why in transformer we compute for all tokens but then use only the last token for prediction?

[Ahmedd-Wahdan]

the input is (B,T) to the transformer and the output from the MLP is also (B,T) and we only use the embeddings of the last column to predict the next token why cant we do something with the embeddings of the other tokens? it's my first time learning transformers