I would like to do sequence classification over the encoder of the T5 model.
Which hidden state of the last layer should I use for the classification? The hidden state of the last timestep or should I take a mean over all timesteps?
Thank you in advance.