I want to use a transformer for classification. I want to submit a proposal at the entrance, and at the exit I want to classify it into two classes.
Do I have to use a decoder or can I get a softmax at the output of the encoder?