Yes, only the EOS token is really important for the classifier to be able to predict the end of a sentence. The SOS token is only used to kick-off the decoding, and therefore does not need to be added to the sequences.