Thank you for your answer,
Actually the label I am trying to predict is a vector of size 720 and each component each represents a “Count”, so it varies from 0 to +infinity, it’s a positive integer value.
Therefore, I think it’s a regression problem or maybe I am totally wrong but I would need more clarification if possible.
I didn’t understand what you meant by this sentence :

You’d need to output label scores (…,output_size, num_classes)

I tried to use L1Loss and MSELoss, but both of them give the same problem.
Thank you for the Embedding part, for the moment I will keep it like this and try to solve the problem of overfitting first.