ptrblck:

You could create 5 different “heads” in your model, which just uses a small classifier (e.g. single linear layer) to predict the different classes.
This approach would reuse the complete model and just run all heads separately.


in this case I guess I will need 5 different losses (?)