Thank you so much for your advice.
the model trains with bce even with sigmoid
softmax works as well with bce but only up to a certain point and the training collapse.
I am not sure why but I guess it has something to do with the dependency among classes…
Do you know if there is a loss function which will be good for both activation function.