Thanks K. Frank,
That was very informative. You are right, using the right terminology is crucial. Thanks for correcting me.
I guess I’ll go with MultiLabelSoftMarginLoss even though it seems just like BCEWithLogitsLoss (I’m not sure what are their differences at this point!).
Thanks again,
Mehran