Hi Srinath!



 YASJAY:

my target values do not sum to 1, that is, they are not soft-labels.


That’s okay.  You can still use the “soft-label cross-entropy” I linked to
above – the math still goes through.  It won’t – precisely speaking –
be a true cross-entropy (which compares two true probability
distributions), but it will give you a reasonable loss function.
(And, to be sure, if you pass your targets that don’t sum to one to
tf.nn.softmax_cross_entropy_with_logits(), nothing changes,
and you will still have a the same issue.)
Best.
K. Frank