I figured out how to construct my model, but the problem is how to calculate loss. My case is kind of special, each pic only has one kind of label.
To be more specific, there is a picture, and the pic only have Length of Hand ground truth label, there will be no other three labels.
Pic -> [no, no, ‘long’, no] , no means we don’t have the label, and I use 0 represent no which is same as Invisible.
For now, I add the losses up as my loss, but I think is not accurate, do you have any suggestion?
Thanks!
Dave