Solved by GinnyWeasley in post #4 
              
              
                I’d at least say it is not recommended to use any label that is not in the range [0, C-1]. According to the documentation (see my last answer), there is an optional parameter called ignore_index, but it states: 

Specifies a target value that is ignored and does not contribute to the input gradient.…