Solved by Epoching in post #4 
              
              
                Oh sorry I misunderstood what you said. Yea from my experience I always use Integer Encoding (e.g. [2, 3, 1, 1] vs [[0 0 1 0], [0 0 0 1], [0 1 0 0], [0 1 0 0] for CrossEntropyLoss and BCELoss  
The docs for CrossEntropyLoss and BCELoss / BCEWithLogitsLoss both show examples using integer encoding th…