Solved by SimonW in post #2 
              
              
                Questions for you: 

Why couldn’t you just load target labels as indices? This will be more memory efficient and arguably run faster in calculating cross entropy loss.




Isn’t it nature that you would get LongTensor when converting one-hot to label indices? Every straightforward way to convert in …