I am an idiot. The reason I thought that the output is supposed to be 0 is because my calculations on the paper were wrong, I just copied the results. Sorry bout the confusion.
Now I don’t know how am I supposed to test the custom function, my labels are not class labels, they are just probability vectors (basically the labels are precomputed probability maps), therefore I don’t have the option of using the original CE loss.
I can generate new labels that match the input to pytorch’s CE but then I get an error because the labels are still of bigger dimension than it supports.