The 54 is just given as an example, I have varying sequence lengths.
Using transpose fixes that, however I think it’s wrong. and now I’m getting this error:
RuntimeError: CUDA error: device-side assert triggered
Any suggestions?
Logically, I tried to max out the vocab dimension to get the actual prediction, but it seems that cross entropy loss should ‘take care’ of that (+ it gave another error about not supporting long).