I am training a bilinear similarity model with a multi-label max-margin loss function. The problem I have is that the model trains perfectly fine on the cpu and returns expected results (close to the baseline). However, the model returns completely incorrect results when I train the system on the gpu. How do I debug this problem?
This is the paper that I am trying to replicate - https://www.cs.northwestern.edu/~ddowney/publications/zheng_aaai_2018.pdf 7
Any help would be appreciated!