Usual approach that I would follow to debug stuff is:

drop the learning rate a bunch, and
use some really simple data initially, maybe just one or two examples
=> you should be able to overfit the simple data really easily

I made a youtube video about overfitting on a sequence of integers, not sure if that is useful?
Train pytorch rnn to predict a sequence of integers