Hi,
It is very hard to say I am afraid as we don’t have any way to reproduce the issue or see the code.
Things that you want to check are:

Are gradients flowing properly? Does the params in your net have .grad fields populated with non-zero values?
Is the optimizer setup properly? Does the params it has are the same as the ones where gradients are populated?