Do you have custom autograd Function in your code?
It seems that one of them returned a gradient which is integer type while gradients should always be floating point types.
Enabling anomaly mode might help you pinpoint the faulty Function.