I think I figured out the issue. The data I was passing to my ABC network was generated through a saved RNN file, I forgot to use .detach() on that data, so while using my network, the input data was using require_grad=True, which it shouldn’t. Using .detach() fixed the issue. Thanks for suggestions @ptrblck.