I’ve tried to reproduce the large difference in your outputs, but fail to do so.
I’m currently using your resnet20 implementation with two inputs in the forward pass and fixed inputs.
To further debug, could you post a full code to reproduce this issue, please?