I think I may have solved my problem by adding require_grad=False. Assigning values to certain tensors caused others to be altered. It was really weird. At this point, some models with the exact same weight perform much differently, but that might just be my computer
Here’s my code 41.