Solved by Alexey_Demyanchuk in post #12 
              
              
                Did you try not to use deepcopy at all in your code? 
Also, did you check if your code updating or reassigning a model parameters somewhere (as in linked thread I posted before)? 
Can you update to a current pytorch version?