I think the resize worked!  But replacing register_backwards_hook() did not fix my original problem.  I’ll post a new thread for that for where I am now.  Thanks!

  
    
    
    Multi GPU Hook not correctly filling buffer 
  
  
    Coming from Multi GPU backwards hook on wrong device, that fixed it so it didnt error anymore, but it is not actually returning the same value with 1 GPU and 2.  I was informed in Initializing a member tensor after creation with DataParallel (repost) that I shouldn’t be using register_backwards_hooks at all, so now I am doing it with a custom function.  I think this is all the relevant code: 
My values tracker looks like 
class valueTracker(nn.Module):
    def __init__(self, out_channels):
     …