Solved by stnoh in post #4 
              
              
                ok… I figured out what was happening. Basically, most problems came from my misusing. 
In my model definition, some parts were already instantiated model, like: 
class Sequential_X(nn.Module):
        ...

sequential_x = Sequential_X()
sequential_x.requires_grad = False ## instantiated in the global…