Solved by ptrblck in post #2 
              
              
                You are reusing the BatchnNorm2d layers in your second approach, while you create new ones in the first approach: 
Out = self.ReLUU(self.BatchNorm_64(self.conv1_1(x)))
Out = self.MaxPool(self.ReLUU(self.BatchNorm_64(self.conv1_2(Out))))