Solved by Nikronic in post #2 
              
              
                Hi, the issue is the way you are calculating norm. As outputs do not have same shape, torch broadcast values so you get wrong norm. 

linear = nn.Linear(16, 8)
conv = nn.Conv2d(16, 8, 1)

conv.weight = nn.Parameter(linear.weight.reshape(8, 16, 1, 1))
conv.bias = nn.Parameter(linear.bias)

batch=5
x …