Solved by josipovic in post #3 
              
              
                @ptrblck Thanks for reply! 
Now that I have inspected the model I wonder if there is a problem how I initialize some layers Namely b1, b2, b3, b4,b5. 
class JModel(nn.Module):
    def __init__(self, b=1, r=5):
        super(Jasper, self).__init__()

        self.conv1 = ConvProc(64, 256, 11, 0.2)
  …