OK @MariosOreo, it was in the second parameter group.
print(optimizer.param_groups[1])  returned:
{'params': [tensor([[-0.7205,  0.7753,  0.3941,  0.2800,  1.1731],
        [-0.4623,  0.6911,  0.1038,  1.3109,  0.0888],
        [-2.0659,  0.5808,  1.0869, -0.4624,  1.9842],
        [-0.5490,  0.6185, -0.3175, -0.4815,  1.5397],
        [-0.2848,  0.3884, -0.4705, -0.1319,  0.3818]])], 'lr': 0.001, 'momentum': 0.9, 'dampening': 0, 'weight_decay': 0, 'nesterov': False}

where ‘params’ is exactly what is in new tensor.
I understood that after printing the optimizer object.
SGD (
Parameter Group 0
    dampening: 0
    lr: 0.001
    momentum: 0.9
    nesterov: False
    weight_decay: 0

Parameter Group 1
    dampening: 0
    lr: 0.001
    momentum: 0.9
    nesterov: False
    weight_decay: 0
)

that gave me the idea of the other parameter group.