Sorry it takes the last value after training but :
After restoring , the value of loss is :
Tensor(0.4,grad_fn=)
After 800 steps , the value of  loss is :
Tensor(1.1,grad_fn=)
After 1000 steps :
Tensor(0.6,grad_fn=)
It’s start increasing  for while before decreasing, when i restore the weights, it’s weird .