The problem is now solved.
When I save model and load it, model state_dict’s keys start with “module.” word.
And when I wanted to replace my model params with the saved model params, there was a key mismatch. But I informed about it from jupyter notebook, not from actual script. The script didn’t showed me any warnings:)