I trained a model in multi-node, multi-gpu environment.
When I try to load the model for validation, I encounter the following error -
Can someone help?
Thanks.
checkpoint = torch.load(args.resume, map_location=lambda storage, loc: storage)
File “/opt/conda/lib/python2.7/site-packages/torch/serialization.py”, line 303, in load
return _load(f, map_location, pickle_module)
File “/opt/conda/lib/python2.7/site-packages/torch/serialization.py”, line 476, in _load
deserialized_objects[key]._set_from_file(f, offset, f_is_real_file)
RuntimeError: storage has wrong size: expected 128 got 64