Hi,
torch.save() is a superset of pickle.dump(). It has the same capabilities (as it uses pickle under the hood), but adds more efficient handling of pytorch tensors.
Using torch.save() of both modules and non-modules should be the simplest solution for you.
I am not sure what will be the exact impact of using pickle.dump() on Module objects. If you do need to know, you should ping smth to know who you should ask about this. You can also check the implementation in this 60 python file.