Ok, so first I need to pass a dummy input to create the parameters:
# instantiate model defined above
model = MyModule()

# pass dummy input
dummy_input = torch.randn((2,2))
model(dummy_input)

Now i can load the state dict. Should I then call model.to(device), and everything will work?