Could you check the device of the parameters in side this state_dict and then try to load the state_dict via map_location='cpu'?
I don’t think this behavior is related to the dataset, but more likely to the previous training run and storage of the state_dict, but I’m also guessing at the moment.