I’m not sure I understand the issue correctly. Could you explain what autocast state would refer to and what the initial issue was that you were seeing?
The linked docs give an example of how to use nn.DataParallel. Are you seeing any errors with it?