Hi,
I am using automatic mixed precision with DataParallel in a single process.
I read the example https://pytorch.org/docs/stable/notes/amp_examples.html#dataparallel-in-a-single-process 1 and it says the @autocast should be added in MyModel before forward.
My question is, should I add the @autocast in the subModel.
For example.
‘’’
MyModel(nn.Module)
…
self. conv1 = subModel(…)
@autocast()
def forward()

‘’’