same behavior observed for RTX 2080 (also CUDA 11.0). Should I report this as a bug on Github @ptrblck_de ?
FYI this behavior may be specific to torch.matmul since replacing forward prop with some CNN leads to smaller memory allocated when AMP=True, which what we expect. Unfortunately the error between AMD=True and AMD=False gradients is much larger in the case of CNNs…