Could it be that the data/gradients aren’t being cast to the half-precision variants? I don’t know how lightning works or if it’s supposed to include this automatically, but if autocast isn’t included then it won’t matter that AMP is imported.