Solved by cpeters in post #6 
              
              
                It sounds like it should be a problem on Lightning’s end? There’s nothing about the 3000 series that doesn’t work with AMP (I’ve done it here), and when writing native pytorch the casting is done explicitly.