I’ve never seen this issue raised by using apex and suspect the GPU might have some hardware issues.
Depending on the opt_level you are using in apex.amp, we are e.g. patching some PyTorch methods to use FP16 instead of FP32 (whitelist/blacklist style) or transform the model’s parameters to FP16 and use master parameters (master gradients) etc.
apex does not manipulate the hardware in any way and just uses CUDA and PyTorch for e.g. mixed precision training.
How old is the GPU and how long was it working fine?