It’s a bit weird that you are seeing this issue with opt_level='O0', since O0 is pure FP32 training and shouldn’t do anything.
Are you calling half() on any tensors or models? Also, I understand that your code is running fine without using apex at all?