The exploding loss sounds concerning, which is why I asked about it in the first post, as it would blow up mixed-precision training.
I don’t quite understand the last error. Is the Quantize layer depending on the usage of amp or why is it suddenly not working in float32?