I don’t really understand it either. It only happens when I try to run mixed precision with the problematic layers, including the Quantize layer in float32. If everything is in float32 theres no problem. Even if theres is a way to fix this I’m not sure I would get any significant speedup since most layers would have to run in float32.