Incidentally, I can reproduce the issue with a tiny test model: adding a += step to forward() makes it non-quantizable.
(BTW, I am aware of  torch.nn.quantized.FloatFunctional  4 – my use case prevents such intrusive model modifications)