For the first argument you are right, since scales and zero-points are FP, hardware need to support FP for the computation.
The second argument may not be true, for static quantization the output of the previous layer can be fed into next layer without dequantizing to FP. Maybe they are thinking about dynamic quantization, which keeps tensors between two layers in FP.