Float16 quantized operators do not exist for static quantization. Since current cpus do not support float16 compute natively, converting to float16 for compute bound cases doesn’t provide much performance benefits.
ref_output is from the float model. You might want to check the norm at few different places in the network to see where we are deviating too much from floating point results.