This means you are feeding a quantized tensor to fake_quantize op, which only supports unquantized tensor, probably because the op with FakeQuantize is not swapped out somehow after the convert, can you paste the model?