I get the error:
Didn't find kernel to dispatch to for operator 'aten::fake_quantize_per_tensor_affine'.  Tried to look up kernel for dispatch key 'QuantizedCPUTensorId'. Registered dispatch keys are: [CUDATensorId, CPUTensorId, VariableTensorId].
when trying to evaluate the model after QAT.
My workflow is the same as in the tutorial/documentation:
model.train()
prepare_qat(model, inplace=True)
train(model, run_args)
eval_model = convert(model, inplace=False)
eval(eval_model)