No, you’d need to do the pre-inference model preparation, i.e. the fuse and prepare steps.
This is the code that PL runs to prepare the model: pytorch-lightning/quantization.py at 92cf396de2fe49e89a625a200d641bd8b6aeb328 · PyTorchLightning/pytorch-lightning · GitHub 19
This is what needs to be run in order to load the checkpoint since the checkpoint is for the model after its been fused/prepared.
Figuring out how to do this would require PL expertise that I don’t have, it may be a good idea to ask at the PL forum: https://forums.pytorchlightning.ai/ 3