SteveMama:

Near dummy_model, I see that you have linked the config file as model.config


oops that was a typo! i should have written that we load the saved config:
from transformers import AutoConfig
# load config and dummy model
config = AutoConfig.from_pretrained("pegasus-quantized-config")
dummy_model = PegasusForConditionalGeneration(config)

if i am not mistaken this should allow you to load just the quantized model, but since this is pseudocode you should do some checks to see if the dummy_model is really light on disk / RAM (as I expect it should be)