Hi Paulo,
I am not able to access the gist. Can you fix that? The main code looks ok, except that you are missing calling torch.quantization.fuse_model() which is required for quantization to work.  Quantization does not support unfused batch norms currently.