kekpirat:

From my understanding only layers in between the Quant/DequantStubs are supposed to be quantised (is that correct?)


Which layers to quantize is controlled by the qconfig, when we do model.qconfig = torch.quantization.get_default_qat_qconfig('fbgemm') it applies the defaults settings of which modules to swap to the entire model.