Solved by dalseeroh in post #5 
              
              
                Hello! 
Think I figured it out. Looks like I did correctly fused some operations? 
    for name, module in model.named_modules():
        if type(module) == PartialConvLayer:

            # encoder_1 fusion 
            if "encoder_1" in name:
                torch.quantization.fuse_modules(module, …