Is the goal here to only quantize one layer in the entire model with qconfig1? Can you try without specifying the inplace option for prepare_jit and convert_jit?
i.e torch.quantization.prepare_jit(model,  {‘layer1.0.conv1’:qconfig1})
cc @jerryzh168 for additional insight.