Do I have to get mdoel’s architecture and I write model class with quant/dequan stub added??

If you wish to skip quantizing certain layers then yes, this is the recommended way with eager model quantization

If I use torch.quantization.QuantWrapper(module ) , will be this problem solved?

It will add a quant/dequant around the entire model and not for individual modules.