yes, quant/dequant control which areas of the model you want to be in which dtype (torch.float vs torch.quint8).

Quant → ConvBn → DeQuant → SiLU ===> Quant → ConvBn → DeQuant → SiLU

yep, that sounds right.  There is some example code here (Quantization — PyTorch 1.9.1 documentation 3) with similar toy examples.