you can have a look here Quantization aware training comprehensive guide 2 , you can write then a custom quantization algorithm that clamp the values of your weights on the desired range (also activations).
then you annotate the layers you want with the custom quantizer and perform Quantization Aware Training (QAT) as in the tutorial