It’s not an issue even if the weights are stored as FP32 values in memory.
I’m trying to evaluate post training quantization or fine tune the model with quantization aware training, but do this all under under fake quantization to any bit width of my choosing.