Solved by jerryzh168 in post #3 
              
              
                Yes, graph mode quantization will be ready for testing after https://github.com/pytorch/pytorch/pull/32303 lands. 
Next we are going to test more models and fix the issues we see in the process, this might take a few more weeks to a month or so, but in the meantime, feel free to checkout the master …