You can follow the instructions here 145 on how to gather a profile of a model and then quantize the model. You just need an ONNX proto to load into Glow – see the page on Testing here 20 which discusses how to load a model using one of our example proto model Loaders. We have some limtited support for python via PyTorch through the ONNXIFI interface – you can find info here 17. Otherwise it’s relatively straightforward to run the Testing Loader examples I linked to above after you’ve built in C++ and quantize/run your model.