I want to optimize it for inference.

I’m not sure what this means. Do you have a specific Glow backend you want to run on?

I can’t seem to find any documentation or examples (the ones on the glow repo are cpp only).

To use Glow you need to use C++, at least to build the project and use it out of the box. This may or may not be possible depending on your model – for example we have an image-classifier driver for running on any of our backends, so as long as you can get your model in ONNX or Caffe2 protobuf form we can load it there.