Sounds weird. I have model with completely stupid weights like {-1, 0, 1} and observe no performance gain after I apply --load-profile option.

I did not mean the literal values of the weights, I meant the byte size of the weights themselves, e.g. how many bytes the weights of each conv layer take up. One benefit of quantization is that it shrinks the number of bytes the weights take up by 4x.

I do not believe that glow as AI compiler do not have any debugging tools which includes logs and some intermediate IR representations for observations and analysis.

We have a Graph based high level IR which you can dump a dot file of a DAG representation of it. This is via command line option -dump-graph-DAG="file.dot". We also have the ability to dump our serialized low-level Instruction IR to stdout, via command line option -dump-ir.