Hello, I am new in Deep Learning and Pytorch.
I’m interested  in making fast deep-learning model.
So I have tried to run dynamic quantized model on BERT tutorial in pytorch.org 5.
I had program run on Intel Xeon E5-2620 v4 system,
and checked that the quantized model is smaller than original model(438M -> 181.5M).
but totall-evalluate time of quantized model is slower than original model(122.3 -> 123.2);
I had  program run on same-spec but different computer, result was same;
I also had program run on AMD ryzen 2600, ryzen 3950x system,
in this case, execution speed  was slower than intel system,
but totall-evalutate quantized model was faster than original model;