Indeed, it seems it’s worse when the number of groups is larger than 1.
I have opened an issue on github Quantized conv2d with dilation and groups much slower than float32 · Issue #59730 · pytorch/pytorch · GitHub 3