Hi, what should I do for triggering the fp16 with multiple groups?
Should I modify pytorch source code?
I found alternative implementation (apply each row of weight separately to each batch) is much slower than conv2d with groups (5.3 ms vs 4.6 ms). Thus speed boost with fp16 (3.2 ms) is not that significant (usually should be multiplied by 2~3, in this case less than 2.3 ms).
I guess I’d better to modify the source code in pytorch to make it fully support fp16 in conv2d (with multiple groups).