Unfortunately, only 1728 is a multiple of 8, so that this operation won’t be sped up in a GEMM using FP16.
On my Titan V, the operation in FP16 is approx. 10x slower than in FP32.
When I adapt the shapes to multiples of 8, I get approx. a 2x speedup.