@mrshenli
Thanks a lot for finding the machine configs. I will see if I can run in modern hardware.
For K80s that was the best I was able to produce. I did some micro-benchmarks as well to understand some of the bottlenecks. But for my experiments I got the optimum results close to end of the curve (end of the curve meaning the graphs +infinity direction).
But I didn’t get a significant speed up from the code. That’s why I was trying different approaches.