Hey @ptrblck, thanks for your suggestion. Unfortunately that does not change much.
I also attempted to use nvvp to profile the execution on the Nvidia side, and the kernel takes roughly 190ms for compute as shown in the below graph.
Screen Shot 2020-07-03 at 11.11.44 AM531×685 61 KB
That makes me really confused about how to interpret each API’s result.