Hi Robbie!



 import-antigravity:

Getting between 100-6000 us per call. It looks like some calls are taking really long and others are not.


Please note the torch.cuda.synchronize() in @ptrblck’s sample
code.  Without it you will get unreliable gpu timings.
(Also, please avoid posting screenshots of textual information.  It
breaks accessibility, searchability, and copy-paste.)
Best.
K. Frank