&gt; <i>I suspect that this compiler is generating ptx and not true native binaries for nvidia&#x27;s architectures</i><p>It would take all of getting to page 2 of the article to confirm this instead of speculating...<p>OTOH, there is an intriguing footnote that<p>&gt; <i>We are also experimenting compiling [virtual ISA] PTX to [Nvidia&#x27;s proprietary Shader ASSembler] SASS before program execution and embedding the SASS directly into the resultant binary</i><p>but the paper mentions in the conclusion that a SASS spec is not publicly available. It would be interesting for someone involved to comment more on that. Experiments on reverse engineering the compiled PTX results?<p>If implementing a replacement for nvcc gave these gains, I would imagine being able to control an offline version of the (normally JIT) compilation to SASS would also yield large benefits. It would likely be incredibly architecture dependent, but for the big machine learning projects that still might be worth the expense.