That is a very valid concern and a key motivation for the proposed StreamExecutor project (<a href="http:&#x2F;&#x2F;lists.llvm.org&#x2F;pipermail&#x2F;llvm-dev&#x2F;2016-March&#x2F;096576.html" rel="nofollow">http:&#x2F;&#x2F;lists.llvm.org&#x2F;pipermail&#x2F;llvm-dev&#x2F;2016-March&#x2F;096576.h...</a>).