I don’t know how well TensorRT supports PyTorch ATM, but I know that Nvidia has at least one person working on PyTorch / Torch / etc support. An anecdotal bit of weirdness that he likes mentioning is that PyTorch and Torch have incompatible RNN weight representations 0.o