Well, TorchScript can represent arbitrary PyTorch operations, including custom operators.
TensorRT does not support all of them.
Whether mixing the two is desirable depends on your parameters. It is a bit more effort, but it would seem that torch2trt lends itself to that.