Here’s what I got:
Collecting environment information...                                                                                                                                   PyTorch version: 1.10.0+cu111                                                                                                                                           Is debug build: False                                                                                                                                                   CUDA used to build PyTorch: 11.1                                                                                                                                        ROCM used to build PyTorch: N/A                                                                                                                                                                                                                                                                                                                 OS: Ubuntu 20.04.3 LTS (x86_64)                                                                                                                                         GCC version: (Ubuntu 9.3.0-17ubuntu1~20.04) 9.3.0                                                                                                                       Clang version: Could not collect                                                                                                                                        CMake version: version 3.21.3                                                                                                                                           Libc version: glibc-2.31                                                                                                                                                                                                                                                                                                                        Python version: 3.8.12 | packaged by conda-forge | (default, Oct 12 2021, 21:59:51)  [GCC 9.4.0] (64-bit runtime)
Python platform: Linux-5.11.0-41-generic-x86_64-with-glibc2.10
Is CUDA available: True
CUDA runtime version: 11.6.55
GPU models and configuration:
GPU 0: NVIDIA RTX A6000
GPU 1: NVIDIA RTX A6000

Nvidia driver version: 470.86
cuDNN version: Probably one of the following:
/usr/lib/x86_64-linux-gnu/libcudnn.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_adv_infer.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_adv_train.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_cnn_infer.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_cnn_train.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_ops_infer.so.8.3.2
/usr/lib/x86_64-linux-gnu/libcudnn_ops_train.so.8.3.2
HIP runtime version: N/A
MIOpen runtime version: N/A

Versions of relevant libraries:
[pip3] mypy-extensions==0.4.3
[pip3] numpy==1.22.0
[pip3] pytorch-quantization==2.1.2
[pip3] torch==1.10.0+cu111
[pip3] torch-tensorrt==1.1.0a0
[pip3] torchtext==0.12.0a0
[pip3] torchvision==0.12.0a0
[conda] magma-cuda110             2.5.2                         5    local
[conda] mkl                       2019.5                      281    conda-forge
[conda] mkl-include               2019.5                      281    conda-forge
[conda] mypy_extensions           0.4.3            py38h578d9bd_4    conda-forge
[conda] numpy                     1.22.0           py38h6ae9a64_1    conda-forge
[conda] pytorch-quantization      2.1.2                    pypi_0    pypi
[conda] torch                     1.10.0+cu111             pypi_0    pypi
[conda] torch-tensorrt            1.1.0a0                  pypi_0    pypi
[conda] torchtext                 0.12.0a0                 pypi_0    pypi
[conda] torchvision               0.12.0a0                 pypi_0    pypi

I think the major differences are the Ubuntu version, non-reported cuDNN version, and CUDA runtime version (which should be superseded by 11.1 in the wheels). If possible, I would recommend trying an NGC container to isolate more OS-level differences.