Segmentation fault whenever trying to load model
### System Info

```shell
`conda list 
# packages in environment at /home/faysal/anaconda3/envs/codexglue:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                      1_llvm    conda-forge
ca-certificates           2021.10.8            ha878542_0    conda-forge
certifi                   2021.5.30        py36h5fab9bb_0    conda-forge
cudatoolkit               10.1.243            h036e899_10    conda-forge
ld_impl_linux-64          2.36.1               hea4e1c9_2    conda-forge
libblas                   3.9.0           14_linux64_openblas    conda-forge
libcblas                  3.9.0           14_linux64_openblas    conda-forge
libffi                    3.4.2                h7f98852_5    conda-forge
libgcc-ng                 11.2.0              h1d223b6_15    conda-forge
libgfortran-ng            11.2.0              h69a702a_15    conda-forge
libgfortran5              11.2.0              h5c6108e_15    conda-forge
liblapack                 3.9.0           14_linux64_openblas    conda-forge
libnsl                    2.0.0                h7f98852_0    conda-forge
libopenblas               0.3.20          pthreads_h78a6416_0    conda-forge
libstdcxx-ng              11.2.0              he4da1e4_15    conda-forge
libzlib                   1.2.11            h166bdaf_1014    conda-forge
llvm-openmp               13.0.1               he0ac6c6_1    conda-forge
mkl                       2022.0.1           h8d4b97c_803    conda-forge
ncurses                   6.3                  h27087fc_1    conda-forge
ninja                     1.10.2               h4bd325d_1    conda-forge
numpy                     1.19.5           py36hfc0c790_2    conda-forge
openssl                   1.1.1n               h166bdaf_0    conda-forge
pip                       21.3.1             pyhd8ed1ab_0    conda-forge
python                    3.6.15          hb7a2778_0_cpython    conda-forge
python_abi                3.6                     2_cp36m    conda-forge
pytorch                   1.4.0           py3.6_cuda10.1.243_cudnn7.6.3_0    pytorch
readline                  8.1                  h46c0cb4_0    conda-forge
setuptools                58.0.4           py36h5fab9bb_2    conda-forge
sqlite                    3.38.2               h4ff8645_0    conda-forge
tbb                       2021.5.0             h924138e_1    conda-forge
tk                        8.6.12               h27826a3_0    conda-forge
tokenizers                0.5.0                    pypi_0    pypi
transformers              2.5.0                    pypi_0    pypi
tree-sitter               0.20.0                   pypi_0    pypi
wheel                     0.37.1             pyhd8ed1ab_0    conda-forge
xz                        5.2.5                h516909a_1    conda-forge
zlib                      1.2.11            h166bdaf_1014    conda-forge`
```


### Who can help?

@LysandreJik
@patrickvonplaten 

### Information

- [ ] The official example scripts
- [ ] My own modified scripts

### Tasks

- [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [ ] My own task or dataset (give details below)

### Reproduction

Whenever I try to run the following code from (https://github.com/microsoft/CodeXGLUE ), it ends in a segmentation fault

`$ python run.py \

--do_train
--do_eval
--model_type roberta
--model_name_or_path $pretrained_model
--config_name roberta-base
--tokenizer_name roberta-base
--train_filename ../data/train.java-cs.txt.java,../data/train.java-cs.txt.cs
--dev_filename ../data/valid.java-cs.txt.java,../data/valid.java-cs.txt.cs
--output_dir $output_dir
--max_source_length 512
--max_target_length 512
--beam_size 5
--train_batch_size 32
--eval_batch_size 32
--learning_rate 5e-5
--train_steps 100
--eval_steps 50

### Expected behavior

```shell
Original issue in codeXglue:
https://github.com/microsoft/CodeXGLUE/issues/117 

They ask me to post the issue here. So posting here for further assistance.
```

Hey @faysalhossain2007,

Could you please provide a short and reproducible code snippet? E.g. if only the model loading leads to a segmentation fault, 
could you please just provide a 4-liner:

```python
from transformers import AutoModel
model = AutoModel.from_pretrained("...")
```<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md) are likely to be ignored.<|||||>Same error here: `Segmentation fault (core dumped)`.

Environment:
```
torch==1.11.0+cu113
transformers==4.30.2
Python 3.7.11
```

I just ran the following testing code snippet

`python -c "from transformers import pipeline; print(pipeline('sentiment-analysis')('we love you'))"`