Decoding throws Segmentation Fault 
## Environment info
<!-- You can run the command `transformers-cli env` and copy-and-paste its output below.
     Don't forget to fill out the missing fields in that output! -->

- `transformers` version: 4.4.2
- Platform: Linux-5.8.0-48-generic-x86_64-with-glibc2.10
- Python version: 3.8.5
- PyTorch version (GPU?): 1.8.1 (True)
- Tensorflow version (GPU?): 2.4.1 (False)
- Using GPU in script?: <fill in>
- Using distributed or parallel set-up in script?: <fill in>


Models:

- bert


## Information

A very simple decoding step throws `24272 segmentation fault (core dumped)` .

## To reproduce

Steps to reproduce the behavior:

```
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("bert-base-uncased")
print(tokenizer.decode(token_ids=torch.tensor([3446])))
```

<!-- If you have code snippets, error messages, stack traces please provide them here as well.
     Important! Use code tags to correctly format your code. See https://help.github.com/en/github/writing-on-github/creating-and-highlighting-code-blocks#syntax-highlighting
     Do not use screenshots, as they are hard to read and (more importantly) don't allow others to copy-and-paste your code.-->

## Expected behavior

It should print `'rate'`

I get `rate` printed out on my setup! Do you mind sharing your `pip list`?<|||||>This was mentioned in #4857 and #5359 ....fiixed it after reinstalling. <|||||>For me, i didn't have sentencepiece installed. I needed to import torch before transformers to fix this