RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling `cublasCreate(handle)`
### System Info

torch version:  1.12.0+cu113
CUDA:  11.4

`RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling cublasCreate(handle)`

I am getting this error when trying to run using CUDA. Works fine when running in CPU.




### Who can help?

_No response_

### Information

- [ ] The official example scripts
- [ ] My own modified scripts

### Tasks

- [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [ ] My own task or dataset (give details below)

### Reproduction

CODE:

```
import os
import pandas as pd
import time
from transformers import T5Tokenizer, T5ForConditionalGeneration
import torch

tokenizer = T5Tokenizer.from_pretrained("google/flan-t5-xl")
model = T5ForConditionalGeneration.from_pretrained("google/flan-t5-xl", low_cpu_mem_usage=True).to("cuda:0")

def generate(input_text):
  input_ids = tokenizer(input_text, return_tensors="pt").input_ids.to("cuda:0")
  output = model.generate(input_ids, max_length=512)
  return tokenizer.decode(output[0], skip_special_tokens=True)

input_text = 'Something .... Sonethinggg......'

response = generate(input_text)
print(input_text)

```

### Expected behavior

Output
This usually means there is something wrong with your setup install.<|||||>> 

Like version mismatch?