[`BLIP`] Fix daily CI failing test
# What does this PR do?

This PR fixes: https://github.com/huggingface/transformers/actions/runs/3754402958/jobs/6378634199

## Why this fix is relevant? 

The reference logits for this test were obtained under pytorch==1.13.1+cu116 and the daily CI uses pytorch==1.13.0+cu116. Setting the tolerance slightly higher (`4e-2`) fixes the test to make it cross-versions compatible. 

cc @LysandreJik @sgugger @ydshieh 
_The documentation is not available anymore as the PR was closed or merged._<|||||>Hmm at the beginning I thought that the `Softmax` was causing the issue, leading to large round errors but the test pass locally with `torch+cu116==1.13.0` but does not pass on the docker image that uses the same version. Will investigate more!<|||||>On GCP (my own/ CI runners), all torch versions give

(torch 1.13.x)
```python
[[0.97982633 0.02017363]]
[[0.50528485]]
```
or (torch 1.12.1)
```
[[0.97982633 0.02017365]]
[[0.5052849]]
```

so
```python
[[0.9798, 0.0202]]
[[0.5053]]
```
will work. Not sure why you got larger differ though, but it is likely an env issue.<|||||>Thanks so much @ydshieh 💯 , the tests seem to pass now on the CI docker image with your suggested values!
Seems that something was wrong with my env indeed