🐛  torch baddbmm error fixed for BigCode models
Fixes # (issue)
This was needed because of a bug in pytorch https://github.com/pytorch/pytorch/issues/80588.
The bug was fixed in https://github.com/pytorch/pytorch/pull/96086


## Before submitting
- [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
- [x] Did you read the [contributor guideline](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md#start-contributing-pull-requests),
      Pull Request section?
- [ ] Was this discussed/approved via a Github issue or the [forum](https://discuss.huggingface.co/)? Please add a link
      to it if that's the case.
- [ ] Did you make sure to update the documentation with your changes? Here are the
      [documentation guidelines](https://github.com/huggingface/transformers/tree/main/docs), and
      [here are tips on formatting docstrings](https://github.com/huggingface/transformers/tree/main/docs#writing-source-documentation).
- [ ] Did you write any new necessary tests?

@ArthurZucker @younesbelkada @jlamypoirier
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/transformers/pr_24768). All of your documentation changes will be reflected on that endpoint.<|||||>> I think we don't use PT>2.0.0 that includes the fix you mentioned above, there should be a reason for that. cc @ydshieh

You prediction is 200% correct: we have torch `2.0.1`. The mentioned torch fix is not included in that minor bug release.<|||||>Ah I see thanks for double checking @ydshieh !<|||||>closing this since its not relevant at this point in time.