Skip failing test for now
# What does this PR do?

All is said in the title. Test is currently failing on main for no reason (I imagine a new release of one of the deps), more can be found [here](https://app.circleci.com/pipelines/github/huggingface/transformers/55784/workflows/83b929a9-3d0d-482a-a823-806f44824bf8/jobs/673138).

cc @sanchit-gandhi 
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/transformers/pr_21226). All of your documentation changes will be reflected on that endpoint.