Time to Say Goodbye, torch 1.7 and 1.8
# What does this PR do?

We have been together for more than 2 years ❤️ 

(see this [discussion](https://github.com/huggingface/transformers/issues/18817))
Thank you @sgugger . I will try to make a clean breakup<|||||>_The documentation is not available anymore as the PR was closed or merged._<|||||>Hope I don't miss anything <|||||>ok, the deepspeed CI is running pt-1.8 - how do we solve that then?

I have passed this change to the Deepspeed team let's see what they say.

edit: they followed suit https://github.com/microsoft/DeepSpeed/pull/3082