(Re-)Enable Nightly + Past CI
# What does this PR do?

(Re-)Enable Nightly + Past CI

cc @stas00 : I don't think there is something (related to `DeepSpeed`) that really needs your review in this PR. But if you prefer, you can take a look the 2 `Dockerfile` files under `docker` (and more files if you want). Thank you.

p.s. I launched a full run (without TensorFlow past version CIs) [here](https://github.com/huggingface/transformers/actions/runs/4532718828)
_The documentation is not available anymore as the PR was closed or merged._<|||||>The DS part looks good, @ydshieh

I wonder if you want to continue testing torchdynamo at all. Users wanting to use it should be encouraged to move to torch>=2.0 instead, where it's built in. But a subject for a different PR I guess.<|||||>> The DS part looks good, @ydshieh
> 
> I wonder if you want to continue testing torchdynamo at all. Users wanting to use it should be encouraged to move to torch>=2.0 instead, where it's built in. But a subject for a different PR I guess.

From my side, it would be great if I don't have to deal with all the potential (installation/runtime) issues for such 3rd party libraries across with different torch versions (at least, not with previous torch versions). It's best to focus on the torch and torch+DeepSpeed testing results.<|||||>oh, I meant not testing torchdynamo in general transformers-wide. For sure you don't need any unrelated packages installed to test deepspeed, other its own deps.
<|||||>Without TensorFlow Past CI - it takes 2.5 days to run the Nightly CI + PyTorch Past CI.
I put the schedule to trigger the workflow on Sunday and Thursday at 2 AM.

The TensorFlow past CI will only run under push events.