PyTorch 1.12.0 for scheduled CI
# What does this PR do?

After the slack discussion, using PyTorch 1.12.0 for scheduled CI is a better idea, so we can see what to fix.

Another reason is that this (messy) block
https://github.com/huggingface/transformers/blob/39dad9768e75460d8bf92fc27d407562eaeb6bd0/docker/transformers-pytorch-gpu/Dockerfile#L19-L22
will change torch 1.11 (if specified) back to 1.12, as torchvision and torchaudio are installed separately from torch without specifying versions. It's better to avoid such situations.

Regarding the torch/torchvision/torchaudio correspondence, I have better approach in my past-ci PR.

_The documentation is not available anymore as the PR was closed or merged._