Hey @pierreguillou,
Yes, versions still are compatible, but you can upgrade them as you want. You can find an overview of all DLCs + versions at  Reference 3, which should be updated soon. I created a PR to update them add new container version by philschmid · Pull Request #514 · huggingface/huggingface_hub · GitHub 1.
The latest Transformers version is currently 4.12.3. You can also check here for notebook example with newer versions notebooks/sagemaker-notebook.ipynb at master · huggingface/notebooks · GitHub