Here is a example notebook: huggingface-course-sagemaker-talk/sagemaker-notebook.ipynb at master · philschmid/huggingface-course-sagemaker-talk · GitHub 1
The repository contains a example script train.py if you want to write your own fine-tuning script and if you want to use the example/ scripts of transformers the notebook also includes instructions for that.