Hey @anikalburgi,
Since the creation of this topic we released new DLC container, take a look here: Hugging Face on Amazon SageMaker 8
You can use transformers_version=4.6.1 in your Estimator to use the image with datasets 1.6.2.