Hello @bkuchars,
Thank you for opening this thread!
To confirm it you are running inside a VPC without internet access?
If yes the script train.py cannot work since in the lines 55 and 87 you are loading the tokenizer and model with the .from_pretrained method. Transformers is trying to load the model from Models - Hugging Face and without internet access, this won’t work.
To solve this you would need to upload your model to s3 and then you can provide the third key in training_data with "model" pointing to a s3uri. SageMaker will then also load the model on start up to the runtime and then you can load the model from disk.
Therefore you would need to change the parameters in .from_pretrained() to the local directory where to model is saved. In this case, it should be /opt/ml/input/data/model