Hey @LeoCordoba,
Your error is coming from caching the dataset. Datasets is caching the dataset on disk to work with it properly. The default cache_dir is ~/.cache/huggingface/datasets. This directory seems not to be on the mounted EBS volume.
To fix your problem you need to define a cache_dirin the load_dataset method. You can copy the run_summarization.py to your local filesystem and adjust
line 313
from
datasets = load_dataset(data_args.dataset_name, data_args.dataset_config_name)

to
datasets = load_dataset(data_args.dataset_name, data_args.dataset_config_name,cache_dir="opt/ml/input")


  
      
      huggingface.co
  
  
    

Loading methods 7

Methods are provided to list and load datasets and metrics. Datasets: Metrics: