Hi @vikasRajashekar
You can use run_language_modeling.py script from here 12 , to use multiple GPU’s you can use the following template
python -m torch.distributed.launch \
    --nproc_per_node=NUM_GPUS_YOU_HAVE run_language_modeling.py \
    --output_dir=output \
    --model_type=gpt2 \
    --model_name_or_path=gpt2 \
    --do_train \
    --train_data_file=$TRAIN_FILE \
    --do_eval \
    --eval_data_file=$TEST_FILE