I’ve never used GPT models before. However, if they are available on huggingface, I guess fine-tuning it won’t be different than fine-tuning any other model. I use PyTorch Lightning for training and replacing any huggingface models with each other wouldn’t change the process I guess…