Make sure you know that the data type and the data set that you've set up is actually the right one. Number six, always use a validation set. Just split one off from a training set if you don't have one. Number seven, try to just start training on one GPU. Number eight, use weights and biases for tracking. And when you're scaling from small to large, increase first the rows, then move to using more VRAM with LoRa instead of QLoRa or full fine tuning instead of LoRa. By the way, there's a factor of four roughly in VRAM difference between each of those.