Something I should mention as well is that you can waste a lot of time with installations and getting stuck in getting set up for fine tuning. One way around that is to use an image or a template that sets up your CUDA and PyTorch to a specific version. I've got a one-click template here for RunPod, and you can use that to consistently have the same environment on which to install the final packages you need for fine tuning. Tip number eight is to use weights and biases.