Tip number seven is to try to start training on just one GPU. Again, this allows you to iterate faster. If you really need to increase VRAM, say from what is on a T4 with Colab, then consider paying maybe 70 cents an hour for a 48 GB GPU like an A6000 or an A100 for 80 GB of VRAM.