In that case the restnet50 was too big. In the case of neural networks, the more training data the better, although it’s not really necessary if ur model is really doing well and able to generalize rather than overfit on the training data, but then once in a while it’s good to train it on new datasets.
Though if u want to actually use the restnet50 then u can use a gpu cloud services for that given that it’s too much for ur gpu to handle
Cheers👍