First I want to check some baselines.
how well do established networks work? Can I do this with more simple Networks? I also plan with going for GAN Networks (https://arxiv.org/abs/1905.12868)
The thing is, all my previously trained networks have been using datasets between 4000 and 8000 images. Thereby I was able to play with different parameters, because a training didn’t last very long. And after a lot of different Hyperparameters I figuered out a good Network Strukture.
Now I want to test datasets larger then 300 00 to 1 Million datapoints. Training will be last a lot longer. So I want to start with a established Network, to look where am I
Is this the wrong way to deal with such datasets?