My task is face valence/expression classification so I doubt imagenet weights will be of much use.
I’ll try and see if I can somehow speed up training in mini-batch allocation since I’ve got a Titan Xp which seems to idle when I don’t fit the data-set in GPU memory. Thanks for the advise and help, I’ll give it a try and report back!
My current overall accuracy appears to be around 69-70% using a greyscale derivate of VGG11 with batch normalisation.