Thanks for the suggestion.
I did the preprocessing you mention, also warm up the learning for first 5 epoch, I even tried warm up 20 epochs. Batch size for me is 128 since I feel it is more stable than 64 and 32. optimizer for me is also the same…SGD+momentum… for training scheme is step decay with factor 0.2 on steps of [60,120,160] with initial LR of 0.1
so …ya still cannot reach 70% and I tried this for few weeks already…
ya i should try to initialize the weight differently. see if it will help.