Yeah, I did go through the list:
I did the minimum pre-processing,
Keras has default batch size as 32, which is the size I am using right now.
I am using 30% validation split as the Keras model
I switch model mode between train() and eval()
Learning rate is 0.0001 ,1e-4
I will do more test on the Keras code to see if I can get a 93% test acc.