I took out the RandonResize yesterday while kept the normalization. I got 84% accuracy on test set after 80 epochs last night. This morning I tried training without the normalization, the model converged really really slow.
Epoch: 1 	Training Loss: 1.214028 	Validation Loss: 0.496487 	Validation Acc: 0.263420
Validation loss decreased (inf --> 0.496487).  Saving model ...
Epoch: 2 	Training Loss: 1.185056 	Validation Loss: 0.475918 	Validation Acc: 0.335629
Validation loss decreased (0.496487 --> 0.475918).  Saving model ...
Epoch: 3 	Training Loss: 1.185590 	Validation Loss: 0.479345 	Validation Acc: 0.276010
Epoch: 4 	Training Loss: 1.176353 	Validation Loss: 0.481123 	Validation Acc: 0.280760
Epoch: 5 	Training Loss: 1.180632 	Validation Loss: 0.478681 	Validation Acc: 0.288836
Epoch: 6 	Training Loss: 1.174871 	Validation Loss: 0.472889 	Validation Acc: 0.280998
Validation loss decreased (0.475918 --> 0.472889).  Saving model ...
Epoch: 7 	Training Loss: 1.174910 	Validation Loss: 0.485266 	Validation Acc: 0.279810
Epoch: 8 	Training Loss: 1.178336 	Validation Loss: 0.476574 	Validation Acc: 0.291449
Epoch: 9 	Training Loss: 1.174524 	Validation Loss: 0.477813 	Validation Acc: 0.294299
Epoch: 10 	Training Loss: 1.171263 	Validation Loss: 0.477734 	Validation Acc: 0.293587
Epoch: 11 	Training Loss: 1.168009 	Validation Loss: 0.476796 	Validation Acc: 0.286698
Epoch: 12 	Training Loss: 1.172514 	Validation Loss: 0.476565 	Validation Acc: 0.294062
Epoch: 13 	Training Loss: 1.173913 	Validation Loss: 0.473833 	Validation Acc: 0.291449
Epoch: 14 	Training Loss: 1.166061 	Validation Loss: 0.474874 	Validation Acc: 0.294299
Epoch: 15 	Training Loss: 1.171629 	Validation Loss: 0.481715 	Validation Acc: 0.292637
Epoch: 16 	Training Loss: 1.150386 	Validation Loss: 0.439620 	Validation Acc: 0.410451

It ended up with 70% test acc. I think the RandomResize was the real problem at the beginning.
However, the original Keras achieved 93% test accuracy. I tried the exact Keras code but only got 87% test acc. I guess that’s due to random initialization?