Normalizing/whitening/decorrelating the input is beneficial as for very simple examples it can be shown that the loss surface is also decorrelated/round and your model can thus be trained easier.
I would generally recommend to take a look at Bishop’s Pattern Recognition and Machine Learning as well as the Deep Learning Book 3.