Normalization actually makes the data have a mean of 0 and a Standard deviation of 1. Most of the times normalization aids in speeding up the training process by making the model converge faster. You can even train in your network without normalization but normalization is highly recommended.