Yes, the range could be outside of [0, 1] and would ideally have a zero mean and unit variance.
Also yes, that’s beneficial for the network training. ML literature calls this normalization often “whitening” and you should be able to find more explanations e.g. in Bishop’s Pattern Recognition and Machine Learning or other references.