Solved by ptrblck in post #2 
              
              
                The Inception models used it to increase the gradient signal during the training as explained in Going Deeper with Convolutions.