Hi Frank,
It is a mistake. Thanks for pointing out.
But just have a quick question about storing the weights and retrieving them back after training. Weights w3-w100 are used for training the whole network ie, these weights influence the training of some other weights in the network. This is not intended from the original question.
The gradients should not flow through the weights from w3-w100 in an ideal training.
Thanks