Solved by Michela in post #2 
              
              
                Dropout stochastically drops connections at every pass, but then reinstates them at the following pass, while dropping new ones. It’s a regularization technique. After training, at evaluation time, all connections are present again. Random pruning (structured or unstructured) permanently removes u…