Maybe this is a different type of DropConnect that they are referencing. I was under the impression that DropConnect referred to dropping the weights of a layer during the forward pass, as described in this paper 2. As far as I understand, there would be no way to implement this by using the activations of a layer’s output - it would only work by masking the weights of the layer itself.