moher:

I understand your explanation, but aren’t the activation maps divided by 1/p to account for those dropped out neurons?


This is not a problem. This is normal. When there are not much feature to account for dropped one, something like this can happen.