I always thought that Dropout is meant to drop some neurons in a Linear layer to reduce the outgoing features. I did not know that it is used to drop in-coming features as well.
Thank you very much for this information. Also, if you have a source handy where I can read more about dropouts’ this behavior, could you please provide 
BR,