Solved by ptrblck in post #4 
              
              
                That sounds like an interesting idea! 

Not at all! I really like these new ideas and would like to know how your experiments worked out! 
Here is a small code snippet zeroing out the activations of the linear layer based on the “missing” features of the previous input. My definition of missing is j…