Solved by nivesh_gadipudi in post #2 
              
              
                A dropout mask is to be used can be applied to the layers by multiplying a tensor of the same size elementwise, this comes in your forward() method so as to apply for the layers irrespective of the input
When you create a dropout mask and apply it to forward propagations the neurons will be inactiv…