How do I set a high dropout rate during the beginning of training, to make weight matrix more sparse, and after every certain epochs, keep reducing this dropout rate?
for example, for the first 50 epochs, dropout rate could be 0.7, for next 50 epochs, 0.6, then 0.5, and for last 50 epochs, dropout rate could be 0.2.
And during evaluation use last dropout rate.