we also introduce , a simple yet effective strategy to reduce the computational complexity of transformers (quadratic w.r.t. the number of tokens) during training. 

we find  works well for vision and audio data, probably due to their high redundancy. https://t.co/bkkeeaiwgx