Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth Paper • 2103.03404 • Published Mar 5, 2021 • 1
