Ashish Vaswani

essentialite's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a paper 1 day ago

Practical Efficiency of Muon for Pretraining

Paper • 2505.02222 • Published 3 days ago • 34

authored 7 papers 28 days ago

Music Transformer

Paper • 1809.04281 • Published Sep 12, 2018 • 2

Efficient Content-Based Sparse Attention with Routing Transformers

Paper • 2003.05997 • Published Mar 12, 2020

Bottleneck Transformers for Visual Recognition

Paper • 2101.11605 • Published Jan 27, 2021

Scaling Local Self-Attention for Parameter Efficient Visual Backbones

Paper • 2103.12731 • Published Mar 23, 2021

Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers

Paper • 2109.10686 • Published Sep 22, 2021

The Efficiency Misnomer

Paper • 2110.12894 • Published Oct 25, 2021

Rethinking Reflection in Pre-Training

Paper • 2504.04022 • Published Apr 5 • 77

upvoted a paper 30 days ago

Rethinking Reflection in Pre-Training

Paper • 2504.04022 • Published Apr 5 • 77