Attention Is All You Need
Paper
•
1706.03762
•
Published
•
44
Transformer Arch
Checkout: https://bbycroft.net/llm and http://nlp.seas.harvard.edu/2018/04/03/attention.html
-
-
ImageNet Large Scale Visual Recognition Challenge
Paper • 1409.0575 • Published • 8 -
Sequence to Sequence Learning with Neural Networks
Paper • 1409.3215 • Published • 3 -
Language Models are Few-Shot Learners
Paper • 2005.14165 • Published • 11 -
Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time
Paper • 2310.17157 • Published • 11 -
Universal Language Model Fine-tuning for Text Classification
Paper • 1801.06146 • Published • 6 -
Effective Approaches to Attention-based Neural Machine Translation
Paper • 1508.04025 • Published • 2 -
Neural Machine Translation by Jointly Learning to Align and Translate
Paper • 1409.0473 • Published • 4 -
RoFormer: Enhanced Transformer with Rotary Position Embedding
Paper • 2104.09864 • Published • 10 -
Deep Residual Learning for Image Recognition
Paper • 1512.03385 • Published • 6 -
Ring Attention with Blockwise Transformers for Near-Infinite Context
Paper • 2310.01889 • Published • 10