-
Attention Is All You Need
Paper • 1706.03762 • Published • 69 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published • 19 -
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 7 -
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Paper • 1910.01108 • Published • 17
Taufiq Dwi Purnomo
taufiqdp
AI & ML interests
SLM, VLM
Recent Activity
upvoted
a
paper
about 1 hour ago
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data
Processing to Every Language
upvoted
a
collection
3 days ago
Gemma 3n
upvoted
an
article
3 days ago
Gemma 3n fully available in the open-source ecosystem!