Article
Introducing Trackio: A Lightweight Experiment Tracking Library from Hugging Face
By
and 4 others
•
•
152Pratyush Sinha
p20p
·
AI & ML interests
None yet
Recent Activity
upvoted
an
article
15 days ago
Introducing Trackio: A Lightweight Experiment Tracking Library from Hugging Face
upvoted
an
article
4 months ago
Bamba-9B-v2 - Fast and powerful!
upvoted
a
collection
6 months ago
ModernBERT
Organizations
None yet
upvoted
an
article
15 days ago
upvoted
an
article
4 months ago
Article
Bamba-9B-v2 - Fast and powerful!
By
and 12 others
•
•
35
upvoted
a
collection
6 months ago
liked
a
Space
8 months ago
liked
a
Space
9 months ago
reacted to
thomwolf's
post with 🔥
10 months ago
Post
4636
[New crazy blog post alert] We are releasing an extensive blog post on the science of creating high quality web-scale datasets, detailing all the steps and learnings that came in our recent 15 trillion tokens 🍷FineWeb release
Inspired by the distill.pub interactive graphics papers, we settled to write the most extensive, enjoyable and in-depth tech report we could draft on so prepare for a 45-mmin read with interactive graphics and all.
And it's not all, in this article we also introduce 📚FineWeb-Edu a filtered subset of Common Crawl with 1.3T tokens containing only web pages with very high educational content. Up to our knowledge, FineWeb-Edu out-performs all openly release web-scale datasets by a significant margin on knowledge- and reasoning-intensive benchmarks like MMLU, ARC, and OpenBookQA
We also make a number of surprising observations on the "quality" of the internet it-self which may challenge some of the general assumptions on web data (not saying more, I'll let you draw your conclusions ;)
HuggingFaceFW/blogpost-fineweb-v1
Inspired by the distill.pub interactive graphics papers, we settled to write the most extensive, enjoyable and in-depth tech report we could draft on so prepare for a 45-mmin read with interactive graphics and all.
And it's not all, in this article we also introduce 📚FineWeb-Edu a filtered subset of Common Crawl with 1.3T tokens containing only web pages with very high educational content. Up to our knowledge, FineWeb-Edu out-performs all openly release web-scale datasets by a significant margin on knowledge- and reasoning-intensive benchmarks like MMLU, ARC, and OpenBookQA
We also make a number of surprising observations on the "quality" of the internet it-self which may challenge some of the general assumptions on web data (not saying more, I'll let you draw your conclusions ;)
HuggingFaceFW/blogpost-fineweb-v1
- 1 reply
upvoted
an
article
about 1 year ago
Article
Large-scale Near-deduplication Behind BigCode
By
•
•
32
liked
a
dataset
about 1 year ago
liked
a
model
almost 2 years ago
liked
5
models
about 2 years ago
microsoft/BioGPT-Large-PubMedQA
Text Generation
•
Updated
•
828
•
116
pritamdeka/PubMedBERT-MNLI-MedNLI
Text Classification
•
0.1B
•
Updated
•
2.33k
•
3
sultan/BioM-BERT-PubMed-PMC-Large
Updated
•
1
•
3
stanford-crfm/BioMedLM
Text Generation
•
Updated
•
3.49k
•
433
pritamdeka/S-PubMedBert-MS-MARCO
Sentence Similarity
•
Updated
•
57.1k
•
31