FineData

Enterprise

community

AI & ML interests

We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)

Recent Activity

guipenedo updated a dataset 3 days ago

HuggingFaceFW/fineweb-2

loubnabnl authored a paper 14 days ago

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text

guipenedo authored a paper 14 days ago

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text

View all activity

HuggingFaceFW 's models 30

HuggingFaceFW/fineweb-edu-classifier

Text Classification • Updated Nov 17, 2024 • 23.4k • • 183

HuggingFaceFW/Datasets-Metrics-Viewer-Data

Updated Sep 2, 2024

HuggingFaceFW/ablation-model-fineweb-edu

Text Generation • Updated Jun 11, 2024 • 1.55k • 14

HuggingFaceFW/ablation-exp-filter-custom-all_filters-28BT

Text Generation • Updated Jun 4, 2024 • 33 • 1

HuggingFaceFW/ablation-exp-filter-custom-line_char_duplicated_0.01-28BT

Text Generation • Updated Jun 4, 2024 • 16 • 2

HuggingFaceFW/ablation-exp-filter-custom-line_ratio_0.67-28BT

Text Generation • Updated Jun 4, 2024 • 18

HuggingFaceFW/ablation-exp-filter-custom-lines_punct_0.12-28BT

Text Generation • Updated Jun 4, 2024 • 17 • 3

HuggingFaceFW/ablation-exp-filter-baseline_c4-28BT

Text Generation • Updated Jun 4, 2024 • 37 • 2

HuggingFaceFW/ablation-exp-filter-baseline_cc-28BT

Text Generation • Updated Jun 4, 2024 • 71 • 4

HuggingFaceFW/ablation-exp-filter-c4-word_lengths-28BT

Text Generation • Updated Jun 4, 2024 • 37 • 2

HuggingFaceFW/ablation-exp-filter-c4-tpunct-28BT

Text Generation • Updated Jun 4, 2024 • 13 • 1

HuggingFaceFW/ablation-exp-filter-c4-curly_bracket-28BT

Text Generation • Updated Jun 4, 2024 • 11

HuggingFaceFW/ablation-exp-filter-c4-all-28BT

Text Generation • Updated Jun 4, 2024 • 13

HuggingFaceFW/ablation-exp-filter-c4-all_except_tpunct-28BT

Text Generation • Updated Jun 4, 2024 • 14

HuggingFaceFW/ablation-exp-textext-wet-28BT

Text Generation • Updated Jun 4, 2024 • 11

HuggingFaceFW/ablation-exp-textext-warc_trafilatura-28BT

Text Generation • Updated Jun 4, 2024 • 14

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_line-350BT

Text Generation • Updated Jun 4, 2024 • 10

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_3line-350BT

Text Generation • Updated Jun 4, 2024 • 12

HuggingFaceFW/ablation-exp-fw-base_filt-ind_mh-c4_filters-350BT

Text Generation • Updated Jun 4, 2024 • 44

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_line_minwords-350BT

Text Generation • Updated Jun 4, 2024 • 15

HuggingFaceFW/ablation-exp-dedup-independent_minhash-350BT

Text Generation • Updated Jun 4, 2024 • 12

HuggingFaceFW/ablation-exp-fw-base_filtering-350BT

Text Generation • Updated Jun 4, 2024 • 35

HuggingFaceFW/ablation-exp-dedup-global_minhash-350BT

Text Generation • Updated Jun 4, 2024 • 16

HuggingFaceFW/ablation-model-redpajama2

Text Generation • Updated May 5, 2024 • 20

HuggingFaceFW/ablation-model-the-pile

Text Generation • Updated Apr 25, 2024 • 14 • 1

HuggingFaceFW/ablation-model-slimpajama

Text Generation • Updated Apr 25, 2024 • 46 • 2

HuggingFaceFW/ablation-model-dolma-v1_6

Text Generation • Updated Apr 25, 2024 • 21 • 2

HuggingFaceFW/ablation-model-c4

Text Generation • Updated Apr 25, 2024 • 16 • 4

HuggingFaceFW/ablation-model-refinedweb

Text Generation • Updated Apr 25, 2024 • 24 • 3

HuggingFaceFW/ablation-model-fineweb-v1

Text Generation • Updated Apr 25, 2024 • 2.55k • 14