Common Crawl Foundation

commoncrawl's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

malteos 

updated a bucket 35 minutes ago

commoncrawl/commoncrawl

710 TB

lfoppiano 

in commoncrawl/statistics about 3 hours ago

Update data (CC-MAIN-2026-43)

#4 opened about 3 hours ago by

lfoppiano

malteos 

updated a dataset 14 days ago

commoncrawl/commonlid-cache_commonlid_nano

Viewer • Updated 14 days ago • 1.51k • 58 • 2

malteos 

updated a bucket 26 days ago

commoncrawl/test-bucket

69.1 GB

malteos 

in commoncrawl/commonlid-results 28 days ago

Add py3langid results on commonlid_nano

#9 opened 28 days ago by

malteos

Refresh results from results

#6 opened about 1 month ago by

abarbaresi

malteos 

updated a dataset 29 days ago

commoncrawl/CommonLID

Viewer • Updated 29 days ago • 373k • 269 • 57

tvaughan 

in commoncrawl/statistics about 1 month ago

Update data (CC-MAIN-2026-39)

#3 opened about 1 month ago by

tvaughan

malteos 

authored 3 papers about 1 month ago

Table Understanding and (Multimodal) LLMs: A Cross-Domain Case Study on Scientific vs. Non-Scientific Data

Paper • 2507.00152 • Published Jun 30, 2025 • 1

SciLaD: A Large-Scale, Transparent, Reproducible Dataset for Natural Scientific Language Processing

Paper • 2512.11192 • Published Dec 12, 2025 • 1

CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data

Paper • 2601.18026 • Published Jan 25

tvaughan 

updated a bucket about 1 month ago

commoncrawl/warc2zip-examples

4.74 GB

malteos 

in commoncrawl/commonlid-results about 1 month ago

Add GoogleTranslate-v3 results on commonlid_nano

#8 opened about 1 month ago by

malteos

Rename GoogleTranslate to GoogleTranslate-v2

#7 opened about 1 month ago by

malteos

lfoppiano 

updated 2 datasets about 1 month ago

commoncrawl/host-index-testing-v2

Viewer • Updated Sep 15 • 9B • 5.71k • 1

commoncrawl/statistics

Viewer • Updated about 3 hours ago • 658k • 839 • 31

lfoppiano 

in commoncrawl/host-index-testing-v2 about 1 month ago

Update README.md

#1 opened about 1 month ago by

lfoppiano

malteos 

updated 2 Spaces about 1 month ago

Running

4

Web Graph Embeddings

🏢

4

Running

1

What is actually inside llms.txt

📄

1

Analyze llms.txt files for content insights

malteos 

in commoncrawl/commonlid-results about 1 month ago

Adding results from GoogleTranslate for commonlid_nano

#5 opened about 1 month ago by

malteos