🔍 A recently published technical report introduces MINT-1T, a dataset that will considerably expand open-source multimodal data. It features one trillion text tokens and three billion images and is scheduled for release in July 2024.
text
🔍 A recently published technical report introduces MINT-1T, a dataset that will considerably expand open-source multimodal data. It features one trillion text tokens and three billion images and is scheduled for release in July 2024.
new_line
new_line
Researcher Affiliation: 
text
Researcher Affiliation: 
new_line
new_line
University of Washington
text
University of Washington
new_line
Salesforce Research
text
Salesforce Research
new_line
Stanford University
text
Stanford University
new_line
University of Texas at Austin
text
University of Texas at Austin
new_line
University of California, Berkeley
text
University of California, Berkeley
new_line
new_line
Paper:
text
Paper:
new_line
MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens
text
MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens
new_line
https://arxiv.org/pdf/2406.11271v1.pdf
https://arxiv.org/pdf/2406.11271v1.pdf
link
new_line
new_line
GitHub:
text
GitHub:
new_line
https://github.com/mlfoundations/MINT-1T
https://github.com/mlfoundations/MINT-1T
link
new_line
new_line
Highlights:
text
Highlights:
new_line
new_line
MINT-1T Dataset: Largest open-source multimodal interleaved dataset with 1 trillion text tokens & 3 billion images. 📊🖼️
text
MINT-1T Dataset: Largest open-source multimodal interleaved dataset with 1 trillion text tokens & 3 billion images. 📊🖼️
new_line
Diverse Sources: Incorporates data from HTML, PDFs, and ArXiv documents. 📄📚
text
Diverse Sources: Incorporates data from HTML, PDFs, and ArXiv documents. 📄📚
new_line
Open Source: Dataset and code will be released at 
text
Open Source: Dataset and code will be released at 
https://github.com/mlfoundations/MINT-1T
https://github.com/mlfoundations/MINT-1T
link
. 🌐🔓
text
. 🌐🔓
new_line
Broader Domain Representation: Uses diverse data sources for balanced domain representation. 🌍📚
text
Broader Domain Representation: Uses diverse data sources for balanced domain representation. 🌍📚
new_line
Performance in Multimodal Tasks: The dataset’s scale and diversity should enhance multimodal task performance. 🤖💡
text
Performance in Multimodal Tasks: The dataset’s scale and diversity should enhance multimodal task performance. 🤖💡
new_line
new_line
Datasheet Information:
text
Datasheet Information:
new_line
new_line
Motivation: Addresses the gap in large-scale open-source multimodal datasets. 🌐📊
text
Motivation: Addresses the gap in large-scale open-source multimodal datasets. 🌐📊
new_line
Composition: 927.6 million documents, including HTML, PDF, and ArXiv sources. 📄📚
text
Composition: 927.6 million documents, including HTML, PDF, and ArXiv sources. 📄📚
new_line
Collection Process: Gathered from CommonCrawl WARC and WAT dumps, with rigorous filtering. 🗂️🔍
text
Collection Process: Gathered from CommonCrawl WARC and WAT dumps, with rigorous filtering. 🗂️🔍
new_line
Preprocessing/Cleaning: Removal of low-quality text, duplicates and anonymization of sensitive information. 🧹🔒
text
Preprocessing/Cleaning: Removal of low-quality text, duplicates and anonymization of sensitive information. 🧹🔒
new_line
Ethical Considerations: Measures to ensure privacy and avoid bias. ⚖️🔏
text
Ethical Considerations: Measures to ensure privacy and avoid bias. ⚖️🔏
new_line
Uses: Training multimodal models, generating interleaved image-text sequences, and building retrieval systems. 🤖📖
text
Uses: Training multimodal models, generating interleaved image-text sequences, and building retrieval systems. 🤖📖
new_line
🔍 A recently published technical report introduces MINT-1T, a dataset that will considerably expand open-source multimodal data. It features one trillion text tokens and three billion images and is scheduled for release in July 2024.

Researcher Affiliation: 

University of Washington
Salesforce Research
Stanford University
University of Texas at Austin
University of California, Berkeley

Paper:
MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens
https://arxiv.org/pdf/2406.11271v1.pdf

GitHub:
https://github.com/mlfoundations/MINT-1T

Highlights:

MINT-1T Dataset: Largest open-source multimodal interleaved dataset with 1 trillion text tokens & 3 billion images. 📊🖼️
Diverse Sources: Incorporates data from HTML, PDFs, and ArXiv documents. 📄📚
Open Source: Dataset and code will be released at https://github.com/mlfoundations/MINT-1T. 🌐🔓
Broader Domain Representation: Uses diverse data sources for balanced domain representation. 🌍📚
Performance in Multimodal Tasks: The dataset’s scale and diversity should enhance multimodal task performance. 🤖💡

Datasheet Information:

Motivation: Addresses the gap in large-scale open-source multimodal datasets. 🌐📊
Composition: 927.6 million documents, including HTML, PDF, and ArXiv sources. 📄📚
Collection Process: Gathered from CommonCrawl WARC and WAT dumps, with rigorous filtering. 🗂️🔍
Preprocessing/Cleaning: Removal of low-quality text, duplicates and anonymization of sensitive information. 🧹🔒
Ethical Considerations: Measures to ensure privacy and avoid bias. ⚖️🔏
Uses: Training multimodal models, generating interleaved image-text sequences, and building retrieval systems. 🤖📖

🔥
YaTharThShaRma999 anas-awadalla