Diaries of Open Source. Part 11 🚀
text
Diaries of Open Source. Part 11 🚀
new_line
new_line
🚀Databricks release DBRX, potentially the best open access model! A 132B Mixture of Experts with 36B active params and trained on 12 trillion tokens
text
🚀Databricks release DBRX, potentially the best open access model! A 132B Mixture of Experts with 36B active params and trained on 12 trillion tokens
new_line
Blog: 
text
Blog: 
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
link
new_line
Base and instruct models: 
text
Base and instruct models: 
https://hf.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
databricks/dbrx-6601c0852a0cdd3c59f71962
collection
resource
https://hf.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
new_line
Demo: 
text
Demo: 
https://hf.co/spaces/databricks/dbrx-instruct
https://hf.co/spaces/databricks/dbrx-instruct
link
new_line
new_line
🤏1-bit and 2-bit quantization exploration using HQQ+
text
🤏1-bit and 2-bit quantization exploration using HQQ+
new_line
Blog post: 
text
Blog post: 
https://mobiusml.github.io/1bit_blog/
https://mobiusml.github.io/1bit_blog/
link
new_line
Models: 
text
Models: 
https://hf.co/collections/mobiuslabsgmbh/llama2-7b-hqq-6604257a96fc8b9c4e13e0fe
https://hf.co/collections/mobiuslabsgmbh/llama2-7b-hqq-6604257a96fc8b9c4e13e0fe
link
new_line
GitHub: 
text
GitHub: 
https://github.com/mobiusml/hqq
https://github.com/mobiusml/hqq
link
new_line
new_line
📚Cosmopedia: a large-scale synthetic dataset for pre-training - it includes 25 billion tokens and 30 million files
text
📚Cosmopedia: a large-scale synthetic dataset for pre-training - it includes 25 billion tokens and 30 million files
new_line
Dataset: 
text
Dataset: 
https://hf.co/datasets/HuggingFaceTB/cosmopedia
HuggingFaceTB/cosmopedia
dataset
resource
https://hf.co/datasets/HuggingFaceTB/cosmopedia
new_line
Blog: 
text
Blog: 
https://hf.co/blog/cosmopedia
https://hf.co/blog/cosmopedia
link
new_line
new_line
⭐Mini-Gemini: multi-modal VLMs, from 2B to 34B
text
⭐Mini-Gemini: multi-modal VLMs, from 2B to 34B
new_line
Models: 
text
Models: 
https://hf.co/collections/YanweiLi/mini-gemini-6603c50b9b43d044171d0854
https://hf.co/collections/YanweiLi/mini-gemini-6603c50b9b43d044171d0854
link
new_line
Paper: 
text
Paper: 
Mini-Gemini: Mining the Potential of Multi-modality Vision Language
  Models (2403.18814)
https://huggingface.co/papers/2403.18814
2403.18814
paper
resource
https://huggingface.co/papers/2403.18814
new_line
GitHub: 
text
GitHub: 
https://github.com/dvlab-research/MiniGemini
https://github.com/dvlab-research/MiniGemini
link
new_line
new_line
🔥VILA - On Pre-training for VLMs
text
🔥VILA - On Pre-training for VLMs
new_line
Models: 
text
Models: 
https://hf.co/collections/Efficient-Large-Model/vila-on-pre-training-for-visual-language-models-65d8022a3a52cd9bcd62698e
Efficient-Large-Model/vila-on-pre-training-for-visual-language-models-65d8022a3a52cd9bcd62698e
collection
resource
https://hf.co/collections/Efficient-Large-Model/vila-on-pre-training-for-visual-language-models-65d8022a3a52cd9bcd62698e
new_line
Paper: 
text
Paper: 
VILA: On Pre-training for Visual Language Models (2312.07533)
https://hf.co/papers/2312.07533
2312.07533
paper
resource
https://hf.co/papers/2312.07533
new_line
new_line
Misc
text
Misc
new_line
👀 FeatUp: a framework for image features at any resolution: 
text
👀 FeatUp: a framework for image features at any resolution: 
https://hf.co/spaces/mhamilton723/FeatUp
mhamilton723/FeatUp
space
resource
https://hf.co/spaces/mhamilton723/FeatUp
text
FeatUp: A Model-Agnostic Framework for Features at Any Resolution (2403.10516)
https://hf.co/papers/2403.10516
2403.10516
paper
resource
https://hf.co/papers/2403.10516
new_line
🍞ColBERTus Maxiums, a colbertialized embedding model 
text
🍞ColBERTus Maxiums, a colbertialized embedding model 
https://hf.co/mixedbread-ai/mxbai-colbert-large-v1
mixedbread-ai/mxbai-colbert-large-v1
model
resource
https://hf.co/mixedbread-ai/mxbai-colbert-large-v1
new_line
🖌️Semantic Palette, a new drawing paradigm  
text
🖌️Semantic Palette, a new drawing paradigm  
https://hf.co/spaces/ironjr/SemanticPalette
https://hf.co/spaces/ironjr/SemanticPalette
link
new_line
🧑‍⚕️HistoGPT, a vision model that generates accurate pathology reports  
text
🧑‍⚕️HistoGPT, a vision model that generates accurate pathology reports  
https://hf.co/marr-peng-lab/histogpt
marr-peng-lab/histogpt
model
resource
https://hf.co/marr-peng-lab/histogpt
text
https://www.medrxiv.org/content/10.1101/2024.03.15.24304211v1
https://www.medrxiv.org/content/10.1101/2024.03.15.24304211v1
link
Diaries of Open Source. Part 11 🚀

🚀Databricks release DBRX, potentially the best open access model! A 132B Mixture of Experts with 36B active params and trained on 12 trillion tokens
Blog: https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Base and instruct models: https://hf.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
Demo: https://hf.co/spaces/databricks/dbrx-instruct

🤏1-bit and 2-bit quantization exploration using HQQ+
Blog post: https://mobiusml.github.io/1bit_blog/
Models: https://hf.co/collections/mobiuslabsgmbh/llama2-7b-hqq-6604257a96fc8b9c4e13e0fe
GitHub: https://github.com/mobiusml/hqq

📚Cosmopedia: a large-scale synthetic dataset for pre-training - it includes 25 billion tokens and 30 million files
Dataset: https://hf.co/datasets/HuggingFaceTB/cosmopedia
Blog: https://hf.co/blog/cosmopedia

⭐Mini-Gemini: multi-modal VLMs, from 2B to 34B
Models: https://hf.co/collections/YanweiLi/mini-gemini-6603c50b9b43d044171d0854
Paper: https://huggingface.co/papers/2403.18814
GitHub: https://github.com/dvlab-research/MiniGemini

🔥VILA - On Pre-training for VLMs
Models: https://hf.co/collections/Efficient-Large-Model/vila-on-pre-training-for-visual-language-models-65d8022a3a52cd9bcd62698e
Paper: https://hf.co/papers/2312.07533

Misc
👀 FeatUp: a framework for image features at any resolution: https://hf.co/spaces/mhamilton723/FeatUp https://hf.co/papers/2403.10516
🍞ColBERTus Maxiums, a colbertialized embedding model https://hf.co/mixedbread-ai/mxbai-colbert-large-v1
🖌️Semantic Palette, a new drawing paradigm  https://hf.co/spaces/ironjr/SemanticPalette
🧑‍⚕️HistoGPT, a vision model that generates accurate pathology reports  https://hf.co/marr-peng-lab/histogpt https://www.medrxiv.org/content/10.1101/2024.03.15.24304211v1
🔥
mobicham appoose loubnabnl davanstrien samusenps DmitryRyumin ajibawa-2023 clem GO4code victor vladbogo nikgr VictorSanh reach-vb manuel-tran
❤️
ironjr loubnabnl samusenps clem reach-vb manuel-tran
👍
shiv2050 ssml2050 manuel-tran
6032802e1f993496bc14d9e3
https://cdn-avatars.huggingface.co/v1/production/uploads/6032802e1f993496bc14d9e3/w6hr-DEQot4VVkoyRIBiy.png
Omar Sanseviero
osanseviero
user
6605542e60cba6d2eeb426e6
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/eglpdmqkla3CnYgB5KVFY.jpeg
CloudEnabledSingapore
cloudenabled
user
64aea8ff67511bd3d965697b
https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg
Feynman Innovations
ajibawa-2023
user