New state-of-the-art open LLM! 🚀 Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. 🤯
text
New state-of-the-art open LLM! 🚀 Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. 🤯
new_line
new_line
TL;DR
text
TL;DR
new_line
🧮 132B MoE with 16 experts with 4 active in generation
text
🧮 132B MoE with 16 experts with 4 active in generation
new_line
🪟 32 000 context window
text
🪟 32 000 context window
new_line
📈 Outperforms open LLMs on common benchmarks, including MMLU
text
📈 Outperforms open LLMs on common benchmarks, including MMLU
new_line
🚀 Up to 2x faster inference than Llama 2 70B
text
🚀 Up to 2x faster inference than Llama 2 70B
new_line
💻 Trained on 12T tokens
text
💻 Trained on 12T tokens
new_line
🔡 Uses the GPT-4 tokenizer
text
🔡 Uses the GPT-4 tokenizer
new_line
📜 Custom License, commercially useable
text
📜 Custom License, commercially useable
new_line
new_line
Collection: 
text
Collection: 
https://huggingface.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
databricks/dbrx-6601c0852a0cdd3c59f71962
collection
resource
https://huggingface.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
new_line
Demo: 
text
Demo: 
https://huggingface.co/spaces/databricks/dbrx-instruct
https://huggingface.co/spaces/databricks/dbrx-instruct
link
new_line
new_line
Kudos to the Team at Databricks and MosaicML for this strong release in the open community! 🤗
text
Kudos to the Team at Databricks and MosaicML for this strong release in the open community! 🤗
new_line
New state-of-the-art open LLM! 🚀 Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. 🤯

TL;DR
🧮 132B MoE with 16 experts with 4 active in generation
🪟 32 000 context window
📈 Outperforms open LLMs on common benchmarks, including MMLU
🚀 Up to 2x faster inference than Llama 2 70B
💻 Trained on 12T tokens
🔡 Uses the GPT-4 tokenizer
📜 Custom License, commercially useable

Collection: https://huggingface.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
Demo: https://huggingface.co/spaces/databricks/dbrx-instruct

Kudos to the Team at Databricks and MosaicML for this strong release in the open community! 🤗

🔥
victor alielfilali01 Shinku osanseviero samusenps giux78 Tom-Neverwinter mmhamdy sepal giulianobr carlos-eduardo eppie2 VictorSanh dalraf lunarflu thomwolf clem KvrParaskevi dagelf flymonk
❤️
clem Tom-Neverwinter mmhamdy eppie2 dalraf lunarflu mohammedbriman matthewgjohnson
👍
liminalism
6303cc3e1dd5d3c62483bd51
/avatars/afbc48df2e8c47c35be48168113d83c0.svg
s
Tom-Neverwinter
user
5ff5d596f244529b3ec0fb89
https://cdn-avatars.huggingface.co/v1/production/uploads/1624629516652-5ff5d596f244529b3ec0fb89.png
Philipp Schmid
philschmid
user
65117e52b6ffd31931b67992
/avatars/6529947b6d0274f137c091849a34f3f5.svg
Mohit Khanna
mohitkhannanu
user