content.raw: New state-of-the-art open LLM! 🚀 Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. 🤯
content.type: text
content.value: New state-of-the-art open LLM! 🚀 Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. 🤯
content.type: new_line
content.type: new_line
content.raw: TL;DR
content.type: text
content.value: TL;DR
content.type: new_line
content.raw: 🧮 132B MoE with 16 experts with 4 active in generation
content.type: text
content.value: 🧮 132B MoE with 16 experts with 4 active in generation
content.type: new_line
content.raw: 🪟 32 000 context window
content.type: text
content.value: 🪟 32 000 context window
content.type: new_line
content.raw: 📈 Outperforms open LLMs on common benchmarks, including MMLU
content.type: text
content.value: 📈 Outperforms open LLMs on common benchmarks, including MMLU
content.type: new_line
content.raw: 🚀 Up to 2x faster inference than Llama 2 70B
content.type: text
content.value: 🚀 Up to 2x faster inference than Llama 2 70B
content.type: new_line
content.raw: 💻 Trained on 12T tokens
content.type: text
content.value: 💻 Trained on 12T tokens
content.type: new_line
content.raw: 🔡 Uses the GPT-4 tokenizer
content.type: text
content.value: 🔡 Uses the GPT-4 tokenizer
content.type: new_line
content.raw: 📜 Custom License, commercially useable
content.type: text
content.value: 📜 Custom License, commercially useable
content.type: new_line
content.type: new_line
content.raw: Collection: 
content.type: text
content.value: Collection: 
content.raw: https://huggingface.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
content.id: databricks/dbrx-6601c0852a0cdd3c59f71962
content.type: collection
content.type: resource
content.url: https://huggingface.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
content.type: new_line
content.raw: Demo: 
content.type: text
content.value: Demo: 
content.href: https://huggingface.co/spaces/databricks/dbrx-instruct
content.raw: https://huggingface.co/spaces/databricks/dbrx-instruct
content.type: link
content.type: new_line
content.type: new_line
content.raw: Kudos to the Team at Databricks and MosaicML for this strong release in the open community! 🤗
content.type: text
content.value: Kudos to the Team at Databricks and MosaicML for this strong release in the open community! 🤗
content.type: new_line
rawContent: New state-of-the-art open LLM! 🚀 Databricks just released DBRX, a 132B MoE trained on 12T tokens. Claiming to surpass OpenAI GPT-3.5 and is competitive with Google Gemini 1.0 Pro. 🤯
  
  TL;DR
  🧮 132B MoE with 16 experts with 4 active in generation
  🪟 32 000 context window
  📈 Outperforms open LLMs on common benchmarks, including MMLU
  🚀 Up to 2x faster inference than Llama 2 70B
  💻 Trained on 12T tokens
  🔡 Uses the GPT-4 tokenizer
  📜 Custom License, commercially useable
  
  Collection: https://huggingface.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
  Demo: https://huggingface.co/spaces/databricks/dbrx-instruct
  
  Kudos to the Team at Databricks and MosaicML for this strong release in the open community! 🤗
  
reactions.reaction: 🔥
reactions.users: victor alielfilali01 Shinku osanseviero samusenps giux78 Tom-Neverwinter mmhamdy sepal giulianobr carlos-eduardo eppie2 VictorSanh dalraf lunarflu thomwolf clem KvrParaskevi dagelf flymonk
reactions.reaction: ❤️
reactions.users: clem Tom-Neverwinter mmhamdy eppie2 dalraf lunarflu mohammedbriman matthewgjohnson
reactions.reaction: 👍
reactions.users: liminalism
commentators._id: 6303cc3e1dd5d3c62483bd51
commentators.avatarUrl: /avatars/afbc48df2e8c47c35be48168113d83c0.svg
commentators.fullname: s
commentators.name: Tom-Neverwinter
commentators.type: user
commentators._id: 65117e52b6ffd31931b67992
commentators.avatarUrl: /avatars/6529947b6d0274f137c091849a34f3f5.svg
commentators.fullname: Mohit Khanna
commentators.name: mohitkhannanu
commentators.type: user
commentators._id: 5ff5d596f244529b3ec0fb89
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1624629516652-5ff5d596f244529b3ec0fb89.png
commentators.fullname: Philipp Schmid
commentators.name: philschmid
commentators.type: user