DBRX is a mixture-of-experts (MoE) large language model trained from scratch by Databricks.