---
license: apache-2.0
language:
- en
tags:
- moe
- olmo
- olmoe
- molmo
- molmoe
co2_eq_emissions: 1
datasets:
- allenai/OLMoE-mix-0924
library_name: transformers
---

<img alt="Molmo Logo." src="molmo_logo.png" width="250px">

# Model Summary

> MolmoE-1B is a multimodal Mixture-of-Experts LLM with 1.5B active and 7.2B total parameters released in September 2024 (0924) based on [OLMoE-1B-7B-0924](https://huggingface.co/allenai/OLMoE-1B-7B-0924). It yields state-of-the-art performance among multimodal models with a similar size while being fully open-source.

- **Paper:** WIP
- **Code:** WIP

# Use

WIP

# Evaluation Snapshot

WIP

# Citation

WIP