allenai
/

OLMoE-1B-7B-0125-Instruct-GGUF

Model card Files Files and versions Community

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0125-Instruct

Downloads last month: 628

GGUF

Model size

6.92B params

Architecture

olmoe

Hardware compatibility

Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for allenai/OLMoE-1B-7B-0125-Instruct-GGUF

Quantizations

1 model

Collection including allenai/OLMoE-1B-7B-0125-Instruct-GGUF

OLMoE (January 2025)

Improved OLMoE for iOS app. Read more: https://allenai.org/blog/olmoe-app • 10 items • Updated Mar 13 • 12