Arcee Maestro 7B Preview GGUF

Original model: Arcee Maestro 7B Preview

Model creator: Arcee AI

Arcee-Maestro-7B-Preview (7B) is Arcee's first reasoning model trained with reinforment learning. It is based on the Qwen2.5-7B DeepSeek-R1 distillation DeepSeek-R1-Distill-Qwen-7B with further GRPO training. Though this is just a preview of our upcoming work, it already shows promising improvements to mathematical and coding abilities across a range of tasks.

Reinforcement Learning: GRPO with 450,000 verified math problems with some coding examples

This repo contains GGUF format model files for Arcee AI’s Arcee Maestro 7B Preview.

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023.

Converted with llama.cpp build 4748 (revision c392e50), using autogguf-rs.

Prompt template: DeepSeek R1

{{system_message}}<|User|>{{prompt}}<|Assistant|><think>


Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs.ai

cnvrs is the best app for private, local AI on your device:


Original Model Evaluation

Arcee Maestro 7B preview shows great gains in mathematics and coding, surpassing O1 preview in many metrics.

arcee-maestro-7b-preview-evals

Downloads last month
382
GGUF
Model size
7.61B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for brittlewis12/Arcee-Maestro-7B-Preview-GGUF