unsloth/README · Request for GGUF of MAI-DS-R1

Apr 19

Hi Michael & Daniel,

Thank you very much for the very cool dynamic 4-bit quantization and other cutting-edge training tools and bug fixes. I noticed that Microsoft released a better DeepSeeek-R1 like perplexity's R1-1776 that removed the restrictions . I am looking forward to your GGUF version. I found that the quantization cost is very high when I actually operate it, especially some i-matrix versions, and when the quantization strategy of some layers needs to be dynamically adjusted slightly. Thanks again for your adjustments.

https://huggingface.co/microsoft/MAI-DS-R1

shimmyshimmer

Unsloth AI org Apr 22

•

edited Apr 27

Hi we saw that and it looks great we'll see what we can do!

Edit: it's up now: https://huggingface.co/unsloth/MAI-DS-R1-GGUF

orca-zhang changed discussion status to closed Apr 24

shimmyshimmer

Unsloth AI org Apr 27

@orca-zhang we just uploaded them here: https://huggingface.co/unsloth/MAI-DS-R1-GGUF