unsloth
/

DeepSeek-R1-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (5)

RTX 5090 with 600GB of RAM what models？

#40 opened 2 days ago by

Deploying a production ready service with GGUF on AWS account.

#39 opened 4 days ago by

samagra-tensorfuse

How to Convert DeepSeek-R1-UD-IQ1_M GGUF Back to Safetensors?

#38 opened 5 days ago by

Perplexity comparsion results

#37 opened 5 days ago by

Q2_K_XL model is the best? IQ2_XXS is better than Q2_K_XL in mmlu-pro benchmark

#36 opened 6 days ago by

Long-Form input takes too long

#35 opened 9 days ago by

Q2_K_XL 好还是 Q4好呢

#34 opened 10 days ago by

is it uncensored?

#33 opened 11 days ago by

Cannot Run `unsloth/DeepSeek-R1-GGUF` Model – Missing `configuration_deepseek.py`

#32 opened 15 days ago by

When using llama.cpp to deploy the DeepSeek - R1 - Q4_K_M model, garbled characters appear in the server's response.

#31 opened 16 days ago by

各种量化版本的模型，在不同测评数据集上面的表现怎么样，有没有具体的测试结果

#29 opened 16 days ago by

when using with ollama, does it support kv_cache_type=q4_0 and flash_attention=1?

#28 opened 18 days ago by

如何同时处理多个http请求

#27 opened 18 days ago by

IQ1_S模型合并后部署于ollama上，推理生成效果差

#26 opened 18 days ago by

模型似乎被微调过

#25 opened 19 days ago by

What is the base precision type(FP32/FP16) used in Q2/Q1 quantization?

#23 opened 20 days ago by

any benchmark results?

#22 opened 21 days ago by

Accuracy of the dynamic quants compared to usual quants?

#21 opened 22 days ago by

8bits quantization

#20 opened 23 days ago by

New research paper, R1 type reasoning models can be drastically improved in quality

#19 opened 25 days ago by

md5 / sha256 hashes please

#18 opened 28 days ago by

Is there a model removing non-shared MoE experts?

#17 opened 28 days ago by

A Step-by-step deployment guide with ollama

#16 opened 29 days ago by

No think tokens visible

#15 opened 29 days ago by

Over 2 tok/sec agg backed by NVMe SSD on 96GB RAM + 24GB VRAM AM5 rig with llama.cpp

#13 opened about 1 month ago by

Running the model with vLLM does not actually work

#12 opened about 1 month ago by

DeepSeek-R1-GGUF on LMStudio not available

#11 opened about 1 month ago by

Where did the BF16 come from?

#10 opened about 1 month ago by

Inference speed

#9 opened about 1 month ago by

Running this model using vLLM Docker

#8 opened about 1 month ago by

UD-IQ1_M models for distilled R1 versions?

#6 opened about 1 month ago by

Llama.cpp server chat template

#4 opened about 1 month ago by

Are the Q4 and Q5 models R1 or R1-Zero

#2 opened about 1 month ago by

What is the VRAM requirement to run this ?

#1 opened about 1 month ago by