RWKV-GGUF - a RachidAR Collection

RachidAR 's Collections

Fine-Tuned or Trained models

Ternary LLMs & Knowledge distillation & SOTA

Papers

SOTA architecture

RWKV-GGUF

updated Oct 7, 2024

RachidAR/RWKV-v6-Finch-1B6-HF-Q5_K_M-GGUF

Updated Sep 4, 2024 • 1 • 2

Note Works with CUDA and CPU backend
RachidAR/RWKV-v6-Finch-14B-HF-Q5_K_M-GGUF

Updated Sep 4, 2024 • 4 • 1

Note Works only with "--no-warmup" parameter.
RachidAR/RWKV-v6-Finch-7B-HF-Q5_K_M-GGUF

Updated Sep 4, 2024 • 1 • 1

Note Works only with "--no-warmup" parameter.