nthngdy/Llama-3.1-8B-Instruct_qfilt
Updated
•
66
Q-Filters
Pre-computed Q-Filters for efficient KV cache compression.
-
-
nthngdy/Llama-3.2-1B-Instruct_qfilt
Updated • 17 -
nthngdy/Llama-3.2-3B-Instruct_qfilt
Updated • 7 -
nthngdy/Llama-3.2-3B_qfilt
Updated • 7 -
nthngdy/Llama-3.1-8B_qfilt
Updated • 19 -
nthngdy/Llama-3.1-70B-Instruct_qfilt
Updated • 14 -
nthngdy/Llama-3.1-70B_qfilt
Updated • 10 -
nthngdy/Meta-Llama-3.1-405B_qfilt
Updated • 7 -
nthngdy/Mistral-Small-24B-Instruct-2501_qfilt
Updated • 11 -
nthngdy/phi-4_qfilt
Updated • 10 -
nthngdy/Llama-3.2-1B_qfilt
Updated • 43 -
nthngdy/Qwen2.5-7B_qfilt
Updated • 15 -
nthngdy/Qwen2.5-7B-Instruct_qfilt
Updated • 12 -
nthngdy/DeepSeek-R1-Distill-Llama-8B_qfilt
Updated • 9 -
nthngdy/DeepSeek-R1-Distill-Qwen-1.5B_qfilt
Updated • 12