Inference Providers
Active filters: kv-cache
Text Generation
• 27B • Updated • 520
• 9
harshithsaiv/kv-cache-compression
Sariel00/mindnano-ling3-compass
Text Generation
• 8B • Updated • 5.41k
• 1
tfwnotops/Ternary-Bonsai-2-27B-ConstantKV
Text Generation
• 27B • Updated • 999
• 9
Text Classification
• 0.4B • Updated • 35
• 1
Zihant0513/SlimKV-Qwen2.5-14B-r8
Text Generation
• 16B • Updated • 21
• 1
fromthesky/PLDR-LLM-v51-104M
Text Generation
• 0.1B • Updated • 39
fromthesky/PLDR-LLM-v51-110M-1
Text Generation
• 0.1B • Updated • 35
fromthesky/PLDR-LLM-v51-110M-2
Text Generation
• 0.1B • Updated • 32
fromthesky/PLDR-LLM-v51-110M-3
Text Generation
• 0.1B • Updated • 254
fromthesky/PLDR-LLM-v51-110M-4
Text Generation
• 0.1B • Updated • 30
fromthesky/PLDR-LLM-v51-110M-5
Text Generation
• 0.1B • Updated • 29
fromthesky/PLDR-LLM-v51-DAG-110M
Text Generation
• 0.1B • Updated • 27
fromthesky/PLDR-LLM-v51G-106M-1
Text Generation
• 0.1B • Updated • 42
fromthesky/PLDR-LLM-v51G-106M-2
Text Generation
• 0.1B • Updated • 37
fromthesky/PLDR-LLM-v51G-106M-3
Text Generation
• 0.1B • Updated • 348
fromthesky/PLDR-LLM-v51G-106M-test
Text Generation
• 0.1B • Updated • 26
fromthesky/PLDR-LLM-v52-81M-FT-SC-1
Text Classification
• 81M • Updated • 19
fromthesky/PLDR-LLM-v52-81M-FT-QA-1
Question Answering
• 81M • Updated • 42
fromthesky/PLDR-LLM-v52-81M-FT-TC-1
Token Classification
• 81M • Updated • 18
fromthesky/PLDR-LLM-v52-110M-1
Text Generation
• 0.1B • Updated • 29
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Qwen3-32B-QKV-Cache-FP8-Per-Head
Updated
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Tensor
Updated
nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Head
Updated