BEST SYSTEM PROMPT. HUGE PERFORMANCE IMPROVEMENT
#7 opened 18 days ago
by
rombodawg

Draft Model of Speculative Decoding
3
#6 opened 26 days ago
by
nagug
Can I use any Inference Engine(like vllm、ollama) applicable to qwen2.5 to infer Athene-V2-Chat?
1
#5 opened 3 months ago
by
wangdafa
32 B coding model please
3
#4 opened 4 months ago
by
gopi87
inference api not working
2
#3 opened 4 months ago
by
llamameta
Smaller versions incoming?
#2 opened 4 months ago
by
phly95