Metrics for 110k context size?
1
#4 opened 3 months ago
by
Thireus
6 tokens / seconds Epyc 7532 512 Go ram 7 RTX 3090 65000 Tokens context with ik_llama and this LLM: Thank's !!!
👍
😎
2
4
#2 opened 3 months ago
by
martossien
Wahoo thanks for sharing your work!
38
#1 opened 3 months ago
by
ubergarm