Anchor Large Language Models: Up to 99% KV cache reduction!
text
Anchor Large Language Models: Up to 99% KV cache reduction!
new_line
new_line
paper: 
text
paper: 
https://arxiv.org/pdf/2402.07616.pdf
https://arxiv.org/pdf/2402.07616.pdf
link
Anchor Large Language Models: Up to 99% KV cache reduction!

paper: https://arxiv.org/pdf/2402.07616.pdf
❤️
osanseviero damerajee samusenps pangjh3 clem Excursions Tonic
👍
FM-1976 Tonic
62a3bb1cd0d8c2c2169f0b88
https://cdn-avatars.huggingface.co/v1/production/uploads/62a3bb1cd0d8c2c2169f0b88/eT2TS0IlQbZtz-F_zHLz9.jpeg
Joseph [open/acc] Pollack
Tonic
user