Welcome to LLMLingua-2, a small-size yet powerful prompt compression method trained via data distillation from GPT-4 for token classification with a BERT-level encoder, excels in task-agnostic compression. It surpasses LLMLingua in handling out-of-domain data, offering 3x-6x faster performance. 
text
Welcome to LLMLingua-2, a small-size yet powerful prompt compression method trained via data distillation from GPT-4 for token classification with a BERT-level encoder, excels in task-agnostic compression. It surpasses LLMLingua in handling out-of-domain data, offering 3x-6x faster performance. 
@qianhuiwu
mention
qianhuiwu
text
new_line
new_line
website: 
text
website: 
https://llmlingua.com/llmlingua2.html
https://llmlingua.com/llmlingua2.html
link
new_line
code: 
text
code: 
https://github.com/microsoft/LLMLingua
https://github.com/microsoft/LLMLingua
link
new_line
demo: 
text
demo: 
https://huggingface.co/spaces/microsoft/llmlingua-2
microsoft/llmlingua-2
space
resource
https://huggingface.co/spaces/microsoft/llmlingua-2
Welcome to LLMLingua-2, a small-size yet powerful prompt compression method trained via data distillation from GPT-4 for token classification with a BERT-level encoder, excels in task-agnostic compression. It surpasses LLMLingua in handling out-of-domain data, offering 3x-6x faster performance. @qianhuiwu 

website: https://llmlingua.com/llmlingua2.html
code: https://github.com/microsoft/LLMLingua
demo: https://huggingface.co/spaces/microsoft/llmlingua-2
🔥
victor osanseviero alexandreteles acamilogg88 taisazero Qwoook hieutrungdao jferns
❤️
qianhuiwu
5f17f0a0925b9863e28ad517
https://cdn-avatars.huggingface.co/v1/production/uploads/5f17f0a0925b9863e28ad517/fXIY5i9RLsIa1v3CCuVtt.jpeg
Victor Mustar
victor
user
62aad4f4890c7773a680b3e1
https://cdn-avatars.huggingface.co/v1/production/uploads/1655362804192-noauth.jpeg
Dao Trung Hieu
hieutrungdao
user