🚀 Let’s transform LLMs into encoders 🚀
text
🚀 Let’s transform LLMs into encoders 🚀
new_line
new_line
Auto-regressive LMs have ruled, but encoder-based architectures like GLiNER are proving to be just as powerful for information extraction while offering better efficiency and interpretability. 🔍✨
text
Auto-regressive LMs have ruled, but encoder-based architectures like GLiNER are proving to be just as powerful for information extraction while offering better efficiency and interpretability. 🔍✨
new_line
new_line
Past encoder backbones were limited by small pre-training datasets and old techniques, but with innovations like LLM2Vec, we've transformed decoders into high-performing encoders! 🔄💡
text
Past encoder backbones were limited by small pre-training datasets and old techniques, but with innovations like LLM2Vec, we've transformed decoders into high-performing encoders! 🔄💡
new_line
new_line
What’s New?
text
What’s New?
new_line
🔹Converted Llama & Qwen decoders to advanced encoders
text
🔹Converted Llama & Qwen decoders to advanced encoders
new_line
🔹Improved GLiNER architecture to be able to work with rotary positional encoding
text
🔹Improved GLiNER architecture to be able to work with rotary positional encoding
new_line
🔹New GLiNER (zero-shot NER) & GLiClass (zero-shot classification) models 
text
🔹New GLiNER (zero-shot NER) & GLiClass (zero-shot classification) models 
new_line
new_line
🔥 Check it out: 
text
🔥 Check it out: 
new_line
new_line
New models: 
text
New models: 
https://huggingface.co/collections/knowledgator/llm2encoder-66d1c76e3c8270397efc5b5e
knowledgator/llm2encoder-66d1c76e3c8270397efc5b5e
collection
resource
https://huggingface.co/collections/knowledgator/llm2encoder-66d1c76e3c8270397efc5b5e
new_line
new_line
GLiNER package: 
text
GLiNER package: 
https://github.com/urchade/GLiNER
https://github.com/urchade/GLiNER
link
new_line
new_line
GLiClass package: 
text
GLiClass package: 
https://github.com/Knowledgator/GLiClass
https://github.com/Knowledgator/GLiClass
link
new_line
new_line
💻 Read our blog for more insights, and stay tuned for what’s next!
text
💻 Read our blog for more insights, and stay tuned for what’s next!
new_line
https://medium.com/@knowledgrator/llm2encoders-e7d90b9f5966
https://medium.com/@knowledgrator/llm2encoders-e7d90b9f5966
link
new_line
🚀 Let’s transform LLMs into encoders 🚀

Auto-regressive LMs have ruled, but encoder-based architectures like GLiNER are proving to be just as powerful for information extraction while offering better efficiency and interpretability. 🔍✨

Past encoder backbones were limited by small pre-training datasets and old techniques, but with innovations like LLM2Vec, we've transformed decoders into high-performing encoders! 🔄💡

What’s New?
🔹Converted Llama & Qwen decoders to advanced encoders
🔹Improved GLiNER architecture to be able to work with rotary positional encoding
🔹New GLiNER (zero-shot NER) & GLiClass (zero-shot classification) models 

🔥 Check it out: 

New models: https://huggingface.co/collections/knowledgator/llm2encoder-66d1c76e3c8270397efc5b5e

GLiNER package: https://github.com/urchade/GLiNER

GLiClass package: https://github.com/Knowledgator/GLiClass

💻 Read our blog for more insights, and stay tuned for what’s next!
https://medium.com/@knowledgrator/llm2encoders-e7d90b9f5966

👀
John6666