content.raw: 🚀 Let’s transform LLMs into encoders 🚀
content.type: text
content.value: 🚀 Let’s transform LLMs into encoders 🚀
content.type: new_line
content.type: new_line
content.raw: Auto-regressive LMs have ruled, but encoder-based architectures like GLiNER are proving to be just as powerful for information extraction while offering better efficiency and interpretability. 🔍✨
content.type: text
content.value: Auto-regressive LMs have ruled, but encoder-based architectures like GLiNER are proving to be just as powerful for information extraction while offering better efficiency and interpretability. 🔍✨
content.type: new_line
content.type: new_line
content.raw: Past encoder backbones were limited by small pre-training datasets and old techniques, but with innovations like LLM2Vec, we've transformed decoders into high-performing encoders! 🔄💡
content.type: text
content.value: Past encoder backbones were limited by small pre-training datasets and old techniques, but with innovations like LLM2Vec, we've transformed decoders into high-performing encoders! 🔄💡
content.type: new_line
content.type: new_line
content.raw: What’s New?
content.type: text
content.value: What’s New?
content.type: new_line
content.raw: 🔹Converted Llama & Qwen decoders to advanced encoders
content.type: text
content.value: 🔹Converted Llama & Qwen decoders to advanced encoders
content.type: new_line
content.raw: 🔹Improved GLiNER architecture to be able to work with rotary positional encoding
content.type: text
content.value: 🔹Improved GLiNER architecture to be able to work with rotary positional encoding
content.type: new_line
content.raw: 🔹New GLiNER (zero-shot NER) & GLiClass (zero-shot classification) models 
content.type: text
content.value: 🔹New GLiNER (zero-shot NER) & GLiClass (zero-shot classification) models 
content.type: new_line
content.type: new_line
content.raw: 🔥 Check it out: 
content.type: text
content.value: 🔥 Check it out: 
content.type: new_line
content.type: new_line
content.raw: New models: 
content.type: text
content.value: New models: 
content.raw: https://huggingface.co/collections/knowledgator/llm2encoder-66d1c76e3c8270397efc5b5e
content.id: knowledgator/llm2encoder-66d1c76e3c8270397efc5b5e
content.type: collection
content.type: resource
content.url: https://huggingface.co/collections/knowledgator/llm2encoder-66d1c76e3c8270397efc5b5e
content.type: new_line
content.type: new_line
content.raw: GLiNER package: 
content.type: text
content.value: GLiNER package: 
content.href: https://github.com/urchade/GLiNER
content.raw: https://github.com/urchade/GLiNER
content.type: link
content.type: new_line
content.type: new_line
content.raw: GLiClass package: 
content.type: text
content.value: GLiClass package: 
content.href: https://github.com/Knowledgator/GLiClass
content.raw: https://github.com/Knowledgator/GLiClass
content.type: link
content.type: new_line
content.type: new_line
content.raw: 💻 Read our blog for more insights, and stay tuned for what’s next!
content.type: text
content.value: 💻 Read our blog for more insights, and stay tuned for what’s next!
content.type: new_line
content.href: https://medium.com/@knowledgrator/llm2encoders-e7d90b9f5966
content.raw: https://medium.com/@knowledgrator/llm2encoders-e7d90b9f5966
content.type: link
content.type: new_line
rawContent: 🚀 Let’s transform LLMs into encoders 🚀
  
  Auto-regressive LMs have ruled, but encoder-based architectures like GLiNER are proving to be just as powerful for information extraction while offering better efficiency and interpretability. 🔍✨
  
  Past encoder backbones were limited by small pre-training datasets and old techniques, but with innovations like LLM2Vec, we've transformed decoders into high-performing encoders! 🔄💡
  
  What’s New?
  🔹Converted Llama & Qwen decoders to advanced encoders
  🔹Improved GLiNER architecture to be able to work with rotary positional encoding
  🔹New GLiNER (zero-shot NER) & GLiClass (zero-shot classification) models 
  
  🔥 Check it out: 
  
  New models: https://huggingface.co/collections/knowledgator/llm2encoder-66d1c76e3c8270397efc5b5e
  
  GLiNER package: https://github.com/urchade/GLiNER
  
  GLiClass package: https://github.com/Knowledgator/GLiClass
  
  💻 Read our blog for more insights, and stay tuned for what’s next!
  https://medium.com/@knowledgrator/llm2encoders-e7d90b9f5966
  
reactions.reaction: 👀
reactions.users: John6666