Stepanov

Ihor

AI & ML interests

Text classification, computational biology, relations extraction, path reasoning

Recent Activity

Organizations

Knowledgator Engineering's profile picture Blog-explorers's profile picture GLiNER Community's profile picture

Posts 7

view post
Post
961
๐Ÿš€ Welcome the New and Improved GLiNER-Multitask! ๐Ÿš€

Since the release of our beta version, GLiNER-Multitask has received many positive responses. It's been embraced in many consulting, research, and production environments. Thank you everyone for your feedback, it helped us rethink the strengths and weaknesses of the first model and we are excited to present the next iteration of this multi-task information extraction model.

๐Ÿ’ก Whatโ€™s New?
Here are the key improvements in this latest version:
๐Ÿ”น Expanded Task Support: Now includes text classification and other new capabilities.
๐Ÿ”น Enhanced Relation Extraction: Significantly improved accuracy and robustness.
๐Ÿ”น Improved Prompt Understanding: Optimized for open-information extraction tasks.
๐Ÿ”น Better Named Entity Recognition (NER): More accurate and reliable results.

๐Ÿ”ง How We Made It Better:
These advancements were made possible by:
๐Ÿ”น Leveraging a better and more diverse dataset.
๐Ÿ”น Using a larger backbone model for increased capacity.
๐Ÿ”น Implementing advanced model merging techniques.
๐Ÿ”น Employing self-learning strategies for continuous improvement.
๐Ÿ”น Better training strategies and hyperparameters tuning.

๐Ÿ“„ Read the Paper: https://arxiv.org/abs/2406.12925
โš™๏ธ Try the Model: knowledgator/gliner-multitask-v1.0
๐Ÿ’ป Test the Demo: knowledgator/GLiNER_HandyLab
๐Ÿ“Œ Explore the Repo: https://github.com/urchade/GLiNER
view post
Post
359
๐Ÿš€ Letโ€™s transform LLMs into encoders ๐Ÿš€

Auto-regressive LMs have ruled, but encoder-based architectures like GLiNER are proving to be just as powerful for information extraction while offering better efficiency and interpretability. ๐Ÿ”โœจ

Past encoder backbones were limited by small pre-training datasets and old techniques, but with innovations like LLM2Vec, we've transformed decoders into high-performing encoders! ๐Ÿ”„๐Ÿ’ก

Whatโ€™s New?
๐Ÿ”นConverted Llama & Qwen decoders to advanced encoders
๐Ÿ”นImproved GLiNER architecture to be able to work with rotary positional encoding
๐Ÿ”นNew GLiNER (zero-shot NER) & GLiClass (zero-shot classification) models

๐Ÿ”ฅ Check it out:

New models: knowledgator/llm2encoder-66d1c76e3c8270397efc5b5e

GLiNER package: https://github.com/urchade/GLiNER

GLiClass package: https://github.com/Knowledgator/GLiClass

๐Ÿ’ป Read our blog for more insights, and stay tuned for whatโ€™s next!
https://medium.com/@knowledgrator/llm2encoders-e7d90b9f5966

datasets

None public yet