🚀 Introducing ColFlor: An Efficient, OCR-Free Vision-Language Document Retrieval Model 🌟
text
🚀 Introducing ColFlor: An Efficient, OCR-Free Vision-Language Document Retrieval Model 🌟
new_line
new_line
Earlier this year, ColPali revolutionized document retrieval by eliminating the need for error-prone OCR pipelines. Instead, it directly processes the document images. However, with its 3 billion parameters, ColPali is computationally heavy for large-scale applications.
text
Earlier this year, ColPali revolutionized document retrieval by eliminating the need for error-prone OCR pipelines. Instead, it directly processes the document images. However, with its 3 billion parameters, ColPali is computationally heavy for large-scale applications.
new_line
new_line
That’s where ColFlor comes in—a smaller, faster alternative! 🎉 At 17x smaller than ColPali, ColFlor offers a more efficient, OCR-free document retrieval solution, making it ideal for users with limited computing resources (GPU Poor). 💡
text
That’s where ColFlor comes in—a smaller, faster alternative! 🎉 At 17x smaller than ColPali, ColFlor offers a more efficient, OCR-free document retrieval solution, making it ideal for users with limited computing resources (GPU Poor). 💡
new_line
text
new_line
Key Highlights:
text
Key Highlights:
new_line
🧠 174M parameters (vs. 3B for ColPali)
text
🧠 174M parameters (vs. 3B for ColPali)
new_line
⚡ 9.8x faster query encoding, 5.25x faster image encoding
text
⚡ 9.8x faster query encoding, 5.25x faster image encoding
new_line
📉 Only 1.8% performance drop on text-rich English documents
text
📉 Only 1.8% performance drop on text-rich English documents
new_line
new_line
Check out the full blog post for more insights on modeling, training, and evaluations across various document retrieval tasks! 🚀
text
Check out the full blog post for more insights on modeling, training, and evaluations across various document retrieval tasks! 🚀
new_line
Also, feel free to try our demo on huggingface 🤗 
text
Also, feel free to try our demo on huggingface 🤗 
new_line
new_line
🔗 Resources:
text
🔗 Resources:
new_line
📄 Blog post: 
text
📄 Blog post: 
https://huggingface.co/blog/ahmed-masry/colflor
https://huggingface.co/blog/ahmed-masry/colflor
link
new_line
🧠 Model: 
text
🧠 Model: 
https://huggingface.co/ahmed-masry/ColFlor
ahmed-masry/ColFlor
model
resource
https://huggingface.co/ahmed-masry/ColFlor
new_line
💻 Demo: 
text
💻 Demo: 
https://huggingface.co/spaces/ahmed-masry/ColFlor-Demo
ahmed-masry/ColFlor-Demo
space
resource
https://huggingface.co/spaces/ahmed-masry/ColFlor-Demo
new_line
🏋️‍♂️ Training code: 
text
🏋️‍♂️ Training code: 
https://github.com/AhmedMasryKU/colflor
https://github.com/AhmedMasryKU/colflor
link
new_line
📊 Evaluation code: 
text
📊 Evaluation code: 
https://github.com/AhmedMasryKU/vidore-benchmark-colflor
https://github.com/AhmedMasryKU/vidore-benchmark-colflor
link
text
new_line
🚀 Introducing ColFlor: An Efficient, OCR-Free Vision-Language Document Retrieval Model 🌟

Earlier this year, ColPali revolutionized document retrieval by eliminating the need for error-prone OCR pipelines. Instead, it directly processes the document images. However, with its 3 billion parameters, ColPali is computationally heavy for large-scale applications.

That’s where ColFlor comes in—a smaller, faster alternative! 🎉 At 17x smaller than ColPali, ColFlor offers a more efficient, OCR-free document retrieval solution, making it ideal for users with limited computing resources (GPU Poor). 💡
 
Key Highlights:
🧠 174M parameters (vs. 3B for ColPali)
⚡ 9.8x faster query encoding, 5.25x faster image encoding
📉 Only 1.8% performance drop on text-rich English documents

Check out the full blog post for more insights on modeling, training, and evaluations across various document retrieval tasks! 🚀
Also, feel free to try our demo on huggingface 🤗 

🔗 Resources:
📄 Blog post: https://huggingface.co/blog/ahmed-masry/colflor
🧠 Model: https://huggingface.co/ahmed-masry/ColFlor
💻 Demo: https://huggingface.co/spaces/ahmed-masry/ColFlor-Demo
🏋️‍♂️ Training code: https://github.com/AhmedMasryKU/colflor
📊 Evaluation code: https://github.com/AhmedMasryKU/vidore-benchmark-colflor 

👀
John6666 Chris4K
🔥
adorkin