Article
Bringing Open-Source Models to Spreadsheets 🚀
By
•
•
4Florent Daudens
fdaudens
AI & ML interests
AI & Journalism
Recent Activity
liked
a model
about 8 hours ago
all-hands/openhands-lm-32b-v0.1
posted
an
update
about 13 hours ago
Did we just drop personalized AI evaluation?! This tool auto-generates custom benchmarks on your docs to test which models are the best.
Most benchmarks test general capabilities, but what matters is how models handle your data and tasks. YourBench helps answer critical questions like:
- Do you really need a hundreds-of-billions-parameter model sledgehammer to crack a nut?
- Could a smaller, fine-tuned model work better?
- How well do different models understand your domain?
Some cool features:
📚 Generates custom benchmarks from your own documents (PDFs, Word, HTML)
🎯 Tests models on real tasks, not just general capabilities
🔄 Supports multiple models for different pipeline stages
🧠 Generate both single-hop and multi-hop questions
🔍 Evaluate top models and deploy leaderboards instantly
💰 Full cost analysis to optimize for your budget
🛠️ Fully configurable via a single YAML file
26 SOTA models tested for question generation. Interesting finding: Qwen2.5 32B leads in question diversity, while smaller Qwen models and Gemini 2.0 Flash offer great value for cost.
You can also run it locally on any models you want.
I'm impressed. Try it out: https://huggingface.co/spaces/yourbench/demo
liked
a Space
about 13 hours ago
yourbench/demo
Organizations
fdaudens's activity
published
an
article
9 months ago
published
an
article
9 months ago
Article
Ethics and Society Newsletter #6: Building Better AI: The Importance of Data Quality
By
and 9 others
•
•
34