Eugenio Palumbo
eugpal4
·
AI & ML interests
None yet
Recent Activity
new activity
about 1 month ago
agents-course/First_agent_template:Create main.py
new activity
about 1 month ago
agents-course/Final_Assignment_Template:Update app.py
replied to
clefourrier's
post
about 1 month ago
Always surprised that so few people actually read the FineTasks blog, on
✨how to select training evals with the highest signal✨
If you're serious about training models without wasting compute on shitty runs, you absolutely should read it!!
An high signal eval actually tells you precisely, during training, how wel & what your model is learning, allowing you to discard the bad runs/bad samplings/...!
The blog covers in depth prompt choice, metrics, dataset, across languages/capabilities, and my fave section is "which properties should evals have"👌
(to know on your use case how to select the best evals for you)
Blog: https://huggingface.co/spaces/HuggingFaceFW/blogpost-fine-tasks
Organizations
