Article
Beyond Image Preferences - Rich Human Feedback for Text-to-Image Generation
By
and 5 others
•
•
13Jason Corkill
jasoncorkill
AI & ML interests
Human data annotation
Recent Activity
reacted
to
their
post
with 👍
about 12 hours ago
We benchmarked @xai-org 's Aurora model, as far as we know the first public evaluation of the model at scale.
We collected 401k human annotations in over the past ~2 days for this, we have uploaded all of the annotation data here on huggingface with a fully permissive license
https://huggingface.co/datasets/Rapidata/xAI_Aurora_t2i_human_preferences
reacted
to
their
post
with 🚀
about 12 hours ago
We benchmarked @xai-org 's Aurora model, as far as we know the first public evaluation of the model at scale.
We collected 401k human annotations in over the past ~2 days for this, we have uploaded all of the annotation data here on huggingface with a fully permissive license
https://huggingface.co/datasets/Rapidata/xAI_Aurora_t2i_human_preferences
reacted
to
their
post
with 🚀
about 12 hours ago
Runway Gen-3 Alpha: The Style and Coherence Champion
Runway's latest video generation model, Gen-3 Alpha, is something special. It ranks #3 overall on our text-to-video human preference benchmark, but in terms of style and coherence, it outperforms even OpenAI Sora.
However, it struggles with alignment, making it less predictable for controlled outputs.
We've released a new dataset with human evaluations of Runway Gen-3 Alpha: Rapidata's text-2-video human preferences dataset. If you're working on video generation and want to see how your model compares to the biggest players, we can benchmark it for you.
🚀 DM us if you’re interested!
Dataset: https://huggingface.co/datasets/Rapidata/text-2-video-human-preferences-runway-alpha
Organizations
jasoncorkill's activity
published
an
article
3 months ago
published
an
article
3 months ago
Article
Crowd-sourced Open Preference Dataset for Text-to-Image Generation
By
and 4 others
•
•
18