VLRewardBench: A Challenging Benchmark for Vision-Language Generative Reward Models
arxiv: arxiv.org/abs/2411.174...
project: vl-rewardbench.github.io

New benchmark for vision generative reward models, aka MLLM-as-judge. They have a semi-synthetic preference generation process.