content.raw: 🚨 Launching The Visual Haystacks (VHs) Benchmark: the first "visual-centric" Needle-In-A-Haystack (NIAH) benchmark to assess LMMs' capability in long-context visual retrieval and reasoning. 
content.type: text
content.value: 🚨 Launching The Visual Haystacks (VHs) Benchmark: the first "visual-centric" Needle-In-A-Haystack (NIAH) benchmark to assess LMMs' capability in long-context visual retrieval and reasoning. 
content.type: new_line
content.type: new_line
content.raw: Check it out!
content.type: text
content.value: Check it out!
content.type: new_line
content.raw: https://huggingface.co/datasets/tsunghanwu/visual_haystacks
content.id: tsunghanwu/visual_haystacks
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/tsunghanwu/visual_haystacks
content.type: new_line
content.href: https://visual-haystacks.github.io/
content.raw: https://visual-haystacks.github.io/
content.type: link
content.type: new_line
content.href: https://arxiv.org/abs/2407.13766
content.raw: https://arxiv.org/abs/2407.13766
content.type: link
content.type: new_line
content.href: https://github.com/visual-haystacks/vhs_benchmark
content.raw: https://github.com/visual-haystacks/vhs_benchmark
content.type: link
rawContent: 🚨 Launching The Visual Haystacks (VHs) Benchmark: the first "visual-centric" Needle-In-A-Haystack (NIAH) benchmark to assess LMMs' capability in long-context visual retrieval and reasoning. 
  
  Check it out!
  https://huggingface.co/datasets/tsunghanwu/visual_haystacks
  https://visual-haystacks.github.io/
  https://arxiv.org/abs/2407.13766
  https://github.com/visual-haystacks/vhs_benchmark
reactions.reaction: 🔥
reactions.users: osanseviero