Video-Oasis: Rethinking Evaluation of Video Understanding
Video-Oasis diagnostics reveal that half of existing video benchmarks can be solved without visual input, exposing significant capability gaps in current video understanding models…
Hugging Face · Daily Papers
·Geuntaek Lim, Sungjune Park
·
·▲ 58 upvotes
Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.
Autores: Geuntaek Lim, Sungjune Park, Jaeyun Lee, Inwoong Lee, Taeoh Kim, Dongyoon Wee
- 58 upvotes da comunidade
- Temas: Video-LLM, video understanding, benchmark evaluation, diagnostic suite, video-native challenges, algorithmic design choices
Resumo
Resumo original (em inglês), extraído do paper:
Video-Oasis diagnostics reveal that half of existing video benchmarks can be solved without visual input, exposing significant capability gaps in current video understanding models.