OpenBioRQ: Unsolved Biomedical Research Questions for Agents

OpenBioRQ: Unsolved Biomedical Research Questions for Agents

A new biomedical benchmark evaluates agentic models' ability to verify sources and avoid false citations by testing unsolved research questions with no answer keys, revealing signi…

Hugging Face · Daily Papers ·Minbyul Jeong · ·▲ 3 upvotes

Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.

Autores: Minbyul Jeong

  • 3 upvotes da comunidade
  • Temas: agentic models, retrieval-grounded benchmark, biomedical research questions, citation verification, tool usage, agentic collapse

Resumo

Resumo original (em inglês), extraído do paper:

A new biomedical benchmark evaluates agentic models' ability to verify sources and avoid false citations by testing unsolved research questions with no answer keys, revealing significant failures in retrieval-grounded reasoning and tool usage.

Onde ler

compartilhar: