MemSyco-Bench: Benchmarking Sycophancy in Agent Memory

MemSyco-Bench: Benchmarking Sycophancy in Agent Memory

Memory plays a crucial role in LLM-based agents, but retrieved memories can cause sycophancy issues where agents over-align with users at the expense of factual accuracy, necessita…

Hugging Face · Daily Papers ·Zhishang Xiang, Zerui Chen · ·▲ 17 upvotes

Este artigo está em destaque na seleção diária de papers do Hugging Face, curada pela comunidade de pesquisa em IA.

Autores: Zhishang Xiang, Zerui Chen, Yunbo Tang, Zhimin Wei, Ruqin Ning, Yujie Lin

  • 17 upvotes da comunidade
  • Temas: memory, LLM-based agents, sycophancy, downstream reasoning, decision-making, MemSyco-Bench

Resumo

Resumo original (em inglês), extraído do paper:

Memory plays a crucial role in LLM-based agents, but retrieved memories can cause sycophancy issues where agents over-align with users at the expense of factual accuracy, necessitating new evaluation benchmarks that assess memory's impact on reasoning and decision-making rather than just storage and retrieval.

Onde ler

compartilhar: