Beyond Borrowed Histories: Person-Aligned User Simulation for Interactive Role-Playing Evaluation
arXiv:2607.27816v1 Announce Type: new Abstract: Role-playing agents (RPAs) have become one of the most important consumer applications of large language models. Users engage in multi-turn conversations with RPAs for experiences such as emotional comfort, making reliable evaluation essential for measuring capability, comparing systems, and guiding further improvement. Existing benchmarks, however, typically require an RPA to continue a fixed dialogue history and then evaluate the continuation usi...
arXiv cs.CL
·Yuhang Zhu (University of Science and Technology of China), Mingxuan Du (University of Science and Technology of China), Benfeng Xu (University of Science and Technology of China, MetaStone Technology, Beijing, China), Jie Gao (MetaStone Technology, Beijing, China), Lingyun Yu (University of Science and Technology of China), Hongtao Xie (University of Science and Technology of China)
·
// relacionados