LLM-enabled multi-agent social interaction, collaboration and competition: a survey

Jingqi LIU , Bin GUO , Yingshan ZHANG , Hao WANG , Yahan PEI , Sinuo ZHAO , Ying LIU , Yunji LIANG , Zhiwen YU

Front. Comput. Sci. ›› 2027, Vol. 21 ›› Issue (7) : 2107351

PDF (3915KB)
Front. Comput. Sci. ›› 2027, Vol. 21 ›› Issue (7) :2107351 DOI: 10.1007/s11704-026-51881-8
Artificial Intelligence
REVIEW ARTICLE
LLM-enabled multi-agent social interaction, collaboration and competition: a survey
Author information +
History +
PDF (3915KB)

Abstract

Recent breakthroughs in Large Language Models (LLMs) revolutionize the field of Natural Language Processing (NLP), driving advancements in comprehension, reasoning, and content generation. These models achieve remarkable performance in specific tasks but encounter limitations in complex social interactions, motivating the development of multi-agent systems that enable dynamic collaboration and competition. LLM-based multi-agent systems, using natural language as the primary medium of interaction, emerge as key enablers of digital social relationships and collective intelligence. At the same time, these systems introduce challenges in modeling agent social behaviors, optimizing collaboration efficiency, and adapting game-theoretic strategies. This survey addresses gaps in the existing literature by systematically exploring the theoretical foundations of LLM-powered social agents, drawing insights from cognitive science and sociology. We first introduce relevant sociological and cognitive theories and propose framework to model social intelligence in multi-agent systems. Based on this framework, we comprehensively review key techniques for social agent construction, collaboration, competition, as well as their application scenarios and evaluation methodologies. Finally, we identify future research directions, with particular emphasis on constructing large-scale cognitive world models and modeling the growth and evolution of multi-agent systems. This work establishes a solid foundation for advancing the understanding of social dynamics in LLM-based multi-agent environments.

Graphical abstract

Keywords

large language models / multi-agent systems / social interaction / collective intelligence

Cite this article

Download citation ▾
Jingqi LIU, Bin GUO, Yingshan ZHANG, Hao WANG, Yahan PEI, Sinuo ZHAO, Ying LIU, Yunji LIANG, Zhiwen YU. LLM-enabled multi-agent social interaction, collaboration and competition: a survey. Front. Comput. Sci., 2027, 21 (7) : 2107351 DOI:10.1007/s11704-026-51881-8

登录浏览全文

4963

注册一个新账户 忘记密码

References

[1]

McCarthy J, Minsky M L, Rochester N, Shannon C E . A proposal for the Dartmouth summer research project on artificial intelligence, August 31, 1955. AI Magazine, 2006, 27( 4): 12–14

[2]

Moor J . The Dartmouth college artificial intelligence conference: the next fifty years. AI Magazine, 2006, 27( 4): 87–91

[3]

Licklider J C R. Man-computer symbiosis. IRE Transactions on Human Factors in Electronics, 1960, HFE-1(1): 4−11

[4]

Preece J, Rogers Y, Sharp H, Benyon D, Holland S, Carey T. Human-Computer Interaction. Edinburgh: Addison-Wesley Longman Ltd., 1994

[5]

Shortliffe E H, Buchanan B G. A model of inexact reasoning in medicine. Mathematical Biosciences, 1975, 23(3−4): 351−379

[6]

Shoham Y, Leyton-Brown K. Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations. Cambridge: Cambridge University Press, 2008

[7]

OpenAI. Gpt-4 technical report. 2023, arXiv preprint arXiv: 2303.08774

[8]

Gemini Team Google. Gemini: a family of highly capable multimodal models. 2023, arXiv preprint arXiv: 2312.11805

[9]

Touvron H, Lavril T, Izacard G, Martinet X, Lachaux M A, Lacroix T, Rozière B, Goyal N, Hambro E, Azhar F, Rodriguez A, Joulin A, Grave E, Lample G. LLaMA: open and efficient foundation language models. 2023, arXiv preprint arXiv: 2302.13971

[10]

Touvron H, Martin L, Stone K, Albert P, Almahairi A, et al. Llama 2: open foundation and fine-tuned chat models. 2023, arXiv preprint arXiv: 2307.09288

[11]

DeepSeek-AI. DeepSeek-V3 technical report. 2024, arXiv preprint arXiv: 2412.19437

[12]

Schick T, Dwivedi-Yu J, Dessì R, Raileanu R, Lomeli M, Hambro E, Zettlemoyer L, Cancedda N, Scialom T. Toolformer: language models can teach themselves to use tools. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 68539−68551

[13]

Plaat A, Wong A, Verberne S, Broekens J, van Stein N, Back T. Reasoning with large language models, a survey. 2024, arXiv preprint arXiv: 2407.11511

[14]

Dong X L, Moon S, Xu Y E, Malik K, Yu Z. Towards next-generation intelligent assistants leveraging LLM techniques. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 5792−5793

[15]

Liang X, Wang H, Wang Y, Song S, Yang J, Niu S, Hu J, Liu D, Yao S, Xiong F, Li Z. Controllable text generation for large language models: a survey. 2024, arXiv preprint arXiv: 2408.12599

[16]

Li J, Tang T, Zhao W X, Nie J Y, Wen J R . Pre-trained language models for text generation: a survey. ACM Computing Surveys, 2024, 56( 9): 230

[17]

Wan K, Mu H, Hao R, Luo H, Gu T, Chen X. A cognitive writing perspective for constrained long-form text generation. In: Proceedings of Findings of the Association for Computational Linguistics: ACL 2025. 2025, 9832−9844

[18]

Brown T B, Mann B, Ryder N, Subbiah M, Kaplan J, et al. Language models are few-shot learners. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. 2020, 159

[19]

Qin Y, Liang S, Ye Y, Zhu K, Yan L, Lu Y, Lin Y, Cong X, Tang X, Qian B, Zhao S, Hong L, Tian R, Xie R, Zhou J, Gerstein M, Li D, Liu Z, Sun M. ToolLLM: facilitating large language models to master 16000+ real-world APIs. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[20]

Zhu X, Chen Y, Tian H, Tao C, Su W, Yang C, Huang G, Li B, Lu L, Wang X, Qiao Y, Zhang Z, Dai J. Ghost in the minecraft: generally capable agents for open-world environments via large language models with text-based knowledge and memory. 2023, arXiv preprint arXiv: 2305.17144

[21]

Leng Y, Yuan Y. Do LLM agents exhibit social behavior? 2023, arXiv preprint arXiv: 2312.15198

[22]

Sclar M, Kumar S, West P, Suhr A, Choi Y, Tsvetkov Y. Minding language models’ (lack of) theory of mind: a plug-and-play multi-character belief tracker. In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. 2023, 13960−13980

[23]

Dam S K, Hong C S, Qiao Y, Zhang C. A complete survey on LLM-based AI chatbots. 2024, arXiv preprint arXiv: 2406.16937

[24]

Lieb A, Goel T. Student interaction with newtbot: an LLM-as-tutor chatbot for secondary physics education. In: Proceedings of Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. 2024, 614

[25]

Abu-Rasheed H, Abdulsalam M H, Weber C, Fathi M. Supporting student decisions on learning recommendations: an LLM-based chatbot with knowledge graph contextualization for conversational explainability and mentoring. 2024, arXiv preprint arXiv: 2401.08517

[26]

Ahn M, Brohan A, Brown N, Chebotar Y, Cortes O, et al. Do as I can, not as I say: grounding language in robotic affordances. 2022, arXiv preprint arXiv: 2204.01691

[27]

Huang W, Xia F, Xiao T, Chan H, Liang J, Florence P, Zeng A, Tompson J, Mordatch I, Chebotar Y, Sermanet P, Jackson T, Brown N, Luu L, Levine S, Hausman K, Ichter B. Inner monologue: embodied reasoning through planning with language models. In: Proceedings of the 6th Conference on Robot Learning. 2023, 1769−1782

[28]

Huang W, Abbeel P, Pathak D, Mordatch I. Language models as zero-shot planners: extracting actionable knowledge for embodied agents. In: Proceedings of International Conference on Machine Learning. 2022, 9118−9147

[29]

Wang B, Cui H, Zhang B, Zheng X, Guo B, Yu Z. MeCo: enhancing LLM-empowered multi-robot collaboration via similar task memoization. 2026, arXiv preprint arXiv: 2601.20577

[30]

Lin J, Dai X, Xi Y, Liu W, Chen B, Zhang H, Liu Y, Wu C, Li X, Zhu C, Guo H, Yu Y, Tang R, Zhang W . How can recommender systems benefit from large language models: a survey. ACM Transactions on Information Systems, 2025, 43( 2): 28

[31]

Lyu H, Jiang S, Zeng H, Xia Y, Wang Q, Zhang S, Chen R, Leung C, Tang J, Luo J. LLM-rec: personalized recommendation via prompting large language models. In: Proceedings of Findings of the Association for Computational Linguistics: NAACL 2024. 2024, 583−612

[32]

Zheng Z, Qiu Z P, Zhu C, Hu X, Wu L K, Song Y, Zhu H S, Xiong H . Exploiting large language model with reinforcement learning for generative job recommendations. Frontiers of Computer Science, 2026, 20( 1): 2001303

[33]

Wang Y, Guo Q, Yao W, Zhang H, Zhang X, Wu Z, Zhang M, Dai X, Zhang M, Wen Q, Ye W, Zhang S, Zhang Y. AutoSurvey: large language models can automatically write surveys. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. 2024, 3655

[34]

Ma Q, Zhou Y, Li J . Automated retrosynthesis planning of macromolecules using large language models and knowledge graphs. Macromolecular Rapid Communications, 2026, 47( 12): 2500065

[35]

Abbasiantaeb Z, Yuan Y, Kanoulas E, Aliannejadi M. Let the LLMS talk: simulating human-to-human conversational QA via zero-shot LLM-to-LLM interactions. In: Proceedings of the 17th ACM International Conference on Web Search and Data Mining. 2024, 8−17

[36]

Wang H, Guo B, Zeng Y, Chen M, Ding Y, Zhang Y, Yao L, Yu Z . Enabling harmonious human-machine interaction with visual-context augmented dialogue system: a review. ACM Transactions on Information Systems, 2025, 43( 3): 68

[37]

Zhang Y, Jin H, Meng D, Wang J, Tan J. A comprehensive survey on process-oriented automatic text summarization with exploration of LLM-based methods. 2025, arXiv preprint arXiv: 2403.02901

[38]

Park J S, O’Brien J, Cai C J, Morris M R, Liang P, Bernstein M S. Generative agents: interactive simulacra of human behavior. In: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 2023, 2

[39]

Altera.AL. Project Sid: many-agent simulations toward AI civilization. 2024, arXiv preprint arXiv: 2411.00114

[40]

Burton J W, Lopez-Lopez E, Hechtlinger S, Rahwan Z, Aeschbach S, . et al. How large language models can reshape collective intelligence. Nature Human Behaviour, 2024, 8( 9): 1643–1655

[41]

Ziems C, Held W, Shaikh O, Chen J, Zhang Z, Yang D. Can large language models transform computational social science? Computational Linguistics, 2024, 50(1): 237−291

[42]

Demszky D, Yang D, Yeager D S, Bryan C J, Clapper M, . et al. Using large language models in psychology. Nature Reviews Psychology, 2023, 2( 11): 688–701

[43]

Ghafarollahi A, Buehler M J. SciAgents: automating scientific discovery through multi-agent intelligent graph reasoning. 2024, arXiv preprint arXiv: 2409.05556

[44]

Qian C, Liu W, Liu H, Chen N, Dang Y, Li J, Yang C, Chen W, Su Y, Cong X, Xu J, Li D, Liu Z, Sun M. ChatDev: communicative agents for software development. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. 2024, 15174−15186

[45]

Xu R, Sun Y, Ren M, Guo S, Pan R, Lin H, Sun L, Han X . AI for social science and social science of AI: a survey. Information Processing & Management, 2024, 61( 3): 103665

[46]

Hao Y, Xie D. A multi-LLM-agent-based framework for economic and public policy analysis. 2025, arXiv preprint arXiv: 2502.16879

[47]

Li L, Li J, Chen C, Gui F, Yang H, et al. Political-LLM: large language models in political science. 2024, arXiv preprint arXiv: 2412.06864

[48]

Yu B, Kasaei H, Cao M. Co-NavGPT: Multi-robot cooperative visual semantic navigation using large language models. 2023, arXiv preprint arXiv: 2310.07937v1

[49]

Zhang H, Du W, Shan J, Zhou Q, Du Y, Tenenbaum J B, Shu T, Gan C. Building cooperative embodied agents modularly with large language models. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[50]

Liu H, Zhu Y, Kato K, Kondo I, Aoyama T, Hasegawa Y. LLM-based human-robot collaboration framework for manipulation tasks. 2023, arXiv preprint arXiv: 2308.14972

[51]

Wang L, Ma C, Feng X, Zhang Z, Yang H, Zhang J, Chen Z, Tang J, Chen X, Lin Y, Zhao W X, Wei Z, Wen J . A survey on large language model based autonomous agents. Frontiers of Computer Science, 2024, 18( 6): 186345

[52]

Guo S, Bu H, Wang H, et al. Economics arena for large language models[J]. arXiv preprint arXiv:2401.01735, 2024.

[53]

Gao C, Lan X, Li N, Yuan Y, Ding J, Zhou Z, Xu F, Li Y . Large language models empowered agent-based modeling and simulation: a survey and perspectives. Humanities and Social Sciences Communications, 2024, 11( 1): 1259

[54]

Chen L, Wang Y, Miao Z, Mo Y, Feng M, Zhou Z, Wang H . Transformer-based imitative reinforcement learning for multirobot path planning. IEEE Transactions on Industrial Informatics, 2023, 19( 10): 10233–10243

[55]

Jian Z, Zhang S, Chen S, Nan Z, Zheng N . A global-local coupling two-stage path planning method for mobile robots. IEEE Robotics and Automation Letters, 2021, 6( 3): 5349–5356

[56]

Vinyals O, Babuschkin I, Czarnecki W M, Mathieu M, Dudzik A, . et al. Grandmaster level in StarCraft II using multi-agent reinforcement learning. Nature, 2019, 575( 7782): 350–354

[57]

Jaderberg M, Czarnecki W M, Dunning I, Marris L, Lever G, Castaneda A G, Beattie C, Rabinowitz N C, Morcos A S, Ruderman A, Sonnerat N, Green T, Deason L, Leibo J Z, Silver D, Hassabis D, Kavukcuoglu K, Graepel T . Human-level performance in 3d multiplayer games with population-based reinforcement learning. Science, 2019, 364( 6443): 859–865

[58]

Sumers T R, Yao S, Narasimhan K, et al. Cognitive architectures for language agents[J]. arXiv preprint arXiv:2309.02427, 2023.

[59]

Goldman A I. Theory of mind. Volume 1. In Margolis E, Samuels R, Stich S P, eds. The Oxford Handbook of Philosophy of Cognitive Science. New York: Oxford University Press, 2012

[60]

Carlson S M, Koenig M A, Harms M B . Theory of mind. WIREs Cognitive Science, 2013, 4( 4): 391–402

[61]

Chen G, Han K, Wong K Y K. TOM-Net: learning transparent object matting from a single image. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 9233−9241

[62]

Baker C L, Jara-Ettinger J, Saxe R, Tenenbaum J B . Rational quantitative attribution of beliefs, desires and percepts in human mentalizing. Nature Human Behaviour, 2017, 1( 4): 0064

[63]

Street W. LLM theory of mind and alignment: opportunities and risks. 2024, arXiv preprint arXiv: 2405.08154

[64]

Rawte V, Sheth A, Das A. A survey of hallucination in large foundation models. 2023, arXiv preprint arXiv: 2309.05922

[65]

Hatalis K, Christou D, Myers J, Jones S, Lambert K, Amos-Binks A, Dannenhauer Z, Dannenhauer D. Memory matters: the need to improve long-term memory in LLM-agents. In: Proceedings of the 2nd AAAI Symposium Series. 2024, 277−280

[66]

Cambria E, Malandri L, Mercorio F, Nobani N, Seveso A. XAI meets LLMs: a survey of the relation between explainable AI and large language models. 2024, arXiv preprint arXiv: 2407.15248

[67]

Hogg M A. Social identity theory. In: McKeown S, Haji R, Ferguson N, eds. Understanding Peace and Conflict Through Social Identity Theory. Cham: Springer, 2016, 3−17

[68]

Chuang Y S, Suresh S, Harlalka N, Goyal A, Hawkins R, Yang S, Shah D, Hu J, Rogers T T. The wisdom of partisan crowds: comparing collective intelligence in humans and LLM-based agents. 2023, arXiv preprint arXiv: 2311.09665

[69]

Ji J, Liu M, Dai J, Pan X, Zhang C, Bian C, Chen B, Sun R, Wang Y, Yang Y. BEAVERTAILS: towards improved safety alignment of LLM via a human-preference dataset. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 1072

[70]

Shanahan M, McDonell K, Reynolds L . Role play with large language models. Nature, 2023, 623( 7987): 493–498

[71]

Lewis P, Perez E, Piktus A, Petroni F, Karpukhin V, Goyal N, Küttler H, Lewis M, Yih W T, Rocktäschel T, Riedel S, Kiela D. Retrieval-augmented generation for knowledge-intensive NLP tasks. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. 2020, 793

[72]

Roccas S, Sagiv L, Schwartz S H, Knafo A . The big five personality factors and personal values. Personality and Social Psychology Bulletin, 2002, 28( 6): 789–801

[73]

Jiang H, Zhang X, Cao X, Breazeal C, Roy D, Kabbara J. PersonaLLM: investigating the ability of large language models to express personality traits. In: Proceedings of Findings of the Association for Computational Linguistics: NAACL 2024. 2024, 3605−3627

[74]

Bhandari P, Fay N, Wise M J, Datta A, Meek S, Naseem U, Nasim M. Can LLM agents maintain a persona in discourse? In: Proceedings of 2025 Conference on Empirical Methods in Natural Language Processing. 2025, 29213−29229

[75]

Li H, Yang C, Zhang A, Deng Y, Wang X, Chua T S. Hello again! LLM-powered personalized agent for long-term dialogue. In: Proceedings of 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies. 2025, 5259−5276

[76]

Zollo T P, Siah A W T, Ye N, Li A, Namkoong H. Personalllm: tailoring LLMs to individual preferences. In: Proceedings of the 13th International Conference on Learning Representations. 2025

[77]

Turner J H. A Theory of Social Interaction. Stanford: Stanford University Press, 1988

[78]

Kenny D A . The design and analysis of social-interaction research. Annual Review of Psychology, 1996, 47: 59–86

[79]

Bardis P D . Social interaction and social processes. Social Science, 1979, 54( 3): 147–167

[80]

Wei J, Wang X, Schuurmans D, Bosma M, Ichter B, Xia F, Chi E H, Le Q V, Zhou D. Chain-of-thought prompting elicits reasoning in large language models. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 1800

[81]

Feng G, Zhang B, Gu Y, Ye H, He D, Wang L. Towards revealing the mystery behind chain of thought: a theoretical perspective. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 3100

[82]

Blumer H. Symbolic Interactionism: Perspective and Method. Berkeley: University of California Press, 1986

[83]

Schweingruber, D., Cast, A. (2025). Symbolic Interactionism. In: Stets, J.E., Hegtvedt, K.A., Doan, L. (eds) Handbook of Social Psychology. Handbooks of Sociology and Social Research. Springer, Cham. Website at 10.1007/978-3-031-93042-3_2

[84]

Zhang Y, Mao S, Ge T, Wang X, de Wynter A, Xia Y, Wu W, Song T, Lan M, Wei F. LLM as a mastermind: a survey of strategic reasoning with large language models. 2024, arXiv preprint arXiv: 2404.01230

[85]

Arora G, Jain S, Merugu S. Intent detection in the age of LLMs. In: Proceedings of 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track. 2024, 1559−1570

[86]

Xu Z, Yu C, Fang F, Wang Y, Wu Y. Language agents with reinforcement learning for strategic play in the werewolf game. In: Proceedings of the 41st International Conference on Machine Learning. 2024, 2285

[87]

Cropanzano R, Mitchell M S . Social exchange theory: an interdisciplinary review. Journal of Management, 2005, 31( 6): 874–900

[88]

Cook K S, Cheshire C, Rice E R W, Nakagawa S. Social exchange theory. In: DeLamater J, Ward A, eds. Handbook of Social Psychology. Dordrecht: Springer, 2013, 61−88

[89]

Wang L, Zhang Z, Chen X. Investigating and extending Homans’ social exchange theory with large language model based agents. In: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics. 2025, 9762−9777

[90]

Forsyth D R. Group Dynamics. 6th ed. Belmont: Wadsworth Cengage Learning, 2014

[91]

Tang X, Zou A, Zhang Z, Li Z, Zhao Y, Zhang X, Cohan A, Gerstein M. MedAgents: large language models as collaborators for zero-shot medical reasoning. In: Proceedings of Findings of the Association for Computational Linguistics: ACL 2024. 2024, 599−621

[92]

Mallampati S, Shelim R, Saad W, Ramakrishnan N. Dynamic strategy adaptation in multi-agent environments with large language models. 2025, arXiv preprint arXiv: 2507.02002

[93]

Mattessich P W, Johnson K M. Collaboration: What Makes It Work. 3rd ed. Nashville: Fieldstone Alliance, 2018

[94]

Belbin R M. Management Teams. 3rd ed. London: Routledge, 2010

[95]

Chandra R . Adam smith, Allyn young, and the division of labor. Journal of Economic Issues, 2004, 38( 3): 787–805

[96]

Belbin R M, Brown V. Team Roles at Work. London: Routledge, 2022

[97]

Ambler S W . Agile model driven development is good enough. IEEE Software, 2003, 20( 5): 71–73

[98]

Lewis K, Herndon B . Transactive memory systems: current issues and future research directions. Organization Science, 2011, 22( 5): 1254–1265

[99]

Samuelson L . Game theory in economics and beyond. Journal of Economic Perspectives, 2016, 30( 4): 107–130

[100]

Kreps D M. Nash equilibrium. In: Eatwell J, Milgate M, Newman P, eds. Game Theory. London: Palgrave Macmillan, 1989, 167−177

[101]

Weibull J W. Evolutionary Game Theory. Cambridge: MIT Press, 1997

[102]

Park J S, Zou C Q, Shaw A, Hill B M, Cai C, Morris M R, Willer R, Liang P, Bernstein M S. Generative agent simulations of 1,000 people. 2024, arXiv preprint arXiv: 2411.10109v1

[103]

Shen T, Li S, Tu Q, Xiong D. RoleEval: a bilingual role evaluation benchmark for large language models. 2023, arXiv preprint arXiv: 2312.16132

[104]

Wang Z M, Peng Z, Que H, Liu J, Zhou W, Wu Y, Guo H, Gan R, Ni Z, Yang J, Zhang M, Zhang Z, Ouyang W, Xu K, Huang W, Fu J, Peng J. RoleLLM: benchmarking, eliciting, and enhancing role-playing abilities of large language models. In: Proceedings of Findings of the Association for Computational Linguistics: ACL 2024. 2024, 14743−14777

[105]

Zhou J, Chen Z, Wan D, Wen B, Song Y, Yu J, Huang Y, Peng L, Yang J, Xiao X, Sabour S, Zhang X, Hou W, Zhang Y, Dong Y, Tang J, Huang M. CharacterGLM: customizing Chinese conversational AI characters with large language models. 2023, arXiv preprint arXiv: 2311.16832

[106]

Shea R, Yu Z. Building persona consistent dialogue agents with offline reinforcement learning. In: Proceedings of 2023 Conference on Empirical Methods in Natural Language Processing. 10735, 2023, 1778−1795

[107]

Yang B, Liu D, Xiao C, Zhao K, Tang C, Li C, Yuan L, Yang G, Lin C. Crafting customisable characters with LLMS: a persona-driven role-playing agent framework. In: Proceedings of Findings of the Association for Computational Linguistics: EMNLP 2025. 2025, 20216−20240

[108]

De Raad B. The Big Five Personality Factors: the Psycholexical Approach to Personality. Gottingen: Hogrefe & Huber Publishers, 2000

[109]

Liu Z, Zhang Y, Li P, Liu Y, Yang D. A dynamic LLM-powered agent network for task-oriented agent collaboration. In: Proceedings of the 1st Conference on Language Modeling. 2024

[110]

Wang X, Xiao Y, Huang J T, Yuan S, Xu R, Guo H, Tu Q, Fei Y, Leng Z, Wang W, Chen J, Li C, Xiao Y. InCharacter: evaluating personality fidelity in role-playing agents through psychological interviews. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. 2024, 1840−1873

[111]

Li C, Leng Z, Yan C, Shen J, Wang H, Mi W, Fei Y, Feng X, Yan S, Wang H, Zhan L, Jia Y, Wu P, Sun H. ChatHaruhi: reviving anime character in reality via large language model. 2023, arXiv preprint arXiv: 2308.09597

[112]

Chen N, Wang Y, Jiang H, Cai D, Li Y, Chen Z, Wang L, Li J. Large language models meet harry potter: a dataset for aligning dialogue agents with characters. In: Proceedings of Findings of the Association for Computational Linguistics. 2023, 8506−8520

[113]

Wang X, Dai H, Gao S, Li P. Characteristic AI agents via large language models. In: Proceedings of 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation. 2024, 3016−3027

[114]

Strachan J W A, Albergo D, Borghini G, Pansardi O, Scaliti E, Gupta S, Saxena K, Rufo A, Panzeri S, Manzi G, Graziano M S A, Becchio C . Testing theory of mind in large language models and humans. Nature Human Behaviour, 2024, 8( 7): 1285–1295

[115]

Gu Y, Tafjord O, Kim H, Moore J, Le Bras R, Clark P, Choi Y. SimpleToM: exposing the gap between explicit ToM inference and implicit tom application in LLMs. 2024, arXiv preprint arXiv: 2410.13648

[116]

Cross L M, Xiang V, Bhatia A, Yamins D L K, Haber N. Hypothetical minds: scaffolding theory of mind for multi-agent tasks with large language models. In: Proceedings of the Thirteenth International Conference on Learning Representations. 2025

[117]

Shi H, Ye S, Fang X, Jin C, Isik L, Kuo Y L, Shu T. MuMA-ToM: multi-modal multi-agent theory of mind. In: Proceedings of the 39th AAAI Conference on Artificial Intelligence. 2025, 1510−1519

[118]

Chen Y, Xing X, Lin J, Zheng H, Wang Z, Liu Q, Xu X. SoulChat: improving LLMs’ empathy, listening, and comfort abilities through fine-tuning with multi-turn empathy conversations. In: Proceedings of Findings of the Association for Computational Linguistics: EMNLP 2023. 2023, 1170−1183

[119]

Qiu H, He H, Zhang S, Li A, Lan Z. SMILE: single-turn to multi-turn inclusive language expansion via ChatGPT for mental health support. In: Proceedings of Findings of the Association for Computational Linguistics: EMNLP 2024. 2024, 615−636

[120]

Qiu H, Li A, Ma L, Lan Z. PsyChat: a client-centric dialogue system for mental health support. In: Proceedings of the 27th International Conference on Computer Supported Cooperative Work in Design. 2024, 2979−2984

[121]

Zhang C, Li R, Tan M, Yang M, Zhu J, Yang D, Zhao J, Ye G, Li C, Hu X. CPsyCoun: a report-based multi-turn dialogue reconstruction and evaluation framework for Chinese psychological counseling. In: Proceedings of Findings of the Association for Computational Linguistics: ACL 2024. 2024, 13947−13966

[122]

Zhang T, Zhang X, Zhao J, Zhou L, Jin Q. ESCoT: towards interpretable emotional support dialogue systems. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. 2024, 13395−13412

[123]

Zhang Z, Bo X, Ma C, Li R, Chen X, Zhu J, Dong Z, Wen J R . A survey on the memory mechanism of large language model-based agents. ACM Transactions on Information Systems, 2025, 43( 6): 155

[124]

Wang M, Yao Y, Xu Z, Qiao S, Deng S, Wang P, Chen X, Gu J C, Jiang Y, Xie P, Huang F, Chen H, Zhang N. Knowledge mechanisms in large language models: a survey and perspective. In: Proceedings of Findings of the Association for Computational Linguistics: EMNLP 2024. 2024, 7097−7135

[125]

Shinn N, Cassano F, Gopinath A, Narasimhan K, Yao S. Reflexion: language agents with verbal reinforcement learning. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 377

[126]

Zhong W, Guo L, Gao Q, Ye H, Wang Y. MemoryBank: enhancing large language models with long-term memory. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 19724−19731

[127]

Modarressi A, Imani A, Fayyaz M, Schütze H. RET-LLM: towards a general read-write memory for large language models. 2023, arXiv preprint arXiv: 2305.14322

[128]

Wang W, Dong L, Cheng H, Liu X, Yan X, Gao J, Wei F. Augmenting language models with long-term memory. In: Proceedings of the 37th International Conference on Neural Information Processing Systems, 2023, 3259

[129]

Zhang W, Tang K, Wu H, Wang M, Shen Y, Hou G, Tan Z, Li P, Zhuang Y, Lu W. Agent-pro: learning to evolve via policy-level reflection and optimization. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. 2024, 5348−5375

[130]

Li X, Qiu X. MoT: memory-of-thought enables ChatGPT to self-improve. In: Proceedings of 2023 Conference on Empirical Methods in Natural Language Processing. 2023, 6354−6374

[131]

Modarressi A, Köksal A, Imani A, Fayyaz M, Schütze H. MemLLM: finetuning LLMs to use an explicit read-write memory. 2024, arXiv preprint arXiv: 2404.11672

[132]

Hu C, Fu J, Du C, Luo S, Zhao J, Zhao H. ChatDB: augmenting LLMs with databases as their symbolic memory. 2023, arXiv preprint arXiv: 2306.03901

[133]

Wang B, Sun T, Yan H, Wang S, Cheng Q, Qiu X. In-memory learning: a declarative learning framework for large language models. 2024, arXiv preprint arXiv: 2403.02757

[134]

Yang Z, Li P, Liu Y. Failures pave the way: enhancing large language models through tuning-free rule accumulation. In: Proceedings of 2023 Conference on Empirical Methods in Natural Language Processing. 2023, 1751−1777

[135]

Huang J, Chen X, Mishra S, Zheng H S, Yu A W, Song X, Zhou D. Large language models cannot self-correct reasoning yet. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[136]

Rezazadeh A, Li Z, Lou A, Zhao Y, Wei W, Bao Y. Collaborative memory: multi-user memory sharing in LLM agents with dynamic access control. 2025, arXiv preprint arXiv: 2505.18279

[137]

Gao H, Zhang Y. Memory sharing for large language model based agents. 2024, arXiv preprint arXiv: 2404.09982v1

[138]

Yu Z, Yu N, Zhang H, Ni W, Yin M, Yang J, Zhao Y, Zhao J. Multi-agent memory from a computer architecture perspective: visions and challenges ahead. 2026, arXiv preprint arXiv: 2603.10062

[139]

Packer C, Wooders S, Lin K, Fang V, Patil S G, Stoica I, Gonzalez J E. MemGPT: towards LLMs as operating systems. 2023, arXiv preprint arXiv: 2310.08560

[140]

Qian C, Cong X, Yang C, Chen W, Su Y, Xu J, Liu Z, Sun M. Communicative agents for software development. 2023, arXiv preprint arXiv: 2307.07924v1

[141]

XAgent Team. XAgent: an autonomous agent for complex task solving. XAgent blog. See github.com/OpenBMB/XAgent website, 2023

[142]

Xu L, Hu Z, Zhou D, Ren H, Dong Z, Keutzer K, Ng S K, Feng J. MAgiC: investigation of large language model powered multi-agent in cognition, adaptability, rationality and collaboration. In: Proceedings of 2024 Conference on Empirical Methods in Natural Language Processing. 2024, 7315−7332

[143]

Zhang J, Xu X, Zhang N, Liu R, Hooi B, Deng S. Exploring collaboration mechanisms for LLM agents: a social psychology view. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. 2024, 14544−14607

[144]

Park J S, Popowski L, Cai C, Morris M R, Liang P, Bernstein M S. Social simulacra: creating populated prototypes for social computing systems. In: Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 2022, 74

[145]

Lin J, Zhao H, Zhang A, Wu Y, Ping H, Chen Q. AgentSims: an open-source sandbox for large language model evaluation. 2023, arXiv preprint arXiv: 2308.04026

[146]

Gao C, Lan X, Lu Z, Mao J, Piao J, Wang H, Jin D, Li Y. S3: social-network simulation system with large language model-empowered agents. 2023, arXiv preprint arXiv: 2307.14984

[147]

Liu W, Wang C, Wang Y, Xie Z, Qiu R, Dang Y, Du Z, Chen W, Yang C, Qian C. Autonomous agents for collaborative task under information asymmetry. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. 2024, 90

[148]

Zhang X, Lin J, Sun L, Qi W, Yang Y, Chen Y, Lyu H, Mou X, Chen S, Luo J, Huang X, Tang S, Wei Z. ElectionSim: massive population election simulation powered by large language model driven agents. 2024, arXiv preprint arXiv: 2410.20746

[149]

Li N, Gao C, Li M, Li Y, Liao Q. EconAgent: large language model-empowered agents for simulating macroeconomic activities. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. 2024, 15523−15536

[150]

Yuan Y, Tang K, Shen J, Zhang M, Wang C. Measuring social norms of large language models. In: Proceedings of Findings of the Association for Computational Linguistics: NAACL 2024. 2024, 650−699

[151]

Horiguchi I, Yoshida T, Ikegami T. Evolution of social norms in LLM agents using natural language. 2024, arXiv preprint arXiv: 2409.00993

[152]

Ashery A F, Aiello L M, Baronchelli A. The dynamics of social conventions in LLM populations: spontaneous emergence, collective biases and tipping points. 2024, arXiv preprint arXiv: 2410.08948v1

[153]

Ren S, Cui Z, Song R, Wang Z, Hu S. Emergence of social norms in large language model-based agent societies. 2024, arXiv preprint arXiv: 2403.08251v1

[154]

Sarkar A, Muresanu A I, Blair C, Sharma A, Trivedi R S, Hadfield G K. Normative modules: a generative agent architecture for learning norms that supports multi-agent cooperation. 2024, arXiv preprint arXiv: 2405.19328

[155]

Wu Q, Bansal G, Zhang J, Wu Y, Zhang S, Zhu E, Li B, Jiang L, Zhang X, Wang C. AutoGen: enabling next-gen LLM applications via multi-agent conversation framework. 2023, arXiv preprint arXiv: 2308.08155v1

[156]

Hong S, Zheng X, Chen J, Zheng X, Cheng Y, Wang J, Zhang C, Wang Z, Yau S K S, Lin Z, Zhou L, Ran C, Xiao L, Wu C, Schmidhuber J. MetaGPT: meta programming for a multi-agent collaborative framework. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[157]

Dong Y, Jiang X, Jin Z, Li G . Self-collaboration code generation via ChatGPT. ACM Transactions on Software Engineering and Methodology, 2024, 33( 7): 189

[158]

Wu M, Xu J, Yuan Y, Haffari G, Wang L, Luo W, Zhang K. (perhaps) beyond human translation: harnessing multi-agent collaboration for translating ultra-long literary texts. 2024, arXiv preprint arXiv: 2405.11804

[159]

Jiang G, Shi X, Luo Q. LLM-collaboration on automatic science journalism for the general audience. 2024, arXiv preprint arXiv: 2407.09756

[160]

Lan X, Gao C, Jin D, Li Y. Stance detection with collaborative role-infused LLM-based agents. In: Proceedings of the 18th International AAAI Conference on Web and Social Media. 2024, 891−903

[161]

Hou X, Yang M, Jiao W, Wang X, Tu Z, Zhao W X. CoAct: a global-local hierarchy for autonomous agent collaboration. 2024, arXiv preprint arXiv: 2406.13381

[162]

Wang Z, Wang W, Li Z, Wang L, Yi C, Xu X, Cao L, Su H, Chen S, Zhou J. XUAT-copilot: multi-agent collaborative system for automated user acceptance testing with large language model. 2024, arXiv preprint arXiv: 2401.02705

[163]

Xiao Z, Zhang D, Wu Y, Xu L, Wang Y J, Han X, Fu X, Zhong T, Zeng J, Song M, Chen G. Chain-of-experts: when LLMs meet complex operations research problems. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[164]

Boiko D A, MacKnight R, Gomes G. Emergent autonomous scientific research capabilities of large language models. 2023, arXiv preprint arXiv: 2304.05332

[165]

Ding S, Chen X, Fang Y, Liu W, Qiu Y, Chai C. DesignGPT: multi-agent collaboration in design. In: Proceedings of the 16th International Symposium on Computational Intelligence and Design. 2023, 204−208

[166]

Huang D, Zhang J M, Luck M, Bu Q, Qing Y, Cui H. AgentCoder: multi-agent-based code generation with iterative testing and optimisation. 2023, arXiv preprint arXiv: 2312.13010

[167]

Hao R, Hu L, Qi W, Wu Q, Zhang Y, Nie L . ChatLLM network: more brains, more intelligence. AI Open, 2025, 6: 45–52

[168]

Sun Q, Yin Z, Li X, Wu Z, Qiu X, Kong L. Corex: pushing the boundaries of complex reasoning through multi-model collaboration. 2023, arXiv preprint arXiv: 2310.00280

[169]

Xu Z, Shi S, Hu B, Yu J, Li D, Zhang M, Wu Y. Towards reasoning in large language models via multi-agent peer review collaboration. 2023, arXiv preprint arXiv: 2311.08152

[170]

Du Y, Li S, Torralba A, Tenenbaum J B, Mordatch I. Improving factuality and reasoning in language models through multiagent debate. In: Proceedings of the 41st International Conference on Machine Learning. 2024, 11733−11763

[171]

Liang T, He Z, Jiao W, Wang X, Wang Y, Wang R, Yang Y, Shi S, Tu Z. Encouraging divergent thinking in large language models through multi-agent debate. In: Proceedings of 2024 Conference on Empirical Methods in Natural Language Processing. 2024, 17889−17904

[172]

Xiong K, Ding X, Cao Y, Liu T, Qin B. Examining inter-consistency of large language models collaboration: an in-depth analysis via debate. In: Proceedings of Findings of the Association for Computational Linguistics: EMNLP 2023. 2023, 7572−7590

[173]

Liu T, Wang X, Huang W, Xu W, Zeng Y, Jiang L, Yang H, Li J. GroupDebate: enhancing the efficiency of multi-agent debate using group discussion. In: Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems. 2026, 1147−1155

[174]

Lu L C, Chen S J, Pai T M, Yu C H, Lee H Y, Sun S H. LLM discussion: enhancing the creativity of large language models via discussion framework and role-play. 2024, arXiv preprint arXiv: 2405.06373

[175]

Chen J, Saha S, Bansal M. ReConcile: round-table conference improves reasoning via consensus among diverse LLMs. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. 2024, 7066−7085

[176]

Qin Z, Wang C, Guo J, Qin H, Jia W. Brainstorming brings power to large language models of knowledge reasoning. In: Proceedings of 2025 IEEE International Conference on Multimedia and Expo. 2025, 1−6

[177]

Li G, Hammoud H A A K, Itani H, Khizbullin D, Ghanem B. Camel: communicative agents for “mind” exploration of large language model society. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 2264

[178]

Chen G, Dong S, Shu Y, Zhang G, Sesay J, Karlsson B, Fu J, Shi Y. Autoagents: a framework for automatic agent generation. In: Proceedings of the 33rd International Joint Conference on Artificial Intelligence. 2024, 22−30

[179]

Song L, Liu J, Zhang J, Zhang S, Luo A, Wang S, Wu Q, Wang C. Adaptive in-conversation team building for language model agents. 2024, arXiv preprint arXiv: 2405.19425

[180]

Chen W, Su Y, Zuo J, Yang C, Yuan C, Qian C, Chan C M, Qin Y, Lu Y, Xie R, Liu Z, Sun M, Zhou J. AgentVerse: facilitating multi-agent collaboration and exploring emergent behaviors in agents. 2023, arXiv preprint arXiv: 2308.10848v1

[181]

Wang Z, Mao S, Wu W, Ge T, Wei F, Ji H. Unleashing the emergent cognitive synergy in large language models: a task-solving agent through multi-persona self-collaboration. In: Proceedings of 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2024, 257−279

[182]

Kim Y, Park C, Jeong H, Chan Y S, Xu X, McDuff D, Lee H, Ghassemi M, Breazeal C, Park H W. MDAgents: an adaptive collaboration of LLMs for medical decision-making. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. 2024, 2522

[183]

Liu Z, Zhang Y, Li P, Liu Y, Yang D. Dynamic LLM-agent network: an LLM-agent collaboration framework with agent team optimization. 2023, arXiv preprint arXiv: 2310.02170v1

[184]

Qian C, Xie Z, Wang Y, Liu W, Zhu K, Xia H, Dang Y, Du Z, Chen W, Yang C, Liu Z, Sun M. Scaling large language model-based multi-agent collaboration. In: Proceedings of the 13th International Conference on Learning Representations. 2025

[185]

Du Z, Qian C, Liu W, Xie Z, Wang Y, Dang Y, Chen W, Yang C. Multi-agent software development through cross-team collaboration. 2024, arXiv preprint arXiv: 2406.08979v1

[186]

Qian C, Dang Y, Li J, Liu W, Xie Z, Wang Y, Chen W, Yang C, Cong X, Che X, Liu Z, Sun M. Experiential co-learning of software-developing agents. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. 2024, 5628−5640

[187]

Pan B, Lu J, Wang K, Zheng L, Wen Z, Feng Y, Zhu M, Chen W . AgentCoord: visually exploring coordination strategy for LLM-based multi-agent collaboration. Computers & Graphics, 2025, 132: 104338

[188]

Du Y, Li S, Torralba A, Tenenbaum J B, Mordatch I. Improving factuality and reasoning in language models through multiagent debate. In: Proceedings of the 41st International Conference on Machine Learning. 2024, 467

[189]

Li Y, Du Y, Zhang J, Hou L, Grabowski P, Li Y, Ie E. Improving multi-agent debate with sparse communication topology. In: Proceedings of Findings of the Association for Computational Linguistics: EMNLP 2024. 2024, 7281−7294

[190]

Shao Y, Jiang Y, Kanell T A, Xu P, Khattab O, Lam M. Assisting in writing wikipedia-like articles from scratch with large language models. In: Proceedings of 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2024, 6252−6278

[191]

Zhang C, Yang K, Hu S, Wang Z, Li G, Sun Y, Zhang C, Zhang Z, Liu A, Zhu S C, Chang X, Zhang J, Yin F, Liang Y, Yang Y. ProAgent: building proactive cooperative agents with large language models. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 17591−17599

[192]

Huynh T K, Dao-Sy D M, Cao T B, Le P H, Nguyen H D, Nguyen-Lam P Q, Nguyen-Vo M L, Pham H P, Pham P H, Than T K, Tran C N, Tran H, Tran-Le G T, Buscemi A, Trang L H, Han T A. Understanding LLM agent behaviours via game theory: strategy recognition, biases and multi-agent dynamics. 2025, arXiv preprint arXiv: 2512.07462

[193]

Huang J T, Li E J, Lam M H, Liang T, Wang W, Yuan Y, Jiao W, Wang X, Tu Z, Lyu M R. Competing large language models in multi-agent gaming environments. In: Proceedings of the 13th International Conference on Learning Representations. 2025

[194]

Herr N, Acero F, Raileanu R, Perez-Ortiz M, Li Z. Are large language models strategic decision makers? A study of performance and bias in two-player non-zero-sum games. 2024, arXiv preprint arXiv: 2407.04467

[195]

Phelps S, Russell Y I. Investigating emergent goal-like behaviour in large language models using experimental economics. 2023, arXiv preprint arXiv: 2305.07970v1

[196]

Lorè N, Heydari B. Strategic behavior of large language models: game structure vs. contextual framing. 2023, arXiv preprint arXiv: 2309.05898

[197]

Fan C, Chen J, Jin Y, He H. Can large language models serve as rational players in game theory? A systematic analysis. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 17960−17967

[198]

Gandhi K, Sadigh D, Goodman N D. Strategic reasoning with language models. 2023, arXiv preprint arXiv: 2305.19165

[199]

Wu D, Shi H, Sun Z, Liu B. Deciphering digital detectives: understanding LLM behaviors and capabilities in multi-agent mystery games. In: Proceedings of Findings of the Association for Computational Linguistics: ACL 2024. 2024, 8225−8291

[200]

Mao S, Cai Y, Xia Y, Wu W, Wang X, Wang F, Ge T, Wei F. ALYMPICS: language agents meet game theory. 2023, arXiv preprint arXiv: 2311.03220v1

[201]

Hu S, Huang T, Liu L. PokeLLMon: a human-parity agent for pokemon battles with large language models. 2024, arXiv preprint arXiv: 2402.01118

[202]

Shi Z, Fang M, Zheng S, Deng S, Chen L, Du Y. Cooperation on the fly: exploring language agents for ad hoc teamwork in the Avalon game. 2023, arXiv preprint arXiv: 2312.17515

[203]

Feng X, Luo Y, Wang Z, Tang H, Yang M, Shao K, Mguni D, Du Y, Wang J. ChessGPT: bridging policy learning and language modeling. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 316

[204]

Huang C, Cao Y, Wen Y, Zhou T, Zhang Y. PokerGPT: an end-to-end lightweight solver for multi-player Texas Hold’em via large language model. 2024, arXiv preprint arXiv: 2401.06781

[205]

Zhang Y, Mao S, Ge T, Wang X, Xia Y, Lan M, Wei F. K-level reasoning: establishing higher order beliefs in large language models for strategic reasoning. In: Proceedings of 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies. 2025, 7212−7234

[206]

Qi S, Chen S, Li Y, Kong X, Wang J, Yang B, Wong P, Zhong Y, Zhang X, Zhang Z, Liu N, Yang Y, Zhu S C. CivRealm: a learning and reasoning odyssey in civilization for decision-making agents. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[207]

Wang S, Liu C, Zheng Z, Qi S, Chen S, Yang Q, Zhao A, Wang C, Song S, Huang G. Avalon’s game of thoughts: battle against deception through recursive contemplation. 2023, arXiv preprint arXiv: 2310.01320

[208]

Abdelnabi S, Gomaa A, Sivaprasad S, Schonherr L, Fritz M. Cooperation, competition, and maliciousness: LLM-stakeholders interactive negotiation. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. 2024, 2658

[209]

Zhao Q, Wang J, Zhang Y, Jin Y, Zhu K, Chen H, Xie X. CompeteAI: understanding the competition dynamics of large language model-based agents. In: Proceedings of the 41st International Conference on Machine Learning. 2024, 61092−61107

[210]

Bianchi F, Chia P J, Yuksekgonul M, Tagliabue J, Jurafsky D, Zou J. How well can LLMs negotiate? Negotiationarena platform and analysis. In: Proceedings of the 41st International Conference on Machine Learning. 2024, 3935−3951

[211]

Jin X, Wang Z, Du Y, Fang M, Zhang H, Wang J. Learning to discuss strategically: a case study on one night ultimate werewolf. 2024, arXiv preprint arXiv: 2405.19946

[212]

Wu S, Zhu L, Yang T, Xu S, Fu Q, Wei Y, Fu H. Enhance reasoning for large language models in the game werewolf. 2024, arXiv preprint arXiv: 2402.02330

[213]

Gong R, Huang Q, Ma X, Vo H, Durante Z, Noda Y, Zheng Z, Zhu S C, Terzopoulos D, Fei-Fei L, Gao J. Mindagent: emergent gaming interaction. 2023, arXiv preprint arXiv: 2309.09971

[214]

Mukobi G, Erlebach H, Lauffer N, Hammond L, Chan A, Clifton J. Welfare diplomacy: Benchmarking language model cooperation. 2023, arXiv preprint arXiv: 2310.08901

[215]

Lin S, Hua W, Li L, Chang C J, Fan L, Ji J, Hua H, Jin M, Luo J, Zhang Y. BattleAgent: multi-modal dynamic emulation on historical battles to complement historical analysis. In: Proceedings of 2024 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2024, 172−181

[216]

de Zarzà I, de Curtò J, Roig G, Manzoni P, Calafate C T . Emergent cooperation and strategy adaptation in multi-agent systems: an extended coevolutionary theory with LLMs. Electronics, 2023, 12( 12): 2722

[217]

Ghaffarzadegan N, Majumdar A, Williams R, Hosseinichimeh N. Generative agent-based modeling: unveiling social system dynamics through coupling mechanistic models with generative artificial intelligence. 2023, arXiv preprint arXiv: 2309.11456

[218]

Zhou X, Zhu H, Mathur L, Zhang R, Yu H, Qi Z, Morency L P, Bisk Y, Fried D, Neubig G, Sap M. SOTOPIA: interactive evaluation for social intelligence in language agents. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[219]

Xu F, Zhang J, Gao C, Feng J, Li Y. Urban generative intelligence (UGI): a foundational platform for agents in embodied city environment. 2023, arXiv preprint arXiv: 2312.11813

[220]

Shi J, Zhao J, Wang Y, Wu X, Li J, He L. CGMI: configurable general multi-agent interaction framework. 2023, arXiv preprint arXiv: 2308.12503

[221]

Hamilton S. Blind judgement: agent-based supreme court modelling with GPT. 2023, arXiv preprint arXiv: 2301.05327

[222]

Xiao B, Yin Z, Shan Z. Simulating public administration crisis: a novel generative agent-based simulation system to lower technology barriers in social science research. 2023, arXiv preprint arXiv: 2311.06957

[223]

Cui Z, Li N, Zhou H. Can AI replace human subjects? A large-scale replication of psychological experiments with LLMs. 2024, arXiv preprint arXiv: 2409.00128v1

[224]

Hagendorff T. Machine psychology: investigating emergent capabilities and behavior in large language models using psychological methods. 2023, arXiv preprint arXiv: 2303.13988v1

[225]

Dillion D, Tandon N, Gu Y, Gray K. Can AI language models replace human participants? Trends in Cognitive Sciences, 2023, 27(7): 597−600

[226]

Huang Y J, Hadfi R. How personality traits influence negotiation outcomes? A simulation based on large language models. In: Proceedings of Findings of the Association for Computational Linguistics: EMNLP 2024. 2024, 10336−10351

[227]

Aher G V, Arriaga R I, Kalai A T. Using large language models to simulate multiple humans and replicate human subject studies. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 337−371

[228]

Dhingra S, Singh M, Vaisakh S B, Malviya N, Gill S S . Mind meets machine: unravelling gpt-4’s cognitive psychology. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 2023, 3( 3): 100139

[229]

Kovač G, Portelas R, Dominey P F, Oudeyer P Y. The SocialAI school: insights from developmental psychology towards artificial socio-cultural agents. 2023, arXiv preprint arXiv: 2307.07871

[230]

Danner M, Hadzic B, Gerhardt S, Ludwig S, Uslu I, Shao P, Weber T, Shiban Y, Ratsch M. Advancing mental health diagnostics: GPT-based method for depression detection. In: Proceedings of the 62nd Annual Conference of the Society of Instrument and Control Engineers. 2023, 1290−1296

[231]

Z. Ma, Y. Mei, Z. Su, Understanding the benefits and challenges of using large language model-based conversational agents for mental well-being support. in AMIA Annual Symposium Proceedings (American Medical Informatics Association, New Orleans, LA, 2023). pp. 1105

[232]

Han X, Wu Z, Xiao C. “Guinea pig trials” utilizing GPT: a novel smart agent-based modeling approach for studying firm competition and collusion. 2023, arXiv preprint arXiv: 2308.10974

[233]

Li Y, Yu Y, Li H, Chen Z, Khashanah K. TradingGPT: multi-agent system with layered memory and distinct characters for enhanced financial trading performance. 2023, arXiv preprint arXiv: 2309.03736

[234]

Guo S, Bu H, Wang H, Ren Y, Sui D, Shang Y, Lu S. Economics arena for large language models. 2024, arXiv preprint arXiv: 2401.01735

[235]

Chen J, Yuan S, Ye R, Majumder B P, Richardson K. Put your money where your mouth is: evaluating strategic planning and execution of LLM agents in an auction arena. 2023, arXiv preprint arXiv: 2310.05746

[236]

Kitadai A, Rico Lugo S D, Tsurusaki Y, Fukasawa Y, Nishino N. Can AI with high reasoning ability replicate human-like decision making in economic experiments? Group Decision and Negotiation, 2025, 34(6): 1303−1326

[237]

Nascimento N, Alencar P, Cowan D. Self-adaptive large language model (LLM)-based multiagent systems. In: Proceedings of 2023 IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion. 2023, 104−109

[238]

Phelps S, Russell Y I. The machine psychology of cooperation: can GPT models operationalize prompts for altruism, cooperation, competitiveness, and selfishness in economic games? Journal of Physics: Complexity, 2025, 6(1): 015018

[239]

Yang Z, Zhang Z, Zheng Z, Jiang Y, Gan Z, et al. OASIS: open agents social interaction simulations on one million agents. 2024, arXiv preprint arXiv: 2411.11581v1

[240]

Törnberg P, Valeeva D, Uitermark J, Bail C. Simulating social media using large language models to evaluate alternative news feed algorithms. 2023, arXiv preprint arXiv: 2310.05984

[241]

Mou X, Wei Z, Huang X. Unveiling the truth and facilitating change: towards agent-based large-scale social movement simulation. In: Proceedings of Findings of the Association for Computational Linguistics: ACL 2024. 2024, 4789−4809

[242]

Wang C, Liu Z, Yang D, Chen X. Decoding echo chambers: LLM-powered simulations revealing polarization in social networks. In: Proceedings of the 31st International Conference on Computational Linguistics. 2025, 3913−3923

[243]

Li S, Yang J, Zhao K. Are you in a masquerade? Exploring the behavior and impact of large language model driven social bots in online social networks. 2023, arXiv preprint arXiv: 2307.10337

[244]

Zhang A, Chen Y, Sheng L, Wang X, Chua T S. On generative agents in recommendation. In: Proceedings of the 47th international ACM SIGIR conference on research and development in Information Retrieval. 2024, 1807−1817

[245]

Zhang J, Hou Y, Xie R, Sun W, McAuley J, Zhao W X, Lin L, Wen J R. AgentCF: COLLABORATIVE learning with autonomous language agents for recommender systems. In: Proceedings of ACM Web Conference 2024. 2024, 3679−3689

[246]

Jin H, Huang L, Cai H, Yan J, Li B, Chen H. From LLMs to LLM-based agents for software engineering: a survey of current, challenges and future. 2024, arXiv preprint arXiv: 2408.02479

[247]

Liu J, Wang K, Chen Y, Peng X, Chen Z, Zhang L, Lou Y. Large language model-based agents for software engineering: a survey. ACM Transactions on Software Engineering and Methodology, 2026, doi: 10.1145/3796507

[248]

Si C, Yang D, Hashimoto T. Can LLMs generate novel research ideas? A large-scale human study with 100+ NLP researchers. In: Proceedings of the 13th International Conference on Learning Representations. 2025

[249]

Baek J, Jauhar S K, Cucerzan S, Hwang S J. ResearchAgent: iterative research idea generation over scientific literature with large language models. In: Proceedings of 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies. 2025, 6709−6738

[250]

Zheng Z, Zhang O, Nguyen H L, Rampal N, Alawadhi A H, Rong Z, Head-Gordon T, Borgs C, Chayes J T, Yaghi O M . ChatGPT research group for optimizing the crystallinity of MOFs and COFs. ACS Central Science, 2023, 9( 11): 2161–2170

[251]

Huang K, Qu Y, Cousins H, Johnson W A, Yin D, Shah M, Zhou D, Altman R, Wang M, Cong L. CRISPR-GPT: an LLM agent for automated design of gene-editing experiments. 2024, arXiv preprint arXiv: 2404.18021v1

[252]

Ghafarollahi A, Buehler M J . Protagents: protein discovery via large language model multi-agent collaborations combining physics and machine learning. Digital Discovery, 2024, 3( 7): 1389–1409

[253]

Liu H, Li Y, Jian J, Cheng Y, Lu J, Guo S, Zhu J, Zhang M, Zhang M, Wang H. Toward a team of AI-made scientists for scientific discovery from gene expression data. 2024, arXiv preprint arXiv: 2402.12391

[254]

Liu S, Lu Y, Chen S, Hu X, Zhao J, Fu T, Zhao Y. DrugAgent: automating AI-aided drug discovery programming through LLM multi-agent collaboration. 2024, arXiv preprint arXiv: 2411.15692

[255]

Corbeil J P. IryoNLP at MEDIQA-CORR 2024: tackling the medical error detection & correction task on the shoulders of medical agents. In: Proceedings of the 6th Clinical Natural Language Processing Workshop. 2024, 570−580

[256]

Pandey H G, Amod A, Kumar S. Advancing healthcare automation: multi-agent system for medical necessity justification. In: Proceedings of the 23rd Workshop on Biomedical Natural Language Processing. 2024, 39−49

[257]

Gebreab S A, Salah K, Jayaraman R, Rehman M H U, Ellaham S. LLM-based framework for administrative task automation in healthcare. In: Proceedings of the 12th International Symposium on Digital Forensics and Security. 2024, 1−7

[258]

Li J, Lai Y, Li W, Ren J, Zhang M, Kang X, Wang S, Li P, Zhang Y Q, Ma W, Liu Y. Agent hospital: a simulacrum of hospital with evolvable medical agents. 2024, arXiv preprint arXiv: 2405.02957

[259]

Li B, Yan T, Pan Y, Luo J, Ji R, Ding J, Xu Z, Liu S, Dong H, Lin Z, Wang Y. MmedAgent: learning to use medical tools with multi-modal agent. In: Proceedings of Findings of the Association for Computational Linguistics: EMNLP 2024. 2024, 8745−8760

[260]

Venkatraman S, Tripto N I, Lee D. CollabStory: multi-LLM collaborative story generation and authorship analysis. In: Proceedings of Findings of the Association for Computational Linguistics: NAACL 2025. 2025, 3665−3679

[261]

Hu P, Jiang J, Chen J, Han M, Liao S, Chang X, Liang X. StoryAgent: customized storytelling video generation via multi-agent collaboration. 2024, arXiv preprint arXiv: 2411.04925

[262]

Swan M, Kido T, Roland E, Santos R P D. Math agents: computational infrastructure, mathematical embedding, and genomics. 2023, arXiv preprint arXiv: 2307.02502

[263]

Chen H, Ji W, Xu L, Zhao S. Multi-agent consensus seeking via large language models. 2023, arXiv preprint arXiv: 2310.20151

[264]

Zhao J, Zu C, Xu H, Lu Y, He W, Ding Y, Gui T, Zhang Q, Huang X. LongAgent: scaling language models to 128k context through multi-agent collaboration. 2024, arXiv preprint arXiv: 2402.11550

[265]

Zhang Y, Sun R, Chen Y, Pfister T, Zhang R, Arık S Ö. Chain of agents: large language models collaborating on long-context tasks. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. 2024

[266]

Hua W, Liu O, Li L, Amayuelas A, Chen J, Jiang L, Jin M, Fan L, Sun F, Wang W, Wang X, Zhang Y. Game-theoretic LLM: agent workflow for negotiation games. 2024, arXiv preprint arXiv: 2411.05990

[267]

Gemp I, Bachrach Y, Lanctot M, Patel R, Dasagi V, Marris L, Piliouras G, Tuyls K. States as strings as strategies: steering language models with game-theoretic solvers. 2024, arXiv preprint arXiv: 2402.01704v1

[268]

Guo F. GPT in game theory experiments. 2023, arXiv preprint arXiv: 2305.05516

[269]

Lu S E. Strategic interactions between large language models-based agents in beauty contests. 2024, arXiv preprint arXiv: 2404.08492

[270]

Noh S, Chang H C H. LLMs with personalities in multi-issue negotiation games. 2024, arXiv preprint arXiv: 2405.05248

[271]

Mozikov M, Severin N, Bodishtianu V, Glushanina M, Baklashkin M, Savchenko A V, Makarov I. The good, the bad, and the hulk-like GPT: analyzing emotional decisions of large language models in cooperation and bargaining games. 2024, arXiv preprint arXiv: 2406.03299

[272]

Fontana N, Pierri F, Aiello L M. Nicer than humans: how do large language models behave in the prisoner’s dilemma? In: Proceedings of the 19th International AAAI Conference on Web and Social Media. 2025, 522−535

[273]

Gupta A. Are ChatGPT and GPT-4 good poker players?–A pre-flop analysis. 2023, arXiv preprint arXiv: 2308.12466

[274]

Light J, Cai M, Shen S, Hu Z. From text to tactic: evaluating LLMs playing the game of Avalon. 2023, arXiv preprint arXiv: 2310.05036v1

[275]

Lan Y, Hu Z, Wang L, Wang Y, Ye D, Zhao P, Lim E P, Xiong H, Wang H. LLM-based agent society investigation: collaboration and confrontation in Avalon gameplay. In: Proceedings of 2024 Conference on Empirical Methods in Natural Language Processing. 2024, 128−145

[276]

Gibbons R. A Primer in Game Theory. New York: Harvester Wheatsheaf, 1992

[277]

Yan M, Li R, Zhang H, Wang H, Yang Z, Yan J. LARP: language-agent role play for open-world games. 2023, arXiv preprint arXiv: 2312.17653

[278]

Chen J, Jiang Y, Lu J, Zhang L. S-agents: self-organizing agents in open-ended environment. 2024, arXiv preprint arXiv: 2402.04578

[279]

Zhao Z, Chen K, Guo D, Chai W, Ye T, Zhang Y, Wang G. Hierarchical auto-organizing system for open-ended multi-agent navigation. 2024, arXiv preprint arXiv: 2403.08282

[280]

Wang G, Xie Y, Jiang Y, et al. Voyager: An open-ended embodied agent with large language models[J]. arXiv preprint arXiv:2305.16291, 2023.

[281]

Li J, Li Y, Wadhwa N, Pritch Y, Jacobs D E, Rubinstein M, Bansal M, Ruiz N. Unbounded: a generative infinite game of character life simulation. In: Proceedings of the 13th International Conference on Learning Representations. 2025

[282]

Guan Z, Kong X, Zhong F, Wang Y. Richelieu: self-evolving LLM-based agents for AI diplomacy. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. 2024, 3925

[283]

Lamparth M, Corso A, Ganz J, Mastro O S, Schneider J, Trinkunas H. Human vs. machine: Behavioral differences between expert humans and language models in wargame simulations. In: Proceedings of the 7th AAAI/ACM Conference on AI, Ethics, and Society. 2024, 807−817

[284]

Rivera J P, Mukobi G, Reuel A, Lamparth M, Smith C, Schneider J. Escalation risks from language models in military and diplomatic decision-making. In: Proceedings of 2024 ACM Conference on Fairness, Accountability, and Transparency. 2024, 836−898

[285]

Moghimifar F, Li Y F, Thomson R, Haffari G. Modelling political coalition negotiations using LLM-based agents. 2024, arXiv preprint arXiv: 2402.11712

[286]

Hua W, Fan L, Li L, Mei K, Ji J, Ge Y, Hemphill L, Zhang Y. War and peace (WarAgent): large language model-based multi-agent simulation of world wars. 2023, arXiv preprint arXiv: 2311.17227

[287]

Mao S, Cai Y, Xia Y, Wu W, Wang X, Wang F, Guan Q, Ge T, Wei F. ALYMPICS: LLM agents meet game theory. In: Proceedings of the 31st International Conference on Computational Linguistics. 2025, 2845−2866

[288]

Light J, Cai M, Shen S, Hu Z. AvalonBench: evaluating LLMs playing the game of Avalon. In: Proceedings of NeurIPS 2023 Workshops. 2023

[289]

Piao J, Yan Y, Zhang J, Li N, Yan J, Lan X, Lu Z, Zheng Z, Wang J Y, Zhou D, Gao C, Xu F, Zhang F, Rong K, SuJ, Li Y. AgentSociety: large-scale simulation of LLM-driven generative agents advances understanding of human behaviors and society. 2025, arXiv preprint arXiv: 2502.08691

[290]

Schipper O, Zhang Y, Du Y, Pechenizkiy M, Fang M. PillagerBench: benchmarking LLM-based agents in competitive minecraft team environments. In: Proceedings of 2025 IEEE Conference on Games. 2025, 1−15

[291]

Yehudai A, Eden L, Li A, Uziel G, Zhao Y, Bar-Haim R, Cohan A, Shmueli-Scheuer M. Survey on evaluation of LLM-based agents. 2025, arXiv preprint arXiv: 2503.16416

[292]

Liu X, Yu H, Zhang H, Xu Y, Lei X, et al. AgentBench: evaluating LLMs as agents. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[293]

Mialon G, Fourrier C, Wolf T, LeCun Y, Scialom T. Gaia: a benchmark for general AI assistants. In: Proceedings of the 12th International Conference on Learning Representations. 2023

[294]

Zhu K, Du H, Hong Z, Yang X, Guo S, Wang Z, Wang Z, Qian C, Tang R, Ji H, You J. MultiAgentBench: evaluating the collaboration and competition of LLM agents. In: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics. 2025, 8580−8622

[295]

Gu J, Jiang X, Shi Z, Tan H, Zhai X, Xu C, Li W, Shen Y, Ma S, Liu H, Wang S, Zhang K, Lin Z, Zhang B, Ni L, Guo J, Wang Y, Guo J . A survey on LLM-as-a-judge. The Innovation, 2026, 7( 6): 101253

[296]

Austin J, Odena A, Nye M, Bosma M, Michalewski H, Dohan D, Jiang E, Cai C, Terry M, Le Q, Sutton C. Program synthesis with large language models. 2021, arXiv preprint arXiv: 2108.07732

[297]

Chen M, Tworek J, Jun H, Yuan Q, de Oliveira Pinto H P, et al. Evaluating large language models trained on code. 2021, arXiv preprint arXiv: 2107.03374

[298]

Zhang S, Wang J, Dong G, Sun J, Zhang Y, Pu G. Experimenting a new programming practice with LLMs. 2024, arXiv preprint arXiv: 2401.01062

[299]

Just R, Jalali D, Ernst M D. Defects4j: a database of existing faults to enable controlled testing studies for java programs. In: Proceedings of 2014 International Symposium on Software Testing and Analysis. 2014, 437−440

[300]

Kim S, Thiessen P A, Bolton E E, Chen J, Fu G, Gindulyte A, Han L, He J, He S, Shoemaker B A, Wang J, Yu B, Zhang J, Bryant S H . PubChem substance and compound databases. Nucleic Acids Research, 2016, 44( D1): D1202–D1213

[301]

The UniProt Consortium . UniProt: a worldwide hub of protein knowledge. Nucleic Acids Research, 2019, 47( D1): D506–D515

[302]

Jain A, Ong S P, Hautier G, Chen W, Richards W D, Dacek S, Cholia S, Gunter D, Skinner D, Ceder G, Persson K A . Commentary: THE materials project: a materials genome approach to accelerating materials innovation. APL Materials, 2013, 1( 1): 011002

[303]

Clough E, Barrett T. The gene expression omnibus database. In: Mathé E, Davis S, eds. Statistical Genomics: Methods and Protocols. New York: Humana, 2016, 93−110

[304]

Tomczak K, Czerwińska P, Wiznerowicz M . The cancer genome atlas (TCGA): an immeasurable source of knowledge. Contemporary Oncology, 2015, 19( 1A): A68–A77

[305]

Brown G R, Hem V, Katz K S, Ovetsky M, Wallin C, Ermolaeva O, Tolstoy I, Tatusova T, Pruitt K D, Maglott D R, Murphy T D . Gene: a gene-centered information resource at NCBI. Nucleic Acids Research, 2015, 43( D1): D36–D42

[306]

Johnson A E W, Bulgarelli L, Shen L, Gayles A, Shammout A, Horng S, Pollard T J, Hao S, Moody B, Gow B, Lehman L W H, Celi L A, Mark R G . MIMIC-IV, a freely accessible electronic health record dataset. Scientific Data, 2023, 10( 1): 1

[307]

Jin D, Pan E, Oufattole N, Weng W H, Fang H, Szolovits P . What disease does this patient have? A large-scale open domain question answering dataset from medical exams. Applied Sciences, 2021, 11( 14): 6421

[308]

Jin Q, Dhingra B, Liu Z, Cohen W W, Lu X. PubMedQA: a dataset for biomedical research question answering. In: Proceedings of 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. 2019, 2567−2577

[309]

Zeng G, Yang W, Ju Z, Yang Y, Wang S, Zhang R, Zhou M, Zeng J, Dong X, Zhang R, Fang H, Zhu P, Chen S, Xie P. MedDialog: large-scale medical dialogue datasets. In: Proceedings of 2020 Conference on Empirical Methods in Natural Language Processing. 2020, 9241−9250

[310]

Johnson A E W, Pollard T J, Berkowitz S J, Greenbaum N R, Lungren M P, Deng C Y, Mark R G, Horng S . MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Scientific Data, 2019, 6( 1): 317

[311]

Lai B, Zhang H, Liu M, Pariani A, Ryan F, Jia W, Hayati S A, Rehg J M, Yang D. Werewolf among us: A multimodal dataset for modeling persuasion behaviors in social deduction games. 2022, arXiv preprint arXiv: 2212.08279

[312]

Zhao Z, Chai W, Wang X, Li B, Hao S, Cao S, Ye T, Wang G. See and think: embodied agent in virtual environment. In: Proceedings of the 18th European Conference on Computer Vision. 2024, 187−204

[313]

Liu R, Yang R, Jia C, Zhang G, Zhou D, Dai A M, Yang D, Vosoughi S. Training socially aligned language models in simulated human society. 2023, arXiv preprint arXiv: 2305.16960v1

[314]

Hendrycks D, Burns C, Basart S, Zou A, Mazeika M, Song D, Steinhardt J. Measuring massive multitask language understanding. In: Proceedings of the 9th International Conference on Learning Representations. 2021

[315]

Hendrycks D, Burns C, Kadavath S, Arora A, Basart S, Tang E, Song D, Steinhardt J. Measuring mathematical problem solving with the MATH dataset. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021

[316]

Srivastava A, Rastogi A, Rao A, et al. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models[J]. arXiv preprint arXiv:2206.04615, 2022.

[317]

Talmor A, Herzig J, Lourie N, Berant J. CommonsenseQA: a question answering challenge targeting commonsense knowledge. In: Proceedings of 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1. 2019, 4149−4158

[318]

Wang A, Pruksachatkun Y, Nangia N, Singh A, Michael J, Hill F, Levy O, Bowman S R. SuperGLUE: a stickier benchmark for general-purpose language understanding systems. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems. 2019, 294

[319]

McCoy R T, Pavlick E, Linzen T. Right for the wrong reasons: diagnosing syntactic heuristics in natural language inference. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 2019, 3428−3448

[320]

Clifford S, Iyengar V, Cabeza R, Sinnott-Armstrong W . Moral foundations vignettes: a standardized stimulus database of scenarios based on moral foundations theory. Behavior Research Methods, 2015, 47( 4): 1178–1198

[321]

He H, Chen D, Balakrishnan A, Liang P. Decoupling strategy and generation in negotiation dialogues. In: Proceedings of 2018 Conference on Empirical Methods in Natural Language Processing. 2018, 2333−2343

[322]

Jandaghi P, Sheng X, Bai X, Pujara J, Sidahmed H. Faithful persona-based conversational dataset generation with large language models. In: Proceedings of the 6th Workshop on NLP for Conversational AI. 2024, 114−139

[323]

Liu X, Nourbakhsh A, Li Q, Fang R, Shah S. Real-time rumor debunking on twitter. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. 2015, 1867−1870

[324]

Ma J, Gao W, Mitra P, Kwon S, Jansen B J, Wong K F, Cha M. Detecting rumors from microblogs with recurrent neural Networks. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence. 2016, 3818−3824

[325]

Zhang J, Tang J, Li J, Liu Y, Xing C . Who influenced you? Predicting retweet via social influence locality. ACM Transactions on Knowledge Discovery from Data (TKDD), 2015, 9( 3): 25

[326]

Chen J, Hu X, Liu S, Huang S, Tu W W, He Z, Wen L. LLMArena: assessing capabilities of large language models in dynamic multi-agent environments. In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics. 2024, 13055−13077

[327]

Wang Y, Zhao Y. Metacognitive prompting improves understanding in large language models. In: Proceedings of 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2024, 1914−1926

[328]

Zheng J, Shi C, Cai X, Li Q, Zhang D, Li C, Yu D, Ma Q . Lifelong learning of large language model based agents: a roadmap. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026, 48( 5): 5552–5571

[329]

Sun M, Hong F, Zhang W. Sophia: a persistent agent framework of artificial life. 2025, arXiv preprint arXiv: 2512.18202

[330]

Ferreira S, Silva I, Martins A. Organizing a society of language models: structures and mechanisms for enhanced collective intelligence. 2024, arXiv preprint arXiv: 2405.03825

[331]

Silver D, Schrittwieser J, Simonyan K, Antonoglou I, Huang A, Guez A, Hubert T, Baker L, Lai M, Bolton A, Chen Y, Lillicrap T, Hui F, Sifre L, van den Driessche G, Graepel T, Hassabis D . Mastering the game of go without human knowledge. Nature, 2017, 550( 7676): 354–359

[332]

Ha D, Schmidhuber J. World models. 2018, arXiv preprint arXiv: 1803.10122

[333]

Sap M, Rashkin H, Chen D, Le Bras R, Choi Y. Social IQA: commonsense reasoning about social interactions. In: Proceedings of 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. 2019, 4463−4473

[334]

Doshi P, Gmytrasiewicz P, Durfee E . Recursively modeling other agents for decision making: a research perspective. Artificial Intelligence, 2020, 279: 103202

[335]

Horton J J, Filippas A, Manning B S. Large language models as simulated economic agents: what can we learn from homo silicus? Cambridge: National Bureau of Economic Research, 2023

[336]

Meta Fundamental AI Research Diplomacy Team (FAIR), Bakhtin A, Brown N, Dinan E, Farina G, . et al. Human-level play in the game of Diplomacy by combining language models with strategic reasoning. Science, 2022, 378( 6624): 1067–1074

[337]

Lee J, Cho K, Kiela D. Countering language drift via visual grounding. In: Proceedings of 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. 2019, 4385−4395

[338]

Rath A. Agent drift: quantifying behavioral degradation in multi-agent LLM systems over extended interactions. 2026, arXiv preprint arXiv: 2601.04170

[339]

Wu S, Galley M, Peng B, Cheng H, Li G, Dou Y, Cai W, Zou J, Leskovec J, Gao J. CollabLLM: from passive responders to active collaborators. In: Proceedings of the 42nd International Conference on Machine Learning. 2025, 67260−67283

[340]

Luo H, Ni C, Wen J, Huang Z, Wang Y, Liao B, Chung S, Jin Y, Li X, Xu W, Wang X F, Salam H. HAI-Eval: measuring human-AI synergy in collaborative coding. 2025, arXiv preprint arXiv: 2512.04111v1

Rights & permissions

Higher Education Press

PDF (3915KB)

Supplementary files

Highlights

1337

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉