---
title: "Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View (2024)"
description: "The authors build a test-bed of simulated \"machine societies\", each with three agents. 132 references, cited by 74 papers here."
authors: ["Jintian Zhang", "Xin Xu", "Ningyu Zhang", "Ruibo Liu", "Bryan Hooi", "Shumin Deng"]
year: 2024
venue: "Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2024.acl-long.782/"
doi: "10.18653/v1/2024.acl-long.782"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhang-2024-exploring-collaboration-mechanisms-llm-agents/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhang-2024-exploring-collaboration-mechanisms-llm-agents/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/3/) / Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View

# Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View

**Authors:** Jintian Zhang, [Xin Xu](https://md.research.elamur.ai/free/en/authors/xin-xu/), [Ningyu Zhang](https://md.research.elamur.ai/free/en/authors/ningyu-zhang/), [Ruibo Liu](https://md.research.elamur.ai/free/en/authors/ruibo-liu/), [Bryan Hooi](https://md.research.elamur.ai/free/en/authors/bryan-hooi/) and [Shumin Deng](https://md.research.elamur.ai/free/en/authors/shumin-deng/) · **Year:** 2024 · **Venue:** [Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2024](https://md.research.elamur.ai/free/en/venues/acl/2024/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2024.acl-long.782/) · [PDF](https://aclanthology.org/2024.acl-long.782.pdf) · [DOI 10.18653/v1/2024.acl-long.782](https://doi.org/10.18653/v1/2024.acl-long.782) · [OpenAlex](https://openalex.org/W4402671292)

**Citations:** 57 citations (OpenAlex, 2026-10-14) · [74](https://md.research.elamur.ai/free/en/papers/zhang-2024-exploring-collaboration-mechanisms-llm-agents/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
Systems built from several large language model agents are increasingly used for hard tasks, but it is unclear how their collaboration works or whether it resembles human group behaviour. The authors build a test-bed of simulated "machine societies", each with three agents. Every agent gets one of two personas, easy-going or overconfident, which yields four societies made up entirely or mostly of one trait. Over several rounds, each agent either debates with its peers or reflects on its own earlier answer, and enumerating these choices produces many collaborative strategies. The societies are tested on MATH, MMLU and Chess Move Validity, mainly with ChatGPT (GPT-3.5) and also with open models.

Some strategies outperform earlier strong methods while using fewer API tokens. Debate generally helps, the mix of personas makes little clear difference, and adding agents or rounds does not reliably improve results. Agents also show conformity and majority-driven consensus, which the authors interpret through social psychology. The study suggests that well-designed small-group collaboration may matter more than simply scaling up models or agent counts.

## Key points
- Setup: 3 agents per society, 4 societies (totally or mostly easy-going, totally or mostly overconfident), two thinking patterns (debate, reflection), and 3-round strategies giving 8 debate/reflection permutations.
- Benchmarks: MATH, MMLU, and Chess Move Validity (from BIG-bench). Models: ChatGPT/GPT-3.5, plus Qwen 72B, LlaMA2 Chat 13B/70B and Mixtral 8×7B.
- Efficiency: letting all agents use the same thinking pattern within a round improves efficiency. The balance between agent count and strategy matters more than scale alone.
- Conformity: it is widespread and grows with more rounds. It helped on ChatGPT and Qwen 72B but hurt on LlaMA2 Chat and Mixtral, and its benefit fades as rounds accumulate. Debate reaches consensus more easily than reflection.
- Resources: code and data are released at github.com/zjunlp/MachineSoM. Limitations include using a single LLM per society and offering no adaptive strategy selection.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 798 works · [💭 Social Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/social-psychology/) · 129 works · [💭 Developmental and Educational Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/developmental-and-educational-psychology/) · 260 works

## Cite

Cite as: Jintian Zhang, Xin Xu, Ningyu Zhang, Ruibo Liu, Bryan Hooi and Shumin Deng. 2024. Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhang2024exploring,
  title = {{Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View}},
  author = {Jintian Zhang, Xin Xu, Ningyu Zhang, Ruibo Liu, Bryan Hooi and Shumin Deng},
  booktitle = {Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2024},
  doi = {10.18653/v1/2024.acl-long.782},
  url = {https://doi.org/10.18653/v1/2024.acl-long.782}
}
```

- [← previous EuroLLM: Multilingual Language Models for Europe](https://md.research.elamur.ai/free/en/papers/martins-2024-eurollm-multilingual-language-models-europe/)
- [next → Humans or LLMs as the Judge? A Study on Judgement Bias](https://md.research.elamur.ai/free/en/papers/chen-2024-humans-or-llms-as-judge/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/3/)

## References

132 references, 24 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Elif Akata, Lion Schulz, Julian Coda-Forno, Seong Joon Oh, Matthias Bethge, and Eric Schulz. 2023. Playing repeated games with large language models. CoRR, abs/2305.16867. — [arXiv:2305.16867](https://arxiv.org/abs/2305.16867) [find](https://scholar.google.com/scholar?q=Elif+Akata%2C+Lion+Schulz%2C+Julian+Coda%2DForno%2C+Seong+Joon+Oh%2C+Matthias+Bethge%2C+and+Eric+Schulz%2E+2023%2E+Playing+repeated+games+with+large+language+models%2E+CoRR%2C+abs%2F2305%2E16867%2E+%E2%80%94+%5BarXiv%3A2305%2E16867%5D%28https%3A%2F)
2. Lize Alberts, Geoff Keeling, and Amanda McCroskery. 2024. What makes for a ’good’ social actor? using respect as a lens to evaluate interactions with language agents. CoRR, abs/2401.09082. — [arXiv:2401.09082](https://arxiv.org/abs/2401.09082) [find](https://scholar.google.com/scholar?q=Lize+Alberts%2C+Geoff+Keeling%2C+and+Amanda+McCroskery%2E+2024%2E+What+makes+for+a+%E2%80%99good%E2%80%99+social+actor%3F+using+respect+as+a+lens+to+evaluate+interactions+with+language+agents%2E+CoRR%2C+abs%2F2401%2E09082%2E+%E2%80%94+%5BarXiv%3A24)
3. Clayton P Alderfer. 1987. An intergroup perspective on group dynamics. Handbook of organizational behavior, 190:222. [find](https://scholar.google.com/scholar?q=Clayton+P+Alderfer%2E+1987%2E+An+intergroup+perspective+on+group+dynamics%2E+Handbook+of+organizational+behavior%2C+190%3A222%2E)
4. Vernon L. Allen and John M. Levine. 1969. Consensus and conformity. Journal of Experimental Social Psychology, 5(4):389–399. [find](https://scholar.google.com/scholar?q=Vernon+L%2E+Allen+and+John+M%2E+Levine%2E+1969%2E+Consensus+and+conformity%2E+Journal+of+Experimental+Social+Psychology%2C+5%284%29%3A389%E2%80%93399%2E)
5. Leila Amgoud and Henri Prade. 2009. Using arguments for making and explaining decisions. Artif. Intell., 173(3-4):413–436. [find](https://scholar.google.com/scholar?q=Leila+Amgoud+and+Henri+Prade%2E+2009%2E+Using+arguments+for+making+and+explaining+decisions%2E+Artif%2E+Intell%2E%2C+173%283%2D4%29%3A413%E2%80%93436%2E)
6. Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, Jianxin Ma, Rui Men, Xingzhang Ren, Xuancheng Ren, Chuanqi Tan, Sinan Tan, Jianhong Tu, P… [our card](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-technical-report/)
7. Andrea Baronchelli. 2018. The emergence of consensus: a primer. Royal Society open science, 5(2):172189. [find](https://scholar.google.com/scholar?q=Andrea+Baronchelli%2E+2018%2E+The+emergence+of+consensus%3A+a+primer%2E+Royal+Society+open+science%2C+5%282%29%3A172189%2E)
8. Marcel Binz and Eric Schulz. 2023. Using cognitive psychology to understand gpt-3. Proceedings of the National Academy of Sciences, 120(6):e2218523120. [find](https://scholar.google.com/scholar?q=Marcel+Binz+and+Eric+Schulz%2E+2023%2E+Using+cognitive+psychology+to+understand+gpt%2D3%2E+Proceedings+of+the+National+Academy+of+Sciences%2C+120%286%29%3Ae2218523120%2E)
9. Wilfred R Bion. 2018. Group dynamics: A re-view. New directions in psychoanalysis, pages 440–477. [find](https://scholar.google.com/scholar?q=Wilfred+R+Bion%2E+2018%2E+Group+dynamics%3A+A+re%2Dview%2E+New+directions+in+psychoanalysis%2C+pages+440%E2%80%93477%2E)
10. R. J. Bogumil. 1985. The reflective practitioner: How professionals think in action. Proc. IEEE, 73(4):845–846. [find](https://scholar.google.com/scholar?q=R%2E+J%2E+Bogumil%2E+1985%2E+The+reflective+practitioner%3A+How+professionals+think+in+action%2E+Proc%2E+IEEE%2C+73%284%29%3A845%E2%80%93846%2E)
11. Gillie Bolton. 2010. Reflective practice: Writing and professional development. Sage publications. [find](https://scholar.google.com/scholar?q=Gillie+Bolton%2E+2010%2E+Reflective+practice%3A+Writing+and+professional+development%2E+Sage+publications%2E)
12. Dorwin Cartwright and Alvin Zander. 1968. Group dynamics. [find](https://scholar.google.com/scholar?q=Dorwin+Cartwright+and+Alvin+Zander%2E+1968%2E+Group+dynamics%2E)
13. Miguel Castro and Barbara Liskov. 1999. Practical byzantine fault tolerance. In OSDI, pages 173–186. USENIX Association. [find](https://scholar.google.com/scholar?q=Miguel+Castro+and+Barbara+Liskov%2E+1999%2E+Practical+byzantine+fault+tolerance%2E+In+OSDI%2C+pages+173%E2%80%93186%2E+USENIX+Association%2E)
14. Guangyao Chen, Siwei Dong, Yu Shu, Ge Zhang, Jaward Sesay, Börje F. Karlsson, Jie Fu, and Yemin Shi. 2023a. Autoagents: A framework for automatic agent generation. CoRR, abs/2309.17288. [find](https://scholar.google.com/scholar?q=Guangyao+Chen%2C+Siwei+Dong%2C+Yu+Shu%2C+Ge+Zhang%2C+Jaward+Sesay%2C+B%C3%B6rje+F%2E+Karlsson%2C+Jie+Fu%2C+and+Yemin+Shi%2E+2023a%2E+Autoagents%3A+A+framework+for+automatic+agent+generation%2E+CoRR%2C+abs%2F2309%2E17288%2E)
15. Huaben Chen, Wenkang Ji, Lufeng Xu, and Shiyu Zhao. 2023b. Multi-agent consensus seeking via large language models. CoRR, abs/2310.20151. — [arXiv:2310.20151](https://arxiv.org/abs/2310.20151) [find](https://scholar.google.com/scholar?q=Huaben+Chen%2C+Wenkang+Ji%2C+Lufeng+Xu%2C+and+Shiyu+Zhao%2E+2023b%2E+Multi%2Dagent+consensus+seeking+via+large+language+models%2E+CoRR%2C+abs%2F2310%2E20151%2E+%E2%80%94+%5BarXiv%3A2310%2E20151%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2310%2E20151%29)
16. Justin Chih-Yao Chen, Swarnadeep Saha, and Mohit Bansal. 2023c. Reconcile: Round-table conference improves reasoning via consensus among diverse llms. arxiv preprint, 2309.07864. [our card](https://md.research.elamur.ai/free/en/papers/chen-2024-reconcile-round-table-conference-improves/)
17. Po-Lin Chen and Cheng-Shang Chang. 2023. Interact: Exploring the potentials of chatgpt as a cooperative agent. CoRR, abs/2308.01552. [find](https://scholar.google.com/scholar?q=Po%2DLin+Chen+and+Cheng%2DShang+Chang%2E+2023%2E+Interact%3A+Exploring+the+potentials+of+chatgpt+as+a+cooperative+agent%2E+CoRR%2C+abs%2F2308%2E01552%2E)
18. Weize Chen, Yusheng Su, Jingwei Zuo, Cheng Yang, Chenfei Yuan, Chen Qian, Chi-Min Chan, Yujia Qin, Yaxi Lu, Ruobing Xie, Zhiyuan Liu, Maosong Sun, and Jie Zhou. 2024. Agentverse: Facilitating multi-agent collaboration and exploring emergent behaviors in agents. In ICLR. OpenReview.net. [our card](https://md.research.elamur.ai/free/en/papers/chen-2023-agentverse-facilitating-multi-agent/)
19. Yuheng Cheng, Ceyao Zhang, Zhengwen Zhang, Xiangrui Meng, Sirui Hong, Wenhao Li, Zihao Wang, Zekai Wang, Feng Yin, Junhua Zhao, and Xiuqiang He. 2024. Exploring large language model based intelligent agents: Definitions, methods, and prospects. CoRR, abs/2401.03428. — [arXiv:2401.03428](https://arxiv.org/abs/2401.03428) [find](https://scholar.google.com/scholar?q=Yuheng+Cheng%2C+Ceyao+Zhang%2C+Zhengwen+Zhang%2C+Xiangrui+Meng%2C+Sirui+Hong%2C+Wenhao+Li%2C+Zihao+Wang%2C+Zekai+Wang%2C+Feng+Yin%2C+Junhua+Zhao%2C+and+Xiuqiang+He%2E+2024%2E+Exploring+large+language+model+based+intelligent+)
20. Yun-Shiuan Chuang, Agam Goyal, Nikunj Harlalka, Siddharth Suresh, Robert Hawkins, Sijia Yang, Dhavan Shah, Junjie Hu, and Timothy T. Rogers. 2023. Simulating opinion dynamics with networks of llm-based agents. CoRR, abs/2311.09618. [find](https://scholar.google.com/scholar?q=Yun%2DShiuan+Chuang%2C+Agam+Goyal%2C+Nikunj+Harlalka%2C+Siddharth+Suresh%2C+Robert+Hawkins%2C+Sijia+Yang%2C+Dhavan+Shah%2C+Junjie+Hu%2C+and+Timothy+T%2E+Rogers%2E+2023%2E+Simulating+opinion+dynamics+with+networks+of+llm%2Dbase)
21. Yun-Shiuan Chuang and Timothy T. Rogers. 2023. Computational agent-based models in opinion dynamics: A survey on social simulations and empirical studies. CoRR, abs/2306.03446. — [arXiv:2306.03446](https://arxiv.org/abs/2306.03446) [find](https://scholar.google.com/scholar?q=Yun%2DShiuan+Chuang+and+Timothy+T%2E+Rogers%2E+2023%2E+Computational+agent%2Dbased+models+in+opinion+dynamics%3A+A+survey+on+social+simulations+and+empirical+studies%2E+CoRR%2C+abs%2F2306%2E03446%2E+%E2%80%94+%5BarXiv%3A2306%2E03446%5D%28ht)
22. Robert B. Cialdini and Noah J. Goldstein. 2004. Social influence: Compliance and conformity. Annual Review of Psychology, 55(1):591–621. PMID: 14744228. [find](https://scholar.google.com/scholar?q=Robert+B%2E+Cialdini+and+Noah+J%2E+Goldstein%2E+2004%2E+Social+influence%3A+Compliance+and+conformity%2E+Annual+Review+of+Psychology%2C+55%281%29%3A591%E2%80%93621%2E+PMID%3A+14744228%2E)
23. Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. 2021. Training verifiers to solve math word problems. arXiv prepring, abs/2110.14168. [our card](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/)
24. Julie C Coultas and Edwin JC van Leeuwen. 2015. Conformity: Definitions, types, and evolutionary grounding. Evolutionary perspectives on social psychology, pages 189–202. [find](https://scholar.google.com/scholar?q=Julie+C+Coultas+and+Edwin+JC+van+Leeuwen%2E+2015%2E+Conformity%3A+Definitions%2C+types%2C+and+evolutionary+grounding%2E+Evolutionary+perspectives+on+social+psychology%2C+pages+189%E2%80%93202%2E)
25. Maxwell Crouse, Ibrahim Abdelaziz, Kinjal Basu, Soham Dan, Sadhana Kumaravel, Achille Fokoue, Pavan Kapanipathi, and Luis A. Lastras. 2023. Formally specifying the high-level behavior of llm-based agents. CoRR, abs/2310.08535. — [arXiv:2310.08535](https://arxiv.org/abs/2310.08535) [find](https://scholar.google.com/scholar?q=Maxwell+Crouse%2C+Ibrahim+Abdelaziz%2C+Kinjal+Basu%2C+Soham+Dan%2C+Sadhana+Kumaravel%2C+Achille+Fokoue%2C+Pavan+Kapanipathi%2C+and+Luis+A%2E+Lastras%2E+2023%2E+Formally+specifying+the+high%2Dlevel+behavior+of+llm%2Dbased+age)
26. Morris H. Degroot. 1974. Reaching a consensus. Journal of the American Statistical Association, 69(345):118–121. [find](https://scholar.google.com/scholar?q=Morris+H%2E+Degroot%2E+1974%2E+Reaching+a+consensus%2E+Journal+of+the+American+Statistical+Association%2C+69%28345%29%3A118%E2%80%93121%2E)
27. Dorottya Demszky, Diyi Yang, David S. Yeager, Christopher J. Bryan, Margarett Clapper, Susannah Chandhok, Johannes C. Eichstaedt, Cameron Hecht, Jeremy Jamieson, Meghann Johnson, Michaela Jones, Danielle Krettek-Cobb, Leslie Lai, Nirel JonesMitchell, Desmond C. Ong, Carol S. Dweck, James J. Gross, a… [find](https://scholar.google.com/scholar?q=Dorottya+Demszky%2C+Diyi+Yang%2C+David+S%2E+Yeager%2C+Christopher+J%2E+Bryan%2C+Margarett+Clapper%2C+Susannah+Chandhok%2C+Johannes+C%2E+Eichstaedt%2C+Cameron+Hecht%2C+Jeremy+Jamieson%2C+Meghann+Johnson%2C+Michaela+Jones%2C+Danie)
28. Hung Du, Srikanth Thudumu, Rajesh Vasa, and Kon Mouzakis. 2024. A survey on context-aware multi-agent systems: Techniques, challenges and future directions. CoRR, abs/2402.01968. — [arXiv:2402.01968](https://arxiv.org/abs/2402.01968) [find](https://scholar.google.com/scholar?q=Hung+Du%2C+Srikanth+Thudumu%2C+Rajesh+Vasa%2C+and+Kon+Mouzakis%2E+2024%2E+A+survey+on+context%2Daware+multi%2Dagent+systems%3A+Techniques%2C+challenges+and+future+directions%2E+CoRR%2C+abs%2F2402%2E01968%2E+%E2%80%94+%5BarXiv%3A2402%2E01968%5D%28)
29. Yali Du, Joel Z. Leibo, Usman Islam, Richard Willis, and Peter Sunehag. 2023a. A review of cooperation in multi-agent learning. CoRR, abs/2312.05162. — [arXiv:2312.05162](https://arxiv.org/abs/2312.05162) [find](https://scholar.google.com/scholar?q=Yali+Du%2C+Joel+Z%2E+Leibo%2C+Usman+Islam%2C+Richard+Willis%2C+and+Peter+Sunehag%2E+2023a%2E+A+review+of+cooperation+in+multi%2Dagent+learning%2E+CoRR%2C+abs%2F2312%2E05162%2E+%E2%80%94+%5BarXiv%3A2312%2E05162%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2312%2E05)
30. Yilun Du, Shuang Li, Antonio Torralba, Joshua B. Tenenbaum, and Igor Mordatch. 2023b. Improving factuality and reasoning in language models through multiagent debate. CoRR, abs/2305.14325. [our card](https://md.research.elamur.ai/free/en/papers/du-2023-improving-factuality-reasoning-language-models/)
31. Edgar A. Duéñez-Guzmán, Suzanne Sadedin, Jane X. Wang, Kevin R. McKee, and Joel Z. Leibo. 2023. A social path to human-like artificial intelligence. Nat. Mac. Intell., 5(11):1181–1188. [find](https://scholar.google.com/scholar?q=Edgar+A%2E+Du%C3%A9%C3%B1ez%2DGuzm%C3%A1n%2C+Suzanne+Sadedin%2C+Jane+X%2E+Wang%2C+Kevin+R%2E+McKee%2C+and+Joel+Z%2E+Leibo%2E+2023%2E+A+social+path+to+human%2Dlike+artificial+intelligence%2E+Nat%2E+Mac%2E+Intell%2E%2C+5%2811%29%3A1181%E2%80%931188%2E)
32. Joshua M Epstein. 2012. Generative social science: Studies in agent-based computational modeling. Princeton University Press. [find](https://scholar.google.com/scholar?q=Joshua+M+Epstein%2E+2012%2E+Generative+social+science%3A+Studies+in+agent%2Dbased+computational+modeling%2E+Princeton+University+Press%2E)
33. Xueyang Feng, Zhi-Yuan Chen, Yujia Qin, Yankai Lin, Xu Chen, Zhiyuan Liu, and Ji-Rong Wen. 2024. Large language model-based human-agent collaboration for complex task solving. CoRR, abs/2402.12914. [find](https://scholar.google.com/scholar?q=Xueyang+Feng%2C+Zhi%2DYuan+Chen%2C+Yujia+Qin%2C+Yankai+Lin%2C+Xu+Chen%2C+Zhiyuan+Liu%2C+and+Ji%2DRong+Wen%2E+2024%2E+Large+language+model%2Dbased+human%2Dagent+collaboration+for+complex+task+solving%2E+CoRR%2C+abs%2F2402%2E12914%2E)
34. Roger Fisher, William L Ury, and Bruce Patton. 2011. Getting to yes: Negotiating agreement without giving in. Penguin. [find](https://scholar.google.com/scholar?q=Roger+Fisher%2C+William+L+Ury%2C+and+Bruce+Patton%2E+2011%2E+Getting+to+yes%3A+Negotiating+agreement+without+giving+in%2E+Penguin%2E)
35. Andreas Flache, Michael Mäs, Thomas Feliciani, Edmund Chattoe-Brown, Guillaume Deffuant, Sylvie Huet, and Jan Lorenz. 2017. Models of social influence: Towards the next frontiers. J. Artif. Soc. Soc. Simul., 20(4). [find](https://scholar.google.com/scholar?q=Andreas+Flache%2C+Michael+M%C3%A4s%2C+Thomas+Feliciani%2C+Edmund+Chattoe%2DBrown%2C+Guillaume+Deffuant%2C+Sylvie+Huet%2C+and+Jan+Lorenz%2E+2017%2E+Models+of+social+influence%3A+Towards+the+next+frontiers%2E+J%2E+Artif%2E+Soc%2E+Soc%2E+)
36. Donelson R Forsyth. 2014. Wadsworth Cengage Learning. [find](https://scholar.google.com/scholar?q=Donelson+R+Forsyth%2E+2014%2E+Wadsworth+Cengage+Learning%2E)
37. Donelson R Forsyth. 2018. Group dynamics. Cengage Learning. [find](https://scholar.google.com/scholar?q=Donelson+R+Forsyth%2E+2018%2E+Group+dynamics%2E+Cengage+Learning%2E)
38. Howard S Friedman and Miriam W Schustack. 1999. Personality: Classic theories and modern research. Allyn and Bacon Boston, MA. [find](https://scholar.google.com/scholar?q=Howard+S+Friedman+and+Miriam+W+Schustack%2E+1999%2E+Personality%3A+Classic+theories+and+modern+research%2E+Allyn+and+Bacon+Boston%2C+MA%2E)
39. Andrew Fuchs, Andrea Passarella, and Marco Conti. 2023. Optimizing delegation between human and AI collaborative agents. CoRR, abs/2309.14718. — [arXiv:2309.14718](https://arxiv.org/abs/2309.14718) [find](https://scholar.google.com/scholar?q=Andrew+Fuchs%2C+Andrea+Passarella%2C+and+Marco+Conti%2E+2023%2E+Optimizing+delegation+between+human+and+AI+collaborative+agents%2E+CoRR%2C+abs%2F2309%2E14718%2E+%E2%80%94+%5BarXiv%3A2309%2E14718%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2309%2E14718%29)
40. Chen Gao, Xiaochong Lan, Nian Li, Yuan Yuan, Jingtao Ding, Zhilun Zhou, Fengli Xu, and Yong Li. 2023a. Large language models empowered agent-based modeling and simulation: A survey and perspectives. CoRR, abs/2312.11970. [find](https://scholar.google.com/scholar?q=Chen+Gao%2C+Xiaochong+Lan%2C+Nian+Li%2C+Yuan+Yuan%2C+Jingtao+Ding%2C+Zhilun+Zhou%2C+Fengli+Xu%2C+and+Yong+Li%2E+2023a%2E+Large+language+models+empowered+agent%2Dbased+modeling+and+simulation%3A+A+survey+and+perspectives%2E+C)
41. Chen Gao, Xiaochong Lan, Zhihong Lu, Jinzhu Mao, Jinghua Piao, Huandong Wang, Depeng Jin, and Yong Li. 2023b. S3 : Social-network simulation system with large language model-empowered agents. CoRR, abs/2307.14984. — [arXiv:2307.14984](https://arxiv.org/abs/2307.14984) [find](https://scholar.google.com/scholar?q=Chen+Gao%2C+Xiaochong+Lan%2C+Zhihong+Lu%2C+Jinzhu+Mao%2C+Jinghua+Piao%2C+Huandong+Wang%2C+Depeng+Jin%2C+and+Yong+Li%2E+2023b%2E+S3+%3A+Social%2Dnetwork+simulation+system+with+large+language+model%2Dempowered+agents%2E+CoRR%2C+ab)
42. Yiming Gao, Feiyu Liu, Liang Wang, Zhenjie Lian, Dehua Zheng, Weixuan Wang, Wenjin Yang, Siqin Li, Xianliang Wang, Wenhui Chen, Jing Dai, Qiang Fu, Wei Yang, Lanxiao Huang, and Wei Liu. 2024. Enhancing human experience in human-agent collaboration: A human-centered modeling approach based on positiv… [find](https://scholar.google.com/scholar?q=Yiming+Gao%2C+Feiyu+Liu%2C+Liang+Wang%2C+Zhenjie+Lian%2C+Dehua+Zheng%2C+Weixuan+Wang%2C+Wenjin+Yang%2C+Siqin+Li%2C+Xianliang+Wang%2C+Wenhui+Chen%2C+Jing+Dai%2C+Qiang+Fu%2C+Wei+Yang%2C+Lanxiao+Huang%2C+and+Wei+Liu%2E+2024%2E+Enhancin)
43. Nigel Gilbert and Pietro Terna. 2000. How to build and use agent-based models in social science. Mind & Society, 1:57–72. [find](https://scholar.google.com/scholar?q=Nigel+Gilbert+and+Pietro+Terna%2E+2000%2E+How+to+build+and+use+agent%2Dbased+models+in+social+science%2E+Mind+%26+Society%2C+1%3A57%E2%80%9372%2E)
44. Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V. Chawla, Olaf Wiest, and Xiangliang Zhang. 2024. Large language model based multi-agents: A survey of progress and challenges. CoRR, abs/2402.01680. [our card](https://md.research.elamur.ai/free/en/papers/guo-2024-large-language-model-based/)
45. Thilo Hagendorff. 2023. Machine psychology: Investigating emergent capabilities and behavior in large language models using psychological methods. CoRR, abs/2303.13988. — [arXiv:2303.13988](https://arxiv.org/abs/2303.13988) [find](https://scholar.google.com/scholar?q=Thilo+Hagendorff%2E+2023%2E+Machine+psychology%3A+Investigating+emergent+capabilities+and+behavior+in+large+language+models+using+psychological+methods%2E+CoRR%2C+abs%2F2303%2E13988%2E+%E2%80%94+%5BarXiv%3A2303%2E13988%5D%28https%3A%2F%2Far)
46. Shanshan Han, Qifan Zhang, Yuhang Yao, Weizhao Jin, Zhaozhuo Xu, and Chaoyang He. 2024. Llm multi-agent systems: Challenges and open problems. CoRR, abs/2402.03578. — [arXiv:2402.03578](https://arxiv.org/abs/2402.03578) [find](https://scholar.google.com/scholar?q=Shanshan+Han%2C+Qifan+Zhang%2C+Yuhang+Yao%2C+Weizhao+Jin%2C+Zhaozhuo+Xu%2C+and+Chaoyang+He%2E+2024%2E+Llm+multi%2Dagent+systems%3A+Challenges+and+open+problems%2E+CoRR%2C+abs%2F2402%2E03578%2E+%E2%80%94+%5BarXiv%3A2402%2E03578%5D%28https%3A%2F%2Farxiv%2E)
47. Rui Hao, Linmei Hu, Weijian Qi, Qingliu Wu, Yirui Zhang, and Liqiang Nie. 2023. Chatllm network: More brains, more intelligence. CoRR, abs/2304.12998. — [arXiv:2304.12998](https://arxiv.org/abs/2304.12998) [find](https://scholar.google.com/scholar?q=Rui+Hao%2C+Linmei+Hu%2C+Weijian+Qi%2C+Qingliu+Wu%2C+Yirui+Zhang%2C+and+Liqiang+Nie%2E+2023%2E+Chatllm+network%3A+More+brains%2C+more+intelligence%2E+CoRR%2C+abs%2F2304%2E12998%2E+%E2%80%94+%5BarXiv%3A2304%2E12998%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2304%2E1)
48. Zhitao He, Pengfei Cao, Yubo Chen, Kang Liu, Ruopeng Li, Mengshu Sun, and Jun Zhao. 2023. LEGO: A multi-agent collaborative framework with role-playing and iterative feedback for causality explanation generation. In EMNLP (Findings), pages 9142–9163. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zhitao+He%2C+Pengfei+Cao%2C+Yubo+Chen%2C+Kang+Liu%2C+Ruopeng+Li%2C+Mengshu+Sun%2C+and+Jun+Zhao%2E+2023%2E+LEGO%3A+A+multi%2Dagent+collaborative+framework+with+role%2Dplaying+and+iterative+feedback+for+causality+explanation)
49. David Held. 2006. Models of democracy. Polity. [find](https://scholar.google.com/scholar?q=David+Held%2E+2006%2E+Models+of+democracy%2E+Polity%2E)
50. Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021a. Measuring massive multitask language understanding. In ICLR. OpenReview.net. [our card](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/)
51. Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021b. Measuring mathematical problem solving with the MATH dataset. In NeurIPS Datasets and Benchmarks. [our card](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/)
52. Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, and Jürgen Schmidhuber. 2024. Metagpt: Meta programming for multi-agent collaborative framework. In ICLR. O… [find](https://scholar.google.com/scholar?q=Sirui+Hong%2C+Mingchen+Zhuge%2C+Jonathan+Chen%2C+Xiawu+Zheng%2C+Yuheng+Cheng%2C+Jinlin+Wang%2C+Ceyao+Zhang%2C+Zili+Wang%2C+Steven+Ka+Shing+Yau%2C+Zijuan+Lin%2C+Liyang+Zhou%2C+Chenyu+Ran%2C+Lingfeng+Xiao%2C+Chenglin+Wu%2C+and+J%C3%BCr)
53. Yaqing Hou, Mingyang Sun, Yifeng Zeng, Yew-Soon Ong, Yaochu Jin, Hongwei Ge, and Qiang Zhang. 2023. A multi-agent cooperative learning system with evolution of social roles. IEEE Transactions on Evolutionary Computation, pages 1–1. [find](https://scholar.google.com/scholar?q=Yaqing+Hou%2C+Mingyang+Sun%2C+Yifeng+Zeng%2C+Yew%2DSoon+Ong%2C+Yaochu+Jin%2C+Hongwei+Ge%2C+and+Qiang+Zhang%2E+2023%2E+A+multi%2Dagent+cooperative+learning+system+with+evolution+of+social+roles%2E+IEEE+Transactions+on+Evolu)
54. Irving L Janis. 1972. Victims of Groupthink: A psychological study of foreign-policy decisions and fiascoes. Houghton Mifflin. [find](https://scholar.google.com/scholar?q=Irving+L+Janis%2E+1972%2E+Victims+of+Groupthink%3A+A+psychological+study+of+foreign%2Dpolicy+decisions+and+fiascoes%2E+Houghton+Mifflin%2E)
55. Karen A Jehn. 1995. A multimethod examination of the benefits and detriments of intragroup conflict. Administrative science quarterly, pages 256–282. [find](https://scholar.google.com/scholar?q=Karen+A+Jehn%2E+1995%2E+A+multimethod+examination+of+the+benefits+and+detriments+of+intragroup+conflict%2E+Administrative+science+quarterly%2C+pages+256%E2%80%93282%2E)
56. Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Yejin Bang, Andrea Madotto, and Pascale Fung. 2023. Survey of hallucination in natural language generation. ACM Comput. Surv., 55(12):248:1–248:38. [our card](https://md.research.elamur.ai/free/en/papers/ji-2022-survey-hallucination-natural-language-generation/)
57. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de Las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix,… [find](https://scholar.google.com/scholar?q=Albert+Q%2E+Jiang%2C+Alexandre+Sablayrolles%2C+Arthur+Mensch%2C+Chris+Bamford%2C+Devendra+Singh+Chaplot%2C+Diego+de+Las+Casas%2C+Florian+Bressand%2C+Gianna+Lengyel%2C+Guillaume+Lample%2C+Lucile+Saulnier%2C+L%C3%A9lio+Renard+Lav)
58. Albert Q. Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Emma Bou Hanna, Florian Bressand, Gianna Lengyel, Guillaume Bour, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock,… [find](https://scholar.google.com/scholar?q=Albert+Q%2E+Jiang%2C+Alexandre+Sablayrolles%2C+Antoine+Roux%2C+Arthur+Mensch%2C+Blanche+Savary%2C+Chris+Bamford%2C+Devendra+Singh+Chaplot%2C+Diego+de+las+Casas%2C+Emma+Bou+Hanna%2C+Florian+Bressand%2C+Gianna+Lengyel%2C+Guill)
59. David W Johnson and Roger T Johnson. 2009. An educational psychology success story: Social interdependence theory and cooperative learning. Educational researcher, 38(5):365–379. [find](https://scholar.google.com/scholar?q=David+W+Johnson+and+Roger+T+Johnson%2E+2009%2E+An+educational+psychology+success+story%3A+Social+interdependence+theory+and+cooperative+learning%2E+Educational+researcher%2C+38%285%29%3A365%E2%80%93379%2E)
60. Luoma Ke, Song Tong, Peng Chen, and Kaiping Peng. 2024. Exploring the frontiers of llms in psychological applications: A comprehensive review. CoRR, abs/2401.01519. — [arXiv:2401.01519](https://arxiv.org/abs/2401.01519) [find](https://scholar.google.com/scholar?q=Luoma+Ke%2C+Song+Tong%2C+Peng+Chen%2C+and+Kaiping+Peng%2E+2024%2E+Exploring+the+frontiers+of+llms+in+psychological+applications%3A+A+comprehensive+review%2E+CoRR%2C+abs%2F2401%2E01519%2E+%E2%80%94+%5BarXiv%3A2401%2E01519%5D%28https%3A%2F%2Farxiv%2E)
61. Chuyi Kong, Yaxin Fan, Xiang Wan, Feng Jiang, and Benyou Wang. 2023. Large language model as a user simulator. CoRR, abs/2308.11534. — [arXiv:2308.11534](https://arxiv.org/abs/2308.11534) [find](https://scholar.google.com/scholar?q=Chuyi+Kong%2C+Yaxin+Fan%2C+Xiang+Wan%2C+Feng+Jiang%2C+and+Benyou+Wang%2E+2023%2E+Large+language+model+as+a+user+simulator%2E+CoRR%2C+abs%2F2308%2E11534%2E+%E2%80%94+%5BarXiv%3A2308%2E11534%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2308%2E11534%29)
62. Tatsuki Kuribayashi, Yohei Oseki, and Timothy Baldwin. 2024. Psychometric predictive power of large language models. In NAACL (Findings). Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Tatsuki+Kuribayashi%2C+Yohei+Oseki%2C+and+Timothy+Baldwin%2E+2024%2E+Psychometric+predictive+power+of+large+language+models%2E+In+NAACL+%28Findings%29%2E+Association+for+Computational+Linguistics%2E)
63. Marc Lanctot, Kate Larson, Yoram Bachrach, Luke Marris, Zun Li, Avishkar Bhoopchand, Thomas W. Anthony, Brian Tanner, and Anna Koop. 2023. Evaluating agents using social choice theory. CoRR, abs/2312.03121. — [arXiv:2312.03121](https://arxiv.org/abs/2312.03121) [find](https://scholar.google.com/scholar?q=Marc+Lanctot%2C+Kate+Larson%2C+Yoram+Bachrach%2C+Luke+Marris%2C+Zun+Li%2C+Avishkar+Bhoopchand%2C+Thomas+W%2E+Anthony%2C+Brian+Tanner%2C+and+Anna+Koop%2E+2023%2E+Evaluating+agents+using+social+choice+theory%2E+CoRR%2C+abs%2F2312%2E)
64. Alan M Leslie, Ori Friedman, and Tim P German. 2004. Core mechanisms in ‘theory of mind’. Trends in cognitive sciences, 8(12):528–533. [find](https://scholar.google.com/scholar?q=Alan+M+Leslie%2C+Ori+Friedman%2C+and+Tim+P+German%2E+2004%2E+Core+mechanisms+in+%E2%80%98theory+of+mind%E2%80%99%2E+Trends+in+cognitive+sciences%2C+8%2812%29%3A528%E2%80%93533%2E)
65. Guohao Li, Hasan Hammoud, Hani Itani, Dmitrii Khizbullin, and Bernard Ghanem. 2023a. CAMEL: communicative agents for "mind" exploration of large language model society. In NeurIPS. [our card](https://md.research.elamur.ai/free/en/papers/li-2023-camel-communicative-agents-mind/)
66. Yuan Li, Yixuan Zhang, and Lichao Sun. 2023b. Metaagents: Simulating interactions of human behaviors for llm-based task-oriented coordination via collaborative generative agents. CoRR, abs/2310.06500. [find](https://scholar.google.com/scholar?q=Yuan+Li%2C+Yixuan+Zhang%2C+and+Lichao+Sun%2E+2023b%2E+Metaagents%3A+Simulating+interactions+of+human+behaviors+for+llm%2Dbased+task%2Doriented+coordination+via+collaborative+generative+agents%2E+CoRR%2C+abs%2F2310%2E06500%2E)
67. Yujia Li, David H. Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, Thomas Hubert, Peter Choy, Cyprien de Masson d’Autume, Igor Babuschkin, Xinyun Chen, Po-Sen Huang, Johannes Welbl, Sven Gowal, Alexey Cherepanov, Jame… [our card](https://md.research.elamur.ai/free/en/papers/li-2022-competition-level-code-generation-alphacode/)
68. Tian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang, Yan Wang, Rui Wang, Yujiu Yang, Zhaopeng Tu, and Shuming Shi. 2023. Encouraging divergent thinking in large language models through multi-agent debate. CoRR, abs/2305.19118. [our card](https://md.research.elamur.ai/free/en/papers/liang-2023-encouraging-divergent-thinking-large-language/)
69. Yuanzhi Liang, Linchao Zhu, and Yi Yang. 2024. An-teval: Quantitatively evaluating informativeness and expressiveness of agent social interactions. CoRR, abs/2401.06509. — [arXiv:2401.06509](https://arxiv.org/abs/2401.06509) [find](https://scholar.google.com/scholar?q=Yuanzhi+Liang%2C+Linchao+Zhu%2C+and+Yi+Yang%2E+2024%2E+An%2Dteval%3A+Quantitatively+evaluating+informativeness+and+expressiveness+of+agent+social+interactions%2E+CoRR%2C+abs%2F2401%2E06509%2E+%E2%80%94+%5BarXiv%3A2401%2E06509%5D%28https%3A%2F%2Fa)
70. Ruibo Liu, Ruixin Yang, Chenyan Jia, Ge Zhang, Denny Zhou, Andrew M. Dai, Diyi Yang, and Soroush Vosoughi. 2024. Training socially aligned language models in simulated human society. In ICLR. OpenReview.net. [find](https://scholar.google.com/scholar?q=Ruibo+Liu%2C+Ruixin+Yang%2C+Chenyan+Jia%2C+Ge+Zhang%2C+Denny+Zhou%2C+Andrew+M%2E+Dai%2C+Diyi+Yang%2C+and+Soroush+Vosoughi%2E+2024%2E+Training+socially+aligned+language+models+in+simulated+human+society%2E+In+ICLR%2E+OpenRevi)
71. Ruibo Liu, Ge Zhang, Xinyu Feng, and Soroush Vosoughi. 2022. Aligning generative language models with human values. In NAACL-HLT (Findings), pages 241–252. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ruibo+Liu%2C+Ge+Zhang%2C+Xinyu+Feng%2C+and+Soroush+Vosoughi%2E+2022%2E+Aligning+generative+language+models+with+human+values%2E+In+NAACL%2DHLT+%28Findings%29%2C+pages+241%E2%80%93252%2E+Association+for+Computational+Linguistics%2E)
72. Zijun Liu, Yanzhe Zhang, Peng Li, Yang Liu, and Diyi Yang. 2023. Dynamic llm-agent network: An llm-agent collaboration framework with agent team optimization. CoRR, abs/2310.02170. [find](https://scholar.google.com/scholar?q=Zijun+Liu%2C+Yanzhe+Zhang%2C+Peng+Li%2C+Yang+Liu%2C+and+Diyi+Yang%2E+2023%2E+Dynamic+llm%2Dagent+network%3A+An+llm%2Dagent+collaboration+framework+with+agent+team+optimization%2E+CoRR%2C+abs%2F2310%2E02170%2E)
73. Jan Lorenz, Martin Neumann, and Tobias Schröder. 2021. Individual attitude change and societal dynamics: Computational experiments with psychological theories. Psychological Review, 128(4):623. [find](https://scholar.google.com/scholar?q=Jan+Lorenz%2C+Martin+Neumann%2C+and+Tobias+Schr%C3%B6der%2E+2021%2E+Individual+attitude+change+and+societal+dynamics%3A+Computational+experiments+with+psychological+theories%2E+Psychological+Review%2C+128%284%29%3A623%2E)
74. Junliang Luo, Tianyu Li, Di Wu, Michael Jenkin, Steve Liu, and Gregory Dudek. 2024. Hallucination detection and hallucination mitigation: An investigation. CoRR, abs/2401.08358. — [arXiv:2401.08358](https://arxiv.org/abs/2401.08358) [find](https://scholar.google.com/scholar?q=Junliang+Luo%2C+Tianyu+Li%2C+Di+Wu%2C+Michael+Jenkin%2C+Steve+Liu%2C+and+Gregory+Dudek%2E+2024%2E+Hallucination+detection+and+hallucination+mitigation%3A+An+investigation%2E+CoRR%2C+abs%2F2401%2E08358%2E+%E2%80%94+%5BarXiv%3A2401%2E08358%5D%28h)
75. Chang Ma, Junlei Zhang, Zhihao Zhu, Cheng Yang, Yujiu Yang, Yaohui Jin, Zhenzhong Lan, Lingpeng Kong, and Junxian He. 2024a. Agentboard: An analytical evaluation board of multi-turn llm agents. CoRR, abs/2401.13178. [find](https://scholar.google.com/scholar?q=Chang+Ma%2C+Junlei+Zhang%2C+Zhihao+Zhu%2C+Cheng+Yang%2C+Yujiu+Yang%2C+Yaohui+Jin%2C+Zhenzhong+Lan%2C+Lingpeng+Kong%2C+and+Junxian+He%2E+2024a%2E+Agentboard%3A+An+analytical+evaluation+board+of+multi%2Dturn+llm+agents%2E+CoRR%2C+)
76. Qun Ma, Xiao Xue, Deyu Zhou, Xiangning Yu, Donghua Liu, Xuwen Zhang, Zihan Zhao, Yifan Shen, Peilin Ji, Juanjuan Li, Gang Wang, and Wanpeng Ma. 2024b. Computational experiments meet large language model based agents: A survey and perspective. CoRR, abs/2402.00262. — [arXiv:2402.00262](https://arxiv.org/abs/2402.00262) [find](https://scholar.google.com/scholar?q=Qun+Ma%2C+Xiao+Xue%2C+Deyu+Zhou%2C+Xiangning+Yu%2C+Donghua+Liu%2C+Xuwen+Zhang%2C+Zihan+Zhao%2C+Yifan+Shen%2C+Peilin+Ji%2C+Juanjuan+Li%2C+Gang+Wang%2C+and+Wanpeng+Ma%2E+2024b%2E+Computational+experiments+meet+large+language+mod)
77. Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark. 2023. Self-refine: Iterative refinement with… [find](https://scholar.google.com/scholar?q=Aman+Madaan%2C+Niket+Tandon%2C+Prakhar+Gupta%2C+Skyler+Hallinan%2C+Luyu+Gao%2C+Sarah+Wiegreffe%2C+Uri+Alon%2C+Nouha+Dziri%2C+Shrimai+Prabhumoye%2C+Yiming+Yang%2C+Shashank+Gupta%2C+Bodhisattwa+Prasad+Majumder%2C+Katherine+Her)
78. Qiaozhu Mei, Yutong Xie, Walter Yuan, and Matthew O. Jackson. 2024. A turing test of whether ai chatbots are behaviorally similar to humans. Proceedings of the National Academy of Sciences, 121(9):e2313925121. [find](https://scholar.google.com/scholar?q=Qiaozhu+Mei%2C+Yutong+Xie%2C+Walter+Yuan%2C+and+Matthew+O%2E+Jackson%2E+2024%2E+A+turing+test+of+whether+ai+chatbots+are+behaviorally+similar+to+humans%2E+Proceedings+of+the+National+Academy+of+Sciences%2C+121%289%29%3Ae23)
79. Jack Mezirow. 2003. How critical reflection triggers transformative learning. Adult and Continuing Education: Teaching, learning and research, 4:199. [find](https://scholar.google.com/scholar?q=Jack+Mezirow%2E+2003%2E+How+critical+reflection+triggers+transformative+learning%2E+Adult+and+Continuing+Education%3A+Teaching%2C+learning+and+research%2C+4%3A199%2E)
80. Jack Mezirow. 2018. Transformative learning theory. In Contemporary theories of learning, pages 114– 128. Routledge. [find](https://scholar.google.com/scholar?q=Jack+Mezirow%2E+2018%2E+Transformative+learning+theory%2E+In+Contemporary+theories+of+learning%2C+pages+114%E2%80%93+128%2E+Routledge%2E)
81. Marvin Minsky. 1988. Society of mind. Simon and Schuster. [find](https://scholar.google.com/scholar?q=Marvin+Minsky%2E+1988%2E+Society+of+mind%2E+Simon+and+Schuster%2E)
82. Don A Moore and Paul J Healy. 2008. The trouble with overconfidence. Psychological review, 115(2):502. [find](https://scholar.google.com/scholar?q=Don+A+Moore+and+Paul+J+Healy%2E+2008%2E+The+trouble+with+overconfidence%2E+Psychological+review%2C+115%282%29%3A502%2E)
83. Diana C Mutz. 2006. Hearing the other side: Deliberative versus participatory democracy. Cambridge University Press. [find](https://scholar.google.com/scholar?q=Diana+C+Mutz%2E+2006%2E+Hearing+the+other+side%3A+Deliberative+versus+participatory+democracy%2E+Cambridge+University+Press%2E)
84. OpenAI. 2022. Chatgpt: Optimizing language models for dialogue. [https://openai.com/blog/chatgpt/](https://openai.com/blog/chatgpt/). [↗](https://openai.com/blog/chatgpt/)
85. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul F. Christiano, Jan Leike, and Ryan Lowe. 2022.… [our card](https://md.research.elamur.ai/free/en/papers/ouyang-2022-training-language-models-follow-instructions/)
86. Joon Sung Park, Joseph C. O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2023. Generative agents: Interactive simulacra of human behavior. In UIST, pages 2:1–2:22. ACM. [find](https://scholar.google.com/scholar?q=Joon+Sung+Park%2C+Joseph+C%2E+O%E2%80%99Brien%2C+Carrie+Jun+Cai%2C+Meredith+Ringel+Morris%2C+Percy+Liang%2C+and+Michael+S%2E+Bernstein%2E+2023%2E+Generative+agents%3A+Interactive+simulacra+of+human+behavior%2E+In+UIST%2C+pages+2%3A1%E2%80%932)
87. Mrinank Sharma, Meg Tong, Tomasz Korbak, David Duvenaud, Amanda Askell, Samuel R. Bowman, Newton Cheng, Esin Durmus, Zac Hatfield-Dodds, Scott R. Johnston, Shauna Kravec, Timothy Maxwell, Sam McCandlish, Kamal Ndousse, Oliver Rausch, Nicholas Schiefer, Da Yan, Miranda Zhang, and Ethan Perez. 2024. T… [our card](https://md.research.elamur.ai/free/en/papers/sharma-2023-towards-understanding-sycophancy-language-models/)
88. Noah Shinn, Beck Labash, and Ashwin Gopinath. 2023. Reflexion: an autonomous agent with dynamic memory and self-reflection. arXiv preprint, abs/2303.11366. [our card](https://md.research.elamur.ai/free/en/papers/shinn-2023-reflexion-language-agents-verbal-reinforcement/)
89. Michael Siegal and Rosemary Varley. 2002. Neural systems involved in ’theory of mind’. Nature Reviews Neuroscience, 3(6):463–471. [find](https://scholar.google.com/scholar?q=Michael+Siegal+and+Rosemary+Varley%2E+2002%2E+Neural+systems+involved+in+%E2%80%99theory+of+mind%E2%80%99%2E+Nature+Reviews+Neuroscience%2C+3%286%29%3A463%E2%80%93471%2E)
90. Chaim Perelman. 1971. The new rhetoric. Springer. [find](https://scholar.google.com/scholar?q=Chaim+Perelman%2E+1971%2E+The+new+rhetoric%2E+Springer%2E)
91. Push Singh. 2003. Examining the society of mind. Comput. Artif. Intell., 22(6):521–543. [find](https://scholar.google.com/scholar?q=Push+Singh%2E+2003%2E+Examining+the+society+of+mind%2E+Comput%2E+Artif%2E+Intell%2E%2C+22%286%29%3A521%E2%80%93543%2E)
92. Pouya Pezeshkpour, Eser Kandogan, Nikita Bhutani, Sajjadur Rahman, Tom Mitchell, and Estevam Hruschka. 2024. Reasoning capacity in multi-agent systems: Limitations, challenges and human-centered solutions. CoRR, abs/2402.01108. — [arXiv:2402.01108](https://arxiv.org/abs/2402.01108) [find](https://scholar.google.com/scholar?q=Pouya+Pezeshkpour%2C+Eser+Kandogan%2C+Nikita+Bhutani%2C+Sajjadur+Rahman%2C+Tom+Mitchell%2C+and+Estevam+Hruschka%2E+2024%2E+Reasoning+capacity+in+multi%2Dagent+systems%3A+Limitations%2C+challenges+and+human%2Dcentered+solut)
93. Paul Smaldino. 2023. Modeling social behavior: Mathematical and agent-based models of social dynamics and cultural evolution. Princeton University Press. [find](https://scholar.google.com/scholar?q=Paul+Smaldino%2E+2023%2E+Modeling+social+behavior%3A+Mathematical+and+agent%2Dbased+models+of+social+dynamics+and+cultural+evolution%2E+Princeton+University+Press%2E)
94. Shuofei Qiao, Ningyu Zhang, Runnan Fang, Yujie Luo, Wangchunshu Zhou, Yuchen Eleanor Jiang, Chengfei Lv, and Huajun Chen. 2024. Autoact: Automatic agent learning from scratch via self-planning. In ACL. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Shuofei+Qiao%2C+Ningyu+Zhang%2C+Runnan+Fang%2C+Yujie+Luo%2C+Wangchunshu+Zhou%2C+Yuchen+Eleanor+Jiang%2C+Chengfei+Lv%2C+and+Huajun+Chen%2E+2024%2E+Autoact%3A+Automatic+agent+learning+from+scratch+via+self%2Dplanning%2E+In+ACL)
95. Vipula Rawte, Amit P. Sheth, and Amitava Das. 2023. A survey of hallucination in large foundation models. CoRR, abs/2309.05922. [our card](https://md.research.elamur.ai/free/en/papers/rawte-2023-survey-hallucination-large-foundation-models/)
96. Maarten Sap, Ronan Le Bras, Daniel Fried, and Yejin Choi. 2022. Neural theory-of-mind? on the limits of social intelligence in large lms. In EMNLP, pages 3762–3780. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Maarten+Sap%2C+Ronan+Le+Bras%2C+Daniel+Fried%2C+and+Yejin+Choi%2E+2022%2E+Neural+theory%2Dof%2Dmind%3F+on+the+limits+of+social+intelligence+in+large+lms%2E+In+EMNLP%2C+pages+3762%E2%80%933780%2E+Association+for+Computational+Lingu)
97. Thomas J Scheff. 1967. Toward a sociological model of consensus. American Sociological Review, pages 32–46. [find](https://scholar.google.com/scholar?q=Thomas+J+Scheff%2E+1967%2E+Toward+a+sociological+model+of+consensus%2E+American+Sociological+Review%2C+pages+32%E2%80%9346%2E)
98. David Wyatt Seal, Laura M Bogart, and Anke A Ehrhardt. 1998. Small group dynamics: The utility of focus group discussions as a research method. Group Dynamics: Theory, Research, and Practice, 2(4):253. [find](https://scholar.google.com/scholar?q=David+Wyatt+Seal%2C+Laura+M+Bogart%2C+and+Anke+A+Ehrhardt%2E+1998%2E+Small+group+dynamics%3A+The+utility+of+focus+group+discussions+as+a+research+method%2E+Group+Dynamics%3A+Theory%2C+Research%2C+and+Practice%2C+2%284%29%3A253)
99. Murray Shanahan, Kyle McDonell, and Laria Reynolds. 2023. Role play with large language models. Nat., 623(7987):493–498. [our card](https://md.research.elamur.ai/free/en/papers/shanahan-2023-role-play-large-language-models/)
100. Natalie Shapira, Mosh Levy, Seyed Hossein Alavi, Xuhui Zhou, Yejin Choi, Yoav Goldberg, Maarten Sap, and Vered Shwartz. 2024. Clever hans or neural theory of mind? stress testing social reasoning in large language models. In EACL (1), pages 2257– 2273. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Natalie+Shapira%2C+Mosh+Levy%2C+Seyed+Hossein+Alavi%2C+Xuhui+Zhou%2C+Yejin+Choi%2C+Yoav+Goldberg%2C+Maarten+Sap%2C+and+Vered+Shwartz%2E+2024%2E+Clever+hans+or+neural+theory+of+mind%3F+stress+testing+social+reasoning+in+l)
101. Nikita Soni, Niranjan Balasubramanian, H. Andrew Schwartz, and Dirk Hovy. 2024. Comparing human-centered language modeling: Is it better to model groups, individual traits, or both? CoRR, abs/2401.12492. — [arXiv:2401.12492](https://arxiv.org/abs/2401.12492) [find](https://scholar.google.com/scholar?q=Nikita+Soni%2C+Niranjan+Balasubramanian%2C+H%2E+Andrew+Schwartz%2C+and+Dirk+Hovy%2E+2024%2E+Comparing+human%2Dcentered+language+modeling%3A+Is+it+better+to+model+groups%2C+individual+traits%2C+or+both%3F+CoRR%2C+abs%2F2401%2E124)
102. Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Al… [our card](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/)
103. Peter Stone and Manuela M. Veloso. 2000. Multiagent systems: A survey from a machine learning perspective. Auton. Robots, 8(3):345–383. [find](https://scholar.google.com/scholar?q=Peter+Stone+and+Manuela+M%2E+Veloso%2E+2000%2E+Multiagent+systems%3A+A+survey+from+a+machine+learning+perspective%2E+Auton%2E+Robots%2C+8%283%29%3A345%E2%80%93383%2E)
104. Cass R Sunstein. 2005. Why societies need dissent. Harvard University Press. [find](https://scholar.google.com/scholar?q=Cass+R+Sunstein%2E+2005%2E+Why+societies+need+dissent%2E+Harvard+University+Press%2E)
105. Henri Tajfel. 1982. Social psychology of intergroup relations. Annual review of psychology, 33(1):1–39. [find](https://scholar.google.com/scholar?q=Henri+Tajfel%2E+1982%2E+Social+psychology+of+intergroup+relations%2E+Annual+review+of+psychology%2C+33%281%29%3A1%E2%80%9339%2E)
106. Henri Tajfel and John C Turner. 2004. The social identity theory of intergroup behavior. In Political psychology, pages 276–293. Psychology Press. [find](https://scholar.google.com/scholar?q=Henri+Tajfel+and+John+C+Turner%2E+2004%2E+The+social+identity+theory+of+intergroup+behavior%2E+In+Political+psychology%2C+pages+276%E2%80%93293%2E+Psychology+Press%2E)
107. Yashar Talebirad and Amirhossein Nadiri. 2023. Multi-agent collaboration: Harnessing the power of intelligent LLM agents. CoRR, abs/2306.03314. 2023. The rise and potential of large language model based agents: A survey. arxiv preprint, abs/2309.07864. [our card](https://md.research.elamur.ai/free/en/papers/xi-2023-rise-potential-large-language/)
108. Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurélien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. 2023. Llama: Open and efficient foundation language models. CoRR, ab… [our card](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/)
109. Yang Xiao, Yi Cheng, Jinlan Fu, Jiashuo Wang, Wenjie Li, and Pengfei Liu. 2023. How far are we from believable ai agents? a framework for evaluating the believability of human behavior simulation. CoRR, abs/2312.17115. — [arXiv:2312.17115](https://arxiv.org/abs/2312.17115) [find](https://scholar.google.com/scholar?q=Yang+Xiao%2C+Yi+Cheng%2C+Jinlan+Fu%2C+Jiashuo+Wang%2C+Wenjie+Li%2C+and+Pengfei+Liu%2E+2023%2E+How+far+are+we+from+believable+ai+agents%3F+a+framework+for+evaluating+the+believability+of+human+behavior+simulation%2E+CoR)
110. José M. Vidal. 2006. Fundamentals of Multiagent Systems: Using NetLogo Models. Unpublished. [http://www.multiagent.com](http://www.multiagent.com). [↗](http://www.multiagent.com)
111. Cheng Wang, Chuwen Wang, Yu Zhao, Shirong Zeng, Wang Zhang, and Ronghui Ning. 2024a. Behavioral simulation: Exploring a possible next paradigm for science. CoRR, abs/2401.09851. — [arXiv:2401.09851](https://arxiv.org/abs/2401.09851) [find](https://scholar.google.com/scholar?q=Cheng+Wang%2C+Chuwen+Wang%2C+Yu+Zhao%2C+Shirong+Zeng%2C+Wang+Zhang%2C+and+Ronghui+Ning%2E+2024a%2E+Behavioral+simulation%3A+Exploring+a+possible+next+paradigm+for+science%2E+CoRR%2C+abs%2F2401%2E09851%2E+%E2%80%94+%5BarXiv%3A2401%2E09851%5D%28h)
112. Haonan Wang, James Zou, Michael Mozer, Anirudh Goyal, Alex Lamb, Linjun Zhang, Weijie J Su, Zhun Deng, Michael Qizhe Xie, Hannah Brown, and Kenji Kawaguchi. 2024b. Can ai be as creative as humans? CoRR, abs/2401.01623. — [arXiv:2401.01623](https://arxiv.org/abs/2401.01623) [find](https://scholar.google.com/scholar?q=Haonan+Wang%2C+James+Zou%2C+Michael+Mozer%2C+Anirudh+Goyal%2C+Alex+Lamb%2C+Linjun+Zhang%2C+Weijie+J+Su%2C+Zhun+Deng%2C+Michael+Qizhe+Xie%2C+Hannah+Brown%2C+and+Kenji+Kawaguchi%2E+2024b%2E+Can+ai+be+as+creative+as+humans%3F+CoR)
113. Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, Wayne Xin Zhao, Zhewei Wei, and Ji-Rong Wen. 2024c. A survey on large language model based autonomous agents. Front. Comput. Sci., 18. [our card](https://md.research.elamur.ai/free/en/papers/wang-2023-survey-large-language-model-based/)
114. Zekun Wang, Ge Zhang, Kexin Yang, Ning Shi, Wangchunshu Zhou, Shaochun Hao, Guangzheng Xiong, Yizhi Li, Mong Yuan Sim, Xiuying Chen, Qingqing Zhu, Zhenzhu Yang, Adam Nik, Qi Liu, Chenghua Lin, Shi Wang, Ruibo Liu, Wenhu Chen, Ke Xu, Dayiheng Liu, Yike Guo, and Jie Fu. 2023. Interactive natural langu… — [arXiv:2305.13246](https://arxiv.org/abs/2305.13246) [find](https://scholar.google.com/scholar?q=Zekun+Wang%2C+Ge+Zhang%2C+Kexin+Yang%2C+Ning+Shi%2C+Wangchunshu+Zhou%2C+Shaochun+Hao%2C+Guangzheng+Xiong%2C+Yizhi+Li%2C+Mong+Yuan+Sim%2C+Xiuying+Chen%2C+Qingqing+Zhu%2C+Zhenzhu+Yang%2C+Adam+Nik%2C+Qi+Liu%2C+Chenghua+Lin%2C+Shi+Wan)
115. Gerhard Weiß. 1995. Adaptation and learning in multi-agent systems: Some remarks and a bibliography. In Adaption and Learning in Multi-Agent Systems, volume 1042 of Lecture Notes in Computer Science, pages 1–21. Springer. [find](https://scholar.google.com/scholar?q=Gerhard+Wei%C3%9F%2E+1995%2E+Adaptation+and+learning+in+multi%2Dagent+systems%3A+Some+remarks+and+a+bibliography%2E+In+Adaption+and+Learning+in+Multi%2DAgent+Systems%2C+volume+1042+of+Lecture+Notes+in+Computer+Science%2C+)
116. Michael J. Wooldridge. 2009. An Introduction to MultiAgent Systems, Second Edition. Wiley. [find](https://scholar.google.com/scholar?q=Michael+J%2E+Wooldridge%2E+2009%2E+An+Introduction+to+MultiAgent+Systems%2C+Second+Edition%2E+Wiley%2E)
117. Anita Williams Woolley, Christopher F. Chabris, Alex Pentland, Nada Hashmi, and Thomas W. Malone. 2010. Evidence for a collective intelligence factor in the performance of human groups. Science, 330(6004):686–688. [find](https://scholar.google.com/scholar?q=Anita+Williams+Woolley%2C+Christopher+F%2E+Chabris%2C+Alex+Pentland%2C+Nada+Hashmi%2C+and+Thomas+W%2E+Malone%2E+2010%2E+Evidence+for+a+collective+intelligence+factor+in+the+performance+of+human+groups%2E+Science%2C+330%286)
118. Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, Rui Zheng, Xiaoran Fan, Xiao Wang, Limao Xiong, Yuhao Zhou, Weiran Wang, Changhao Jiang, Yicheng Zou, Xiangyang Liu, Zhangyue Yin, Shihan Dou, Rongxiang Weng, Wensen Cheng, Qi Zhang,… [find](https://scholar.google.com/scholar?q=Zhiheng+Xi%2C+Wenxiang+Chen%2C+Xin+Guo%2C+Wei+He%2C+Yiwen+Ding%2C+Boyang+Hong%2C+Ming+Zhang%2C+Junzhe+Wang%2C+Senjie+Jin%2C+Enyu+Zhou%2C+Rui+Zheng%2C+Xiaoran+Fan%2C+Xiao+Wang%2C+Limao+Xiong%2C+Yuhao+Zhou%2C+Weiran+Wang%2C+Changhao+J)
119. Chengxing Xie, Canyu Chen, Feiran Jia, Ziyu Ye, Kai Shu, Adel Bibi, Ziniu Hu, Philip H. S. Torr, Bernard Ghanem, and Guohao Li. 2024. Can large language model agents simulate human trust behaviors? CoRR, abs/2402.04559. — [arXiv:2402.04559](https://arxiv.org/abs/2402.04559) [find](https://scholar.google.com/scholar?q=Chengxing+Xie%2C+Canyu+Chen%2C+Feiran+Jia%2C+Ziyu+Ye%2C+Kai+Shu%2C+Adel+Bibi%2C+Ziniu+Hu%2C+Philip+H%2E+S%2E+Torr%2C+Bernard+Ghanem%2C+and+Guohao+Li%2E+2024%2E+Can+large+language+model+agents+simulate+human+trust+behaviors%3F+Co)
120. Tianbao Xie, Fan Zhou, Zhoujun Cheng, Peng Shi, Luoxuan Weng, Yitao Liu, Toh Jing Hua, Junning Zhao, Qian Liu, Che Liu, Leo Z. Liu, Yiheng Xu, Hongjin Su, Dongchan Shin, Caiming Xiong, and Tao Yu. 2023. Openagents: An open platform for language agents in the wild. CoRR, abs/2310.10634. [find](https://scholar.google.com/scholar?q=Tianbao+Xie%2C+Fan+Zhou%2C+Zhoujun+Cheng%2C+Peng+Shi%2C+Luoxuan+Weng%2C+Yitao+Liu%2C+Toh+Jing+Hua%2C+Junning+Zhao%2C+Qian+Liu%2C+Che+Liu%2C+Leo+Z%2E+Liu%2C+Yiheng+Xu%2C+Hongjin+Su%2C+Dongchan+Shin%2C+Caiming+Xiong%2C+and+Tao+Yu%2E+202)
121. Lin Xu, Zhiyuan Hu, Daquan Zhou, Hongyu Ren, Zhen Dong, Kurt Keutzer, See-Kiong Ng, and Jiashi Feng. 2023. Magic: Investigation of large language model powered multi-agent in cognition, adaptability, rationality and collaboration. CoRR, abs/2311.08562. [find](https://scholar.google.com/scholar?q=Lin+Xu%2C+Zhiyuan+Hu%2C+Daquan+Zhou%2C+Hongyu+Ren%2C+Zhen+Dong%2C+Kurt+Keutzer%2C+See%2DKiong+Ng%2C+and+Jiashi+Feng%2E+2023%2E+Magic%3A+Investigation+of+large+language+model+powered+multi%2Dagent+in+cognition%2C+adaptability%2C+)
122. Ruoxi Xu, Yingfei Sun, Mengjie Ren, Shiguang Guo, Ruotong Pan, Hongyu Lin, Le Sun, and Xianpei Han. 2024. Ai for social science and social science of ai: A survey. Information Processing & Management, 61(3):103665. [find](https://scholar.google.com/scholar?q=Ruoxi+Xu%2C+Yingfei+Sun%2C+Mengjie+Ren%2C+Shiguang+Guo%2C+Ruotong+Pan%2C+Hongyu+Lin%2C+Le+Sun%2C+and+Xianpei+Han%2E+2024%2E+Ai+for+social+science+and+social+science+of+ai%3A+A+survey%2E+Information+Processing+%26+Management%2C)
123. Shukang Yin, Chaoyou Fu, Sirui Zhao, Ke Li, Xing Sun, Tong Xu, and Enhong Chen. 2023. A survey on multimodal large language models. arXiv preprint, abs/2306.13549. [our card](https://md.research.elamur.ai/free/en/papers/yin-2023-survey-multimodal-large-language-models/)
124. Ceyao Zhang, Kaijie Yang, Siyi Hu, Zihao Wang, Guanghe Li, Yihang Sun, Cheng Zhang, Zhaowei Zhang, Anji Liu, Song-Chun Zhu, Xiaojun Chang, Junge Zhang, Feng Yin, Yitao Liang, and Yaodong Yang. 2024. Proagent: Building proactive cooperative agents with large language models. In AAAI, pages 17591–1759… [find](https://scholar.google.com/scholar?q=Ceyao+Zhang%2C+Kaijie+Yang%2C+Siyi+Hu%2C+Zihao+Wang%2C+Guanghe+Li%2C+Yihang+Sun%2C+Cheng+Zhang%2C+Zhaowei+Zhang%2C+Anji+Liu%2C+Song%2DChun+Zhu%2C+Xiaojun+Chang%2C+Junge+Zhang%2C+Feng+Yin%2C+Yitao+Liang%2C+and+Yaodong+Yang%2E+2024%2E+P)
125. Xijia Zhang, Yue Guo, Simon Stepputtis, Katia P. Sycara, and Joseph Campbell. 2023a. Explaining agent behavior with large language models. CoRR, abs/2309.10346. — [arXiv:2309.10346](https://arxiv.org/abs/2309.10346) [find](https://scholar.google.com/scholar?q=Xijia+Zhang%2C+Yue+Guo%2C+Simon+Stepputtis%2C+Katia+P%2E+Sycara%2C+and+Joseph+Campbell%2E+2023a%2E+Explaining+agent+behavior+with+large+language+models%2E+CoRR%2C+abs%2F2309%2E10346%2E+%E2%80%94+%5BarXiv%3A2309%2E10346%5D%28https%3A%2F%2Farxiv%2Eorg%2F)
126. Xijia Zhang, Yue Guo, Simon Stepputtis, Katia P. Sycara, and Joseph Campbell. 2023b. Understanding your agent: Leveraging large language models for behavior explanation. CoRR, abs/2311.18062. — [arXiv:2311.18062](https://arxiv.org/abs/2311.18062) [find](https://scholar.google.com/scholar?q=Xijia+Zhang%2C+Yue+Guo%2C+Simon+Stepputtis%2C+Katia+P%2E+Sycara%2C+and+Joseph+Campbell%2E+2023b%2E+Understanding+your+agent%3A+Leveraging+large+language+models+for+behavior+explanation%2E+CoRR%2C+abs%2F2311%2E18062%2E+%E2%80%94+%5BarXiv)
127. Yue Zhang, Yafu Li, Leyang Cui, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, Longyue Wang, Anh Tuan Luu, Wei Bi, Freda Shi, and Shuming Shi. 2023c. Siren’s song in the AI ocean: A survey on hallucination in large language models. CoRR, abs/2309.01219. [our card](https://md.research.elamur.ai/free/en/papers/zhang-2023-siren-s-song-ai-ocean/)
128. Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, Yifan Du, Chen Yang, Yushuo Chen, Zhipeng Chen, Jinhao Jiang, Ruiyang Ren, Yifan Li, Xinyu Tang, Zikang Liu, Peiyu Liu, Jian-Yun Nie, and Ji-Rong Wen. 2023. A survey of l… [our card](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/)
129. Wangchunshu Zhou, Yuchen Eleanor Jiang, Long Li, Jialong Wu, Tiannan Wang, Shi Qiu, Jintian Zhang, Jing Chen, Ruipu Wu, Shuai Wang, Shiding Zhu, Jiyu Chen, Wentao Zhang, Ningyu Zhang, Huajun Chen, Peng Cui, and Mrinmaya Sachan. 2023. Agents: An open-source framework for autonomous language agents. C… [find](https://scholar.google.com/scholar?q=Wangchunshu+Zhou%2C+Yuchen+Eleanor+Jiang%2C+Long+Li%2C+Jialong+Wu%2C+Tiannan+Wang%2C+Shi+Qiu%2C+Jintian+Zhang%2C+Jing+Chen%2C+Ruipu+Wu%2C+Shuai+Wang%2C+Shiding+Zhu%2C+Jiyu+Chen%2C+Wentao+Zhang%2C+Ningyu+Zhang%2C+Huajun+Chen%2C+Pen)
130. Yuqi Zhu, Xiaohan Wang, Jing Chen, Shuofei Qiao, Yixin Ou, Yunzhi Yao, Shumin Deng, Huajun Chen, and Ningyu Zhang. 2023. Llms for knowledge graph construction and reasoning: Recent capabilities and future opportunities. CoRR, abs/2305.13168. [find](https://scholar.google.com/scholar?q=Yuqi+Zhu%2C+Xiaohan+Wang%2C+Jing+Chen%2C+Shuofei+Qiao%2C+Yixin+Ou%2C+Yunzhi+Yao%2C+Shumin+Deng%2C+Huajun+Chen%2C+and+Ningyu+Zhang%2E+2023%2E+Llms+for+knowledge+graph+construction+and+reasoning%3A+Recent+capabilities+and+fu)
131. Mingchen Zhuge, Haozhe Liu, Francesco Faccio, Dylan R. Ashley, Róbert Csordás, Anand Gopalakrishnan, Abdullah Hamdi, Hasan Abed Al Kader Hammoud, Vincent Herrmann, Kazuki Irie, Louis Kirsch, Bing Li, Guohao Li, Shuming Liu, Jinjie Mai, Piotr Piekos, Aditya Ramesh, Imanol Schlag, Weimin Shi, Aleksand… — [arXiv:2305.17066](https://arxiv.org/abs/2305.17066) [find](https://scholar.google.com/scholar?q=Mingchen+Zhuge%2C+Haozhe+Liu%2C+Francesco+Faccio%2C+Dylan+R%2E+Ashley%2C+R%C3%B3bert+Csord%C3%A1s%2C+Anand+Gopalakrishnan%2C+Abdullah+Hamdi%2C+Hasan+Abed+Al+Kader+Hammoud%2C+Vincent+Herrmann%2C+Kazuki+Irie%2C+Louis+Kirsch%2C+Bing+Li%2C+)
132. Overview of Appendices • Setting agent numbers to 3 is generally advantageous in performance and cost, as seen from Figure 15, 25, 34, 43, 57. We summarize the overview of Appendices below: §A: Key Takeaways. §B: Related Work. §C: Potential Real-World Applications. §D: Implementation Details. Experi… [find](https://scholar.google.com/scholar?q=Overview+of+Appendices+%E2%80%A2+Setting+agent+numbers+to+3+is+generally+advantageous+in+performance+and+cost%2C+as+seen+from+Figure+15%2C+25%2C+34%2C+43%2C+57%2E+We+summarize+the+overview+of+Appendices+below%3A+%C2%A7A%3A+Key+Ta)

*Updated 24 October 2026*