---
title: "How FaR Are Large Language Models From Agents with"
description: "The authors introduce Thinking for Doing (T4D), which recasts ToMi false-belief stories as observations. 41 references, cited by 34 papers here."
authors: ["Pei Zhou", "Aman Madaan", "Srividya Pranavi Potharaju", "Aditya Gupta", "Kevin R. McKee", "Ari Holtzman", "Jay Pujara", "Xiang Ren", "Swaroop Mishra", "Aida Nematzadeh", "Shyam Upadhyay", "Manaal Faruqui"]
year: 2023
venue: "arXiv:2310.03051"
source: "https://arxiv.org/abs/2310.03051"
doi: "10.48550/arxiv.2310.03051"
arxiv: "2310.03051"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhou-2023-far-large-language-models-agents/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhou-2023-far-large-language-models-agents/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/page/11/) / How FaR Are Large Language Models From Agents with Theory-of-Mind?

# How FaR Are Large Language Models From Agents with Theory-of-Mind?

**Authors:** [Pei Zhou](https://md.research.elamur.ai/free/en/authors/pei-zhou/), [Aman Madaan](https://md.research.elamur.ai/free/en/authors/aman-madaan/), Srividya Pranavi Potharaju, [Aditya Gupta](https://md.research.elamur.ai/free/en/authors/aditya-gupta/), Kevin R. McKee, [Ari Holtzman](https://md.research.elamur.ai/free/en/authors/ari-holtzman/), [Jay Pujara](https://md.research.elamur.ai/free/en/authors/jay-pujara/), [Xiang Ren](https://md.research.elamur.ai/free/en/authors/xiang-ren/), [Swaroop Mishra](https://md.research.elamur.ai/free/en/authors/swaroop-mishra/), [Aida Nematzadeh](https://md.research.elamur.ai/free/en/authors/aida-nematzadeh/), [Shyam Upadhyay](https://md.research.elamur.ai/free/en/authors/shyam-upadhyay/) and [Manaal Faruqui](https://md.research.elamur.ai/free/en/authors/manaal-faruqui/) · **Year:** 2023 · **Venue:** arXiv:2310.03051 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2310.03051) · [PDF](https://arxiv.org/pdf/2310.03051) · [DOI 10.48550/arxiv.2310.03051](https://doi.org/10.48550/arxiv.2310.03051) · [arXiv 2310.03051](https://arxiv.org/abs/2310.03051) · [OpenAlex](https://openalex.org/W4387427450)

**Citations:** 6 citations (OpenAlex, 2026-10-14) · [34](https://md.research.elamur.ai/free/en/papers/zhou-2023-far-large-language-models-agents/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Theory-of-Mind (ToM) benchmarks for large language models, such as ToMi, usually ask directly about a character's beliefs. They leave open whether models can turn those inferences into useful behavior. The authors introduce Thinking for Doing (T4D), which recasts ToMi false-belief stories as observations. The model acts as a helpful agent and must decide which character should be given information. GPT-4 and PaLM 2 track beliefs well when asked explicitly, but they do poorly on T4D. The best zero-shot accuracy is about 50%, while human agreement exceeds 95%. Experiments with oracle reasoning hints show that the main obstacle is finding, unprompted, which mental-state inference is relevant. With hints, models come close to human level. The authors therefore propose Foresee and Reflect (FaR), a zero-shot prompt structure. It has the model predict each character's likely future actions and obstacles, then judge whether sharing information now would help. FaR raises GPT-4 to 71% and transfers to out-of-distribution tasks. This suggests that structured, future-oriented reasoning matters for socially capable LLM agents.

## Key points
- **T4D task:** Built by converting ToMi (Sally-Anne-style) stories into a multiple-choice question about whom to help. Zero-shot GPT-4 reaches only ~50%, against >95% human agreement.
- **Error analysis:** Human rationales reveal three reasoning patterns: question decomposition, ToM inferences, and commonsense assumptions. Supplying these as oracle hints brings models near human performance.
- **FaR results:** FaR lifts GPT-4 from 50% to 71% on T4D. It beats Chain-of-Thought, zero-shot Tree-of-Thought, and Self-Ask, which give no significant gains.
- **Ablations:** Both the Foresee and Reflect components are required. Performance is sensitive to noisy future predictions.
- **Generalization:** FaR improves consistently on three story-structure variants from Sclar et al. (2023) and on Faux-Pas stories from Shapira et al. (2023b). It even outperforms few-shot in-context learning.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Carnegie Mellon University](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) — University, Pittsburgh, United States · 598 works · 191,226 citations
- [University of Southern California](https://md.research.elamur.ai/free/en/universities/university-of-southern-california/) — University, Los Angeles, United States · 175 works · 37,050 citations
- [University of Chicago](https://md.research.elamur.ai/free/en/universities/university-of-chicago/) — University, Chicago, United States · 52 works · 50,893 citations

📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 3,486 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,649 works · [💭 Developmental and Educational Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/developmental-and-educational-psychology/) · 523 works

## Cite

Cite as: Pei Zhou, Aman Madaan, Srividya Pranavi Potharaju, Aditya Gupta, Kevin R. McKee, Ari Holtzman, Jay Pujara, Xiang Ren, Swaroop Mishra, Aida Nematzadeh, Shyam Upadhyay and Manaal Faruqui. 2023. How FaR Are Large Language Models From Agents with Theory-of-Mind?. arXiv:2310.03051.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{zhou2023how,
  title = {{How FaR Are Large Language Models From Agents with Theory-of-Mind?}},
  author = {Pei Zhou, Aman Madaan, Srividya Pranavi Potharaju, Aditya Gupta, Kevin R. McKee, Ari Holtzman, Jay Pujara, Xiang Ren, Swaroop Mishra, Aida Nematzadeh, Shyam Upadhyay and Manaal Faruqui},
  year = {2023},
  doi = {10.48550/arxiv.2310.03051},
  eprint = {2310.03051},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2310.03051}
}
```

- [← previous Automatic Evaluation and Analysis of Idioms in Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/baziotis-2023-automatic-evaluation-analysis-idioms-neural/)
- [next → Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysis](https://md.research.elamur.ai/free/en/papers/giulianelli-2023-definition-generation-senses/)
- [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/page/11/)

## References

41 references, 14 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Jacob Andreas. [Language models as agent models](https://md.research.elamur.ai/free/en/papers/andreas-2022-language-models-as-agent-models/). In Findings of the Association for Computational Linguistics: EMNLP 2022, pp. 5769–5779, Abu Dhabi, United Arab Emirates, December 2022. Association for Computational Linguistics. URL https://aclanthology.org/2022.findings-emnlp. 423 . [↗](https://aclanthology.org/2022.findings-emnlp)
2. Rohan Anil, Andrew M Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, et al. [Palm 2 technical report](https://md.research.elamur.ai/free/en/papers/anil-2023-palm-2-technical-report/). arXiv preprint arXiv:2305.10403, 2023.
3. Cristian-Paul Bara, CH-Wang Sky, and Joyce Chai. Mindcraft: Theory of mind modeling for situated dialogue in collaborative tasks. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 1112–1125, 2021. [find](https://scholar.google.com/scholar?q=Cristian%2DPaul+Bara%2C+CH%2DWang+Sky%2C+and+Joyce+Chai%2E+Mindcraft%3A+Theory+of+mind+modeling+for+situated+dialogue+in+collaborative+tasks%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Methods+in+Natural+)
4. Simon Baron-Cohen, Alan M Leslie, and Uta Frith. Does the autistic child have a “theory of mind”? Cognition, 21(1):37–46, 1985. [find](https://scholar.google.com/scholar?q=Simon+Baron%2DCohen%2C+Alan+M+Leslie%2C+and+Uta+Frith%2E+Does+the+autistic+child+have+a+%E2%80%9Ctheory+of+mind%E2%80%9D%3F+Cognition%2C+21%281%29%3A37%E2%80%9346%2C+1985%2E)
5. Simon Baron-Cohen, Michelle O’riordan, Valerie Stone, Rosie Jones, and Kate Plaisted. Recognition of faux pas by normally developing children and children with asperger syndrome or high-functioning autism. Journal of autism and developmental disorders, 29:407–418, 1999. [find](https://scholar.google.com/scholar?q=Simon+Baron%2DCohen%2C+Michelle+O%E2%80%99riordan%2C+Valerie+Stone%2C+Rosie+Jones%2C+and+Kate+Plaisted%2E+Recognition+of+faux+pas+by+normally+developing+children+and+children+with+asperger+syndrome+or+high%2Dfunctioning+au)
6. Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Michal Podstawski, Hubert Niewiadomski, Piotr Nyczyk, et al. Graph of thoughts: Solving elaborate problems with large language models. arXiv preprint arXiv:2308.09687, 2023. [find](https://scholar.google.com/scholar?q=Maciej+Besta%2C+Nils+Blach%2C+Ales+Kubicek%2C+Robert+Gerstenberger%2C+Lukas+Gianinazzi%2C+Joanna+Gajda%2C+Tomasz+Lehmann%2C+Michal+Podstawski%2C+Hubert+Niewiadomski%2C+Piotr+Nyczyk%2C+et+al%2E+Graph+of+thoughts%3A+Solving+el)
7. Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. [Language models are few-shot learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/). arXiv preprint arXiv:2005.14165, 2020.
8. Susan T Fiske. Thinking is for doing: portraits of social cognition from daguerreotype to laserphoto. Journal of personality and social psychology, 63(6):877, 1992. [find](https://scholar.google.com/scholar?q=Susan+T+Fiske%2E+Thinking+is+for+doing%3A+portraits+of+social+cognition+from+daguerreotype+to+laserphoto%2E+Journal+of+personality+and+social+psychology%2C+63%286%29%3A877%2C+1992%2E)
9. Uta Frith and Christopher D Frith. Development and neurophysiology of mentalizing. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 358(1431):459–473, 2003. [find](https://scholar.google.com/scholar?q=Uta+Frith+and+Christopher+D+Frith%2E+Development+and+neurophysiology+of+mentalizing%2E+Philosophical+Transactions+of+the+Royal+Society+of+London%2E+Series+B%3A+Biological+Sciences%2C+358%281431%29%3A459%E2%80%93473%2C+2003%2E)
10. Izzeddin Gur, Hiroki Furuta, Austin Huang, Mustafa Safdari, Yutaka Matsuo, Douglas Eck, and Aleksandra Faust. [A real-world webagent with planning, long context understanding, and program synthesis](https://md.research.elamur.ai/free/en/papers/gur-2023-real-world-webagent-planning-long/). arXiv preprint arXiv:2307.12856, 2023.
11. Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, and Zhiting Hu. Reasoning with language model is planning with world model. arXiv preprint arXiv:2305.14992, 2023. [find](https://scholar.google.com/scholar?q=Shibo+Hao%2C+Yi+Gu%2C+Haodi+Ma%2C+Joshua+Jiahua+Hong%2C+Zhen+Wang%2C+Daisy+Zhe+Wang%2C+and+Zhiting+Hu%2E+Reasoning+with+language+model+is+planning+with+world+model%2E+arXiv+preprint+arXiv%3A2305%2E14992%2C+2023%2E)
12. Peter E Hart, Nils J Nilsson, and Bertram Raphael. A formal basis for the heuristic determination of minimum cost paths. IEEE transactions on Systems Science and Cybernetics, 4(2):100–107, 1968. [find](https://scholar.google.com/scholar?q=Peter+E+Hart%2C+Nils+J+Nilsson%2C+and+Bertram+Raphael%2E+A+formal+basis+for+the+heuristic+determination+of+minimum+cost+paths%2E+IEEE+transactions+on+Systems+Science+and+Cybernetics%2C+4%282%29%3A100%E2%80%93107%2C+1968%2E)
13. Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. [Large language models are zero-shot reasoners](https://md.research.elamur.ai/free/en/papers/kojima-2022-large-language-models-zero-shot/). Advances in neural information processing systems, 35: 22199–22213, 2022.
14. Michal Kosinski. Theory of mind may have spontaneously emerged in large language models. arXiv preprint arXiv:2302.[02083, 2023](https://md.research.elamur.ai/free/en/papers/kosinski-2023-evaluating-large-language-models-theory/).
15. Matthew Le, Y-Lan Boureau, and Maximilian Nickel. Revisiting the evaluation of theory of mind through question answering. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)… [find](https://scholar.google.com/scholar?q=Matthew+Le%2C+Y%2DLan+Boureau%2C+and+Maximilian+Nickel%2E+Revisiting+the+evaluation+of+theory+of+mind+through+question+answering%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language)
16. Kyle Mahowald, Anna A Ivanova, Idan A Blank, Nancy Kanwisher, Joshua B Tenenbaum, and Evelina Fedorenko. Dissociating language and thought in large language models: a cognitive perspective. arXiv preprint arXiv:2301.06627, 2023. [find](https://scholar.google.com/scholar?q=Kyle+Mahowald%2C+Anna+A+Ivanova%2C+Idan+A+Blank%2C+Nancy+Kanwisher%2C+Joshua+B+Tenenbaum%2C+and+Evelina+Fedorenko%2E+Dissociating+language+and+thought+in+large+language+models%3A+a+cognitive+perspective%2E+arXiv+prep)
17. Swaroop Mishra, Daniel Khashabi, Chitta Baral, Yejin Choi, and Hannaneh Hajishirzi. Reframing Instructional Prompts to GPTk’s Language. arXiv preprint arXiv:2109.[07830, 2021](https://md.research.elamur.ai/free/en/papers/mishra-2022-reframing-instructional-prompts-gptk-s/).
18. Aida Nematzadeh, Kaylee Burns, Erin Grant, Alison Gopnik, and Tom Griffiths. Evaluating theory of mind in question answering. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pp. 2392–2400, 2018. [find](https://scholar.google.com/scholar?q=Aida+Nematzadeh%2C+Kaylee+Burns%2C+Erin+Grant%2C+Alison+Gopnik%2C+and+Tom+Griffiths%2E+Evaluating+theory+of+mind+in+question+answering%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+in+Natural+Lang)
19. OpenAI. Chatgpt: Optimizing language models for dialogue, 2022. URL [https://openai.com/blog/](https://openai.com/blog/) chatgpt/ . [↗](https://openai.com/blog/)
20. R OpenAI. [Gpt-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). arXiv, pp. 2303–08774, 2023.
21. Joon Sung Park, Joseph C O’Brien, Carrie J Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interactive simulacra of human behavior. arXiv preprint arXiv:2304.03442, 2023. [find](https://scholar.google.com/scholar?q=Joon+Sung+Park%2C+Joseph+C+O%E2%80%99Brien%2C+Carrie+J+Cai%2C+Meredith+Ringel+Morris%2C+Percy+Liang%2C+and+Michael+S+Bernstein%2E+Generative+agents%3A+Interactive+simulacra+of+human+behavior%2E+arXiv+preprint+arXiv%3A2304%2E0344)
22. Josef Perner, Susan R Leekam, and Heinz Wimmer. Three-year-olds’ difficulty with false belief: The case for a conceptual deficit. British journal of developmental psychology, 5(2):125–137, 1987. [find](https://scholar.google.com/scholar?q=Josef+Perner%2C+Susan+R+Leekam%2C+and+Heinz+Wimmer%2E+Three%2Dyear%2Dolds%E2%80%99+difficulty+with+false+belief%3A+The+case+for+a+conceptual+deficit%2E+British+journal+of+developmental+psychology%2C+5%282%29%3A125%E2%80%93137%2C+1987%2E)
23. David Premack and Guy Woodruff. Does the chimpanzee have a theory of mind? Behavioral and brain sciences, 1(4):515–526, 1978. [find](https://scholar.google.com/scholar?q=David+Premack+and+Guy+Woodruff%2E+Does+the+chimpanzee+have+a+theory+of+mind%3F+Behavioral+and+brain+sciences%2C+1%284%29%3A515%E2%80%93526%2C+1978%2E)
24. Ofir Press, Muru Zhang, Sewon Min, Ludwig Schmidt, Noah A Smith, and Mike Lewis. Measuring and narrowing the compositionality gap in language models. arXiv preprint arXiv:2210.03350, 2022. [find](https://scholar.google.com/scholar?q=Ofir+Press%2C+Muru+Zhang%2C+Sewon+Min%2C+Ludwig+Schmidt%2C+Noah+A+Smith%2C+and+Mike+Lewis%2E+Measuring+and+narrowing+the+compositionality+gap+in+language+models%2E+arXiv+preprint+arXiv%3A2210%2E03350%2C+2022%2E)
25. Maarten Sap, Hannah Rashkin, Derek Chen, Ronan Le Bras, and Yejin Choi. Social IQa: Commonsense reasoning about social interactions. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EM… [find](https://scholar.google.com/scholar?q=Maarten+Sap%2C+Hannah+Rashkin%2C+Derek+Chen%2C+Ronan+Le+Bras%2C+and+Yejin+Choi%2E+Social+IQa%3A+Commonsense+reasoning+about+social+interactions%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natur)
26. Maarten Sap, Ronan Le Bras, Daniel Fried, and Yejin Choi. Neural theory-of-mind? on the limits of social intelligence in large LMs. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pp. 3762–3780, Abu Dhabi, United Arab Emirates, December 2022. Association fo… [find](https://scholar.google.com/scholar?q=Maarten+Sap%2C+Ronan+Le+Bras%2C+Daniel+Fried%2C+and+Yejin+Choi%2E+Neural+theory%2Dof%2Dmind%3F+on+the+limits+of+social+intelligence+in+large+LMs%2E+In+Proceedings+of+the+2022+Conference+on+Empirical+Methods+in+Natura)
27. Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom. [Toolformer: Language models can teach themselves to use tools](https://md.research.elamur.ai/free/en/papers/schick-2023-toolformer-language-models-can-teach/). arXiv preprint arXiv:2302.04761, 2023.
28. Melanie Sclar, Sachin Kumar, Peter West, Alane Suhr, Yejin Choi, and Yulia Tsvetkov. Minding language models’(lack of) theory of mind: A plug-and-play multi-character belief tracker. arXiv preprint arXiv:2306.[00924, 2023](https://md.research.elamur.ai/free/en/papers/sclar-2023-minding-language-models-lack-theory/).
29. Natalie Shapira, Mosh Levy, Seyed Hossein Alavi, Xuhui Zhou, Yejin Choi, Yoav Goldberg, Maarten Sap, and Vered Shwartz. Clever hans or neural theory of mind? stress testing social reasoning in large language models. arXiv preprint arXiv:2305.14763, 2023a. [find](https://scholar.google.com/scholar?q=Natalie+Shapira%2C+Mosh+Levy%2C+Seyed+Hossein+Alavi%2C+Xuhui+Zhou%2C+Yejin+Choi%2C+Yoav+Goldberg%2C+Maarten+Sap%2C+and+Vered+Shwartz%2E+Clever+hans+or+neural+theory+of+mind%3F+stress+testing+social+reasoning+in+large+l)
30. Natalie Shapira, Guy Zwirn, and Yoav Goldberg. How well do large language models perform on faux pas tests? In Findings of the Association for Computational Linguistics: ACL 2023, pp. 10438–10451, Toronto, Canada, July 2023b. Association for Computational Linguistics. doi: 10.18653/v1/2023.findings-… [find](https://scholar.google.com/scholar?q=Natalie+Shapira%2C+Guy+Zwirn%2C+and+Yoav+Goldberg%2E+How+well+do+large+language+models+perform+on+faux+pas+tests%3F+In+Findings+of+the+Association+for+Computational+Linguistics%3A+ACL+2023%2C+pp%2E+10438%E2%80%9310451%2C+Tor)
31. Ori Shapira, Ramakanth Pasunuru, Mohit Bansal, Ido Dagan, and Yael Amsterdamer. Interactive query-assisted summarization via deep reinforcement learning. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… [find](https://scholar.google.com/scholar?q=Ori+Shapira%2C+Ramakanth+Pasunuru%2C+Mohit+Bansal%2C+Ido+Dagan%2C+and+Yael+Amsterdamer%2E+Interactive+query%2Dassisted+summarization+via+deep+reinforcement+learning%2E+In+Proceedings+of+the+2022+Conference+of+the+N)
32. Alan Strathman, Faith Gleicher, David S Boninger, and C Scott Edwards. The consideration of future consequences: Weighing immediate and distant outcomes of behavior. Journal of personality and social psychology, 66(4):742, 1994. [find](https://scholar.google.com/scholar?q=Alan+Strathman%2C+Faith+Gleicher%2C+David+S+Boninger%2C+and+C+Scott+Edwards%2E+The+consideration+of+future+consequences%3A+Weighing+immediate+and+distant+outcomes+of+behavior%2E+Journal+of+personality+and+social+)
33. Sean Trott, Cameron Jones, Tyler Chang, James Michaelov, and Benjamin Bergen. Do large language models know what humans know? Cognitive Science, 47(7):e13309, 2023. [find](https://scholar.google.com/scholar?q=Sean+Trott%2C+Cameron+Jones%2C+Tyler+Chang%2C+James+Michaelov%2C+and+Benjamin+Bergen%2E+Do+large+language+models+know+what+humans+know%3F+Cognitive+Science%2C+47%287%29%3Ae13309%2C+2023%2E)
34. Tomer Ullman. Large language models fail on trivial alterations to theory-of-mind tasks. arXiv preprint arXiv:2302.08399, 2023. [find](https://scholar.google.com/scholar?q=Tomer+Ullman%2E+Large+language+models+fail+on+trivial+alterations+to+theory%2Dof%2Dmind+tasks%2E+arXiv+preprint+arXiv%3A2302%2E08399%2C+2023%2E)
35. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). Advances in Neural Information Processing Systems, 35:24824–24837, 2022.
36. Heinz Wimmer and Josef Perner. Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children’s understanding of deception. Cognition, 13(1):103–128, 1983. [find](https://scholar.google.com/scholar?q=Heinz+Wimmer+and+Josef+Perner%2E+Beliefs+about+beliefs%3A+Representation+and+constraining+function+of+wrong+beliefs+in+young+children%E2%80%99s+understanding+of+deception%2E+Cognition%2C+13%281%29%3A103%E2%80%93128%2C+1983%2E)
37. Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L Griffiths, Yuan Cao, and Karthik Narasimhan. Tree of thoughts: Deliberate problem solving with large language models. arXiv preprint arXiv:2305.10601, 2023a. [find](https://scholar.google.com/scholar?q=Shunyu+Yao%2C+Dian+Yu%2C+Jeffrey+Zhao%2C+Izhak+Shafran%2C+Thomas+L+Griffiths%2C+Yuan+Cao%2C+and+Karthik+Narasimhan%2E+Tree+of+thoughts%3A+Deliberate+problem+solving+with+large+language+models%2E+arXiv+preprint+arXiv%3A23)
38. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. [ReAct: Synergizing reasoning and acting in language models](https://md.research.elamur.ai/free/en/papers/yao-2022-react-synergizing-reasoning-acting-language/). In International Conference on Learning Representations (ICLR), 2023b.
39. Yao Yao, Zuchao Li, and Hai Zhao. Beyond chain-of-thought, effective graph-of-thought reasoning in large language models. arXiv preprint arXiv:2305.[16582, 2023c](https://md.research.elamur.ai/free/en/papers/yao-2023-chain-thought-effective-graph-thought/).
40. Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Olivier Bousquet, Quoc Le, and Ed Chi. [Least-to-Most Prompting Enables Complex Reasoning in Large Language Models](https://md.research.elamur.ai/free/en/papers/al-2022-least-most-prompting-enables-complex/). arXiv preprint arXiv:2205.10625, 2022.
41. Pei Zhou, Andrew Zhu, Jennifer Hu, Jay Pujara, Xiang Ren, Chris Callison-Burch, Yejin Choi, and Prithviraj Ammanabrolu. I cast detect thoughts: Learning to converse and guide with intents and theory-of-mind in dungeons and dragons. In Proceedings of the 61st Annual Meeting of the Association for Com… [find](https://scholar.google.com/scholar?q=Pei+Zhou%2C+Andrew+Zhu%2C+Jennifer+Hu%2C+Jay+Pujara%2C+Xiang+Ren%2C+Chris+Callison%2DBurch%2C+Yejin+Choi%2C+and+Prithviraj+Ammanabrolu%2E+I+cast+detect+thoughts%3A+Learning+to+converse+and+guide+with+intents+and+theory%2Do)

*Updated 2 November 2026*