---
title: "Large Language Models as Analogical Reasoners (2023)"
description: "Chain-of-thought prompting helps LLMs solve multi-step problems, but both common forms have… 92 references, cited by 62 papers here."
authors: ["Michihiro Yasunaga", "Xinyun Chen", "Yujia Li", "Panupong Pasupat", "Jure Leskovec", "Percy Liang", "Ed H. Chi", "Denny Zhou"]
year: 2023
venue: "arXiv:2310.01714"
source: "https://arxiv.org/abs/2310.01714"
doi: "10.48550/arxiv.2310.01714"
arxiv: "2310.01714"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/yasunaga-2023-large-language-models-analogical-reasoners/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/yasunaga-2023-large-language-models-analogical-reasoners/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/page/9/) / Large Language Models as Analogical Reasoners

# Large Language Models as Analogical Reasoners

**Authors:** [Michihiro Yasunaga](https://md.research.elamur.ai/free/en/authors/michihiro-yasunaga/), [Xinyun Chen](https://md.research.elamur.ai/free/en/authors/xinyun-chen/), [Yujia Li](https://md.research.elamur.ai/free/en/authors/yujia-li/), [Panupong Pasupat](https://md.research.elamur.ai/free/en/authors/panupong-pasupat/), [Jure Leskovec](https://md.research.elamur.ai/free/en/authors/jure-leskovec/), [Percy Liang](https://md.research.elamur.ai/free/en/authors/percy-liang/), [Ed H. Chi](https://md.research.elamur.ai/free/en/authors/ed-h-chi/) and [Denny Zhou](https://md.research.elamur.ai/free/en/authors/denny-zhou/) · **Year:** 2023 · **Venue:** arXiv:2310.01714 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2310.01714) · [PDF](https://arxiv.org/pdf/2310.01714) · [DOI 10.48550/arxiv.2310.01714](https://doi.org/10.48550/arxiv.2310.01714) · [arXiv 2310.01714](https://arxiv.org/abs/2310.01714) · [OpenAlex](https://openalex.org/W4387355871)

**Citations:** 12 citations (OpenAlex, 2026-10-14) · [62](https://md.research.elamur.ai/free/en/papers/yasunaga-2023-large-language-models-analogical-reasoners/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Chain-of-thought prompting helps LLMs solve multi-step problems, but both common forms have drawbacks. The zero-shot variant gives only generic guidance, and the few-shot variant needs hand-written reasoning demonstrations for every task. Yasunaga et al. (Google DeepMind and Stanford) propose analogical prompting. It draws on the psychological observation that people approach a new problem by recalling similar ones they have solved before. In a single prompt, the model first invents several related but mutually different example problems with worked solutions, and only then answers the target question. A variant also asks the model to write a short tutorial on the relevant high-level concepts before the examples. The method needs no labeled data or retrieval pipeline, and the examples are tailored to each problem. It was tested on GSM8K, MATH, Codeforces and BIG-Bench reasoning tasks with GPT-3.5, GPT-4 and PaLM2. Across these, it outperforms both 0-shot CoT and few-shot CoT, with an average accuracy gain of about 4%. This makes it a cheap, task-agnostic way to strengthen reasoning when annotated demonstrations are unavailable.

## Key points
- The method comes in two forms: "self-generated exemplars" and "self-generated knowledge + exemplars". In the second, the model writes a tutorial-like overview before recalling examples, which the authors find especially helpful for code generation on Codeforces.
- Everything happens in one pass. The prompt asks for roughly three relevant and distinct problems with solutions, then the solution to the original problem. Markdown-style `#` headers help the model structure its output.
- Benchmarks are GSM8K and MATH (math), Codeforces (code generation) and BIG-Bench tasks such as formal fallacies. Base models are GPT-3.5, GPT-4 and PaLM2. The average gain over the 0-shot and few-shot CoT baselines is about +4%.
- Gains are most visible on benchmarks that mix many reasoning types. Examples are MATH, which covers algebra, probability and geometry, and Codeforces, which involves dynamic programming and graph algorithms.
- Compared with retrieval-based CoT, which fetches demonstrations from external data, self-generation works better with larger base LLMs. Retrieval keeps the advantage with smaller models.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Stanford University](https://md.research.elamur.ai/free/en/universities/stanford-university/) — University, Stanford, United States · 506 works · 330,053 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 3,486 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,894 works · [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,685 works

## Cite

Cite as: Michihiro Yasunaga, Xinyun Chen, Yujia Li, Panupong Pasupat, Jure Leskovec, Percy Liang, Ed H. Chi and Denny Zhou. 2023. Large Language Models as Analogical Reasoners. arXiv:2310.01714.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{yasunaga2023large,
  title = {{Large Language Models as Analogical Reasoners}},
  author = {Michihiro Yasunaga, Xinyun Chen, Yujia Li, Panupong Pasupat, Jure Leskovec, Percy Liang, Ed H. Chi and Denny Zhou},
  year = {2023},
  doi = {10.48550/arxiv.2310.01714},
  eprint = {2310.01714},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2310.01714}
}
```

- [← previous Instruction Mining: Instruction Data Selection for Tuning Large Language Models](https://md.research.elamur.ai/free/en/papers/cao-2023-instruction-mining-instruction-data-selection/)
- [next → MENLI: Robust Evaluation Metrics from Natural Language Inference](https://md.research.elamur.ai/free/en/papers/chen-2023-menli-robust-evaluation-metrics-natural/)
- [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/page/9/)

## References

92 references, 48 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Rohan Anil, Andrew M Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, et al. [Palm 2 technical report](https://md.research.elamur.ai/free/en/papers/anil-2023-palm-2-technical-report/). arXiv preprint arXiv:2305.10403, 2023.
2. Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc Le, et al. [Program synthesis with large language models](https://md.research.elamur.ai/free/en/papers/austin-2021-program-synthesis-large-language-models/). arXiv preprint arXiv:2108.07732, 2021.
3. Jiang Bian, Bin Gao, and Tie-Yan Liu. Knowledge-powered deep learning for word embedding. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2014, Nancy, France, September 15-19, 2014. Proceedings, Part I 14, pp. 132–148. [find](https://scholar.google.com/scholar?q=Jiang+Bian%2C+Bin+Gao%2C+and+Tie%2DYan+Liu%2E+Knowledge%2Dpowered+deep+learning+for+word+embedding%2E+In+Machine+Learning+and+Knowledge+Discovery+in+Databases%3A+European+Conference%2C+ECML+PKDD+2014%2C+Nancy%2C+France%2C+)
4. Léon Bottou. From machine learning to machine reasoning: An essay. Machine learning, 94:133–149, 2014. [find](https://scholar.google.com/scholar?q=Le%CC%81on+Bottou%2E+From+machine+learning+to+machine+reasoning%3A+An+essay%2E+Machine+learning%2C+94%3A133%E2%80%93149%2C+2014%2E)
5. Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter,… — [Language Models are Few-Shot Learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/)
6. Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, and Denny Zhou. [Large language models as tool makers](https://md.research.elamur.ai/free/en/papers/cai-2023-large-language-models-tool-makers/). arXiv preprint arXiv:2305.17126, 2023.
7. Jaime G Carbonell. Learning by analogy: Formulating and generalizing plans from past experience. In Machine learning, pp. 137–161. Elsevier, 1983. [find](https://scholar.google.com/scholar?q=Jaime+G+Carbonell%2E+Learning+by+analogy%3A+Formulating+and+generalizing+plans+from+past+experience%2E+In+Machine+learning%2C+pp%2E+137%E2%80%93161%2E+Elsevier%2C+1983%2E)
8. Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al. [Evaluating large language models trained on code](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/). arXiv preprint arXiv:2107.03374, 2021. URL https://arxiv.org/abs/2107.03374. [↗](https://arxiv.org/abs/2107.03374)
9. Wenhu Chen, Xueguang Ma, Xinyi Wang, and William W Cohen. Program of thoughts prompting: Disentangling computation from reasoning for numerical reasoning tasks. arXiv preprint arXiv:2211.12588, 2022. [find](https://scholar.google.com/scholar?q=Wenhu+Chen%2C+Xueguang+Ma%2C+Xinyi+Wang%2C+and+William+W+Cohen%2E+Program+of+thoughts+prompting%3A+Disentangling+computation+from+reasoning+for+numerical+reasoning+tasks%2E+arXiv+preprint+arXiv%3A2211%2E12588%2C+2022%2E)
10. Xinyun Chen, Chang Liu, and Dawn Song. Execution-guided neural program synthesis. In International Conference on Learning Representations, 2018. [find](https://scholar.google.com/scholar?q=Xinyun+Chen%2C+Chang+Liu%2C+and+Dawn+Song%2E+Execution%2Dguided+neural+program+synthesis%2E+In+International+Conference+on+Learning+Representations%2C+2018%2E)
11. Xinyun Chen, Chen Liang, Adams Wei Yu, Denny Zhou, Dawn Song, and Quoc V Le. Neural symbolic reader: Scalable integration of distributed and symbolic representations for reading comprehension. In International Conference on Learning Representations, 2019. [find](https://scholar.google.com/scholar?q=Xinyun+Chen%2C+Chen+Liang%2C+Adams+Wei+Yu%2C+Denny+Zhou%2C+Dawn+Song%2C+and+Quoc+V+Le%2E+Neural+symbolic+reader%3A+Scalable+integration+of+distributed+and+symbolic+representations+for+reading+comprehension%2E+In+Inte)
12. Xinyun Chen, Maxwell Lin, Nathanael Schärli, and Denny Zhou. Teaching large language models to self-debug. arXiv preprint arXiv:2304.05128, 2023. [find](https://scholar.google.com/scholar?q=Xinyun+Chen%2C+Maxwell+Lin%2C+Nathanael+Scha%CC%88rli%2C+and+Denny+Zhou%2E+Teaching+large+language+models+to+self%2Ddebug%2E+arXiv+preprint+arXiv%3A2304%2E05128%2C+2023%2E)
13. Zhoujun Cheng, Tianbao Xie, Peng Shi, Chengzu Li, Rahul Nadkarni, Yushi Hu, Caiming Xiong, Dragomir Radev, Mari Ostendorf, Luke Zettlemoyer, et al. [Binding language models in symbolic languages](https://md.research.elamur.ai/free/en/papers/cheng-2022-binding-language-models-symbolic-languages/). arXiv preprint arXiv:2210.02875, 2022.
14. Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emi… — [PaLM: Scaling Language Modeling with Pathways](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/)
15. Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al. Scaling instruction-finetuned language models. arXiv preprint arXiv:2210.11416, 2022. [find](https://scholar.google.com/scholar?q=Hyung+Won+Chung%2C+Le+Hou%2C+Shayne+Longpre%2C+Barret+Zoph%2C+Yi+Tay%2C+William+Fedus%2C+Eric+Li%2C+Xuezhi+Wang%2C+Mostafa+Dehghani%2C+Siddhartha+Brahma%2C+et+al%2E+Scaling+instruction%2Dfinetuned+language+models%2E+arXiv+prep)
16. Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. [Training verifiers to solve math word problems](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/), 2021. URL https://arxiv.org/abs/2110.14168. [↗](https://arxiv.org/abs/2110.14168)
17. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. [BERT: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volum…
18. Andrew Drozdov, Nathanael Schärli, Ekin Akyürek, Nathan Scales, Xinying Song, Xinyun Chen, Olivier Bousquet, and Denny Zhou. Compositional semantic parsing with large language models. arXiv preprint arXiv:2209.15003, 2022. [find](https://scholar.google.com/scholar?q=Andrew+Drozdov%2C+Nathanael+Scha%CC%88rli%2C+Ekin+Akyu%CC%88rek%2C+Nathan+Scales%2C+Xinying+Song%2C+Xinyun+Chen%2C+Olivier+Bousquet%2C+and+Denny+Zhou%2E+Compositional+semantic+parsing+with+large+language+models%2E+arXiv+preprint)
19. Dheeru Dua, Yizhong Wang, Pradeep Dasigi, Gabriel Stanovsky, Sameer Singh, and Matt Gardner. [Drop: A reading comprehension benchmark requiring discrete reasoning over paragraphs](https://md.research.elamur.ai/free/en/papers/dua-2019-drop-reading-comprehension-benchmark-requiring/). arXiv preprint arXiv:1903.00161, 2019.
20. Kevin Dunbar. The analogical paradox: Why analogy is so easy in naturalistic settings yet so difficult in the psychological laboratory. The analogical mind: Perspectives from cognitive science, pp. 313–334, 2001. [find](https://scholar.google.com/scholar?q=Kevin+Dunbar%2E+The+analogical+paradox%3A+Why+analogy+is+so+easy+in+naturalistic+settings+yet+so+difficult+in+the+psychological+laboratory%2E+The+analogical+mind%3A+Perspectives+from+cognitive+science%2C+pp%2E+31)
21. Yanlin Feng, Xinyue Chen, Bill Yuchen Lin, Peifeng Wang, Jun Yan, and Xiang Ren. [Scalable multi-hop relational reasoning for knowledge-aware question answering](https://md.research.elamur.ai/free/en/papers/feng-2020-scalable-multi-hop-relational-reasoning/). In Empirical Methods in Natural Language Processing (EMNLP), 2020.
22. Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, Shawn Presser, and Connor Leahy. The pile: An 800gb dataset of diverse text for language modeling. arXiv preprint arXiv: Arxiv-2101.00027, 2020. URL [https://arxiv.…](https://arxiv.…) [↗](https://arxiv.…)
23. Dedre Gentner. [Structure-mapping: A theoretical framework for analogy](https://md.research.elamur.ai/free/en/papers/gentner-1983-structure-mapping-theoretical-framework-analogy/). Cognitive science, 7(2):155–170, 1983.
24. Dedre Gentner and Keith J Holyoak. Reasoning and learning by analogy: Introduction. American psychologist, 52(1):32, 1997. [find](https://scholar.google.com/scholar?q=Dedre+Gentner+and+Keith+J+Holyoak%2E+Reasoning+and+learning+by+analogy%3A+Introduction%2E+American+psychologist%2C+52%281%29%3A32%2C+1997%2E)
25. Dedre Gentner and Arthur B Markman. Structure mapping in analogy and similarity. American psychologist, 52(1):45, 1997. [find](https://scholar.google.com/scholar?q=Dedre+Gentner+and+Arthur+B+Markman%2E+Structure+mapping+in+analogy+and+similarity%2E+American+psychologist%2C+52%281%29%3A45%2C+1997%2E)
26. Kavi Gupta, Peter Ebert Christensen, Xinyun Chen, and Dawn Song. Synthesize, execute and debug: Learning to repair for neural program synthesis. Advances in Neural Information Processing Systems, 33:17685–17695, 2020. [find](https://scholar.google.com/scholar?q=Kavi+Gupta%2C+Peter+Ebert+Christensen%2C+Xinyun+Chen%2C+and+Dawn+Song%2E+Synthesize%2C+execute+and+debug%3A+Learning+to+repair+for+neural+program+synthesis%2E+Advances+in+Neural+Information+Processing+Systems%2C+33%3A1)
27. Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, and Zhiting Hu. Reasoning with language model is planning with world model. arXiv preprint arXiv:2305.14992, 2023. [find](https://scholar.google.com/scholar?q=Shibo+Hao%2C+Yi+Gu%2C+Haodi+Ma%2C+Joshua+Jiahua+Hong%2C+Zhen+Wang%2C+Daisy+Zhe+Wang%2C+and+Zhiting+Hu%2E+Reasoning+with+language+model+is+planning+with+world+model%2E+arXiv+preprint+arXiv%3A2305%2E14992%2C+2023%2E)
28. Zhiwei He, Tian Liang, Wenxiang Jiao, Zhuosheng Zhang, Yujiu Yang, Rui Wang, Zhaopeng Tu, Shuming Shi, and Xing Wang. [Exploring human-like translation strategy with large language models](https://md.research.elamur.ai/free/en/papers/he-2024-exploring-human-like-translation-strategy/). arXiv preprint arXiv:2305.04118, 2023.
29. Dan Hendrycks, Steven Basart, Saurav Kadavath, Mantas Mazeika, Akul Arora, Ethan Guo, Collin Burns, Samir Puranik, Horace He, Dawn Song, et al. [Measuring coding challenge competence with apps](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-coding-challenge-competence-apps/). arXiv preprint arXiv:2105.09938, 2021a.
30. Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. [Measuring mathematical problem solving with the math dataset](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/). arXiv preprint arXiv:2103.03874, 2021b.
31. Keith J Holyoak. Analogy and relational reasoning. The Oxford handbook of thinking and reasoning, pp. 234–259, 2012. [find](https://scholar.google.com/scholar?q=Keith+J+Holyoak%2E+Analogy+and+relational+reasoning%2E+The+Oxford+handbook+of+thinking+and+reasoning%2C+pp%2E+234%E2%80%93259%2C+2012%2E)
32. Xiaoyang Hu, Shane Storks, Richard L Lewis, and Joyce Chai. In-context analogical reasoning with pre-trained language models. arXiv preprint arXiv:2305.17626, 2023. [find](https://scholar.google.com/scholar?q=Xiaoyang+Hu%2C+Shane+Storks%2C+Richard+L+Lewis%2C+and+Joyce+Chai%2E+In%2Dcontext+analogical+reasoning+with+pre%2Dtrained+language+models%2E+arXiv+preprint+arXiv%3A2305%2E17626%2C+2023%2E)
33. Ziqi Huang, Hongyuan Zhu, Ying Sun, Dongkyu Choi, Cheston Tan, and Joo-Hwee Lim. A diagnostic study of visual question answering with analogical reasoning. In 2021 IEEE International Conference on Image Processing (ICIP), pp. 2463–2467. [find](https://scholar.google.com/scholar?q=Ziqi+Huang%2C+Hongyuan+Zhu%2C+Ying+Sun%2C+Dongkyu+Choi%2C+Cheston+Tan%2C+and+Joo%2DHwee+Lim%2E+A+diagnostic+study+of+visual+question+answering+with+analogical+reasoning%2E+In+2021+IEEE+International+Conference+on+Ima)
34. Zhengbao Jiang, Frank F Xu, Jun Araki, and Graham Neubig. [How can we know what language models know?](https://md.research.elamur.ai/free/en/papers/jiang-2020-how-can-we-know-what/) Transactions of the Association for Computational Linguistics, 8:423–438, 2020.
35. Jaehun Jung, Lianhui Qin, Sean Welleck, Faeze Brahman, Chandra Bhagavatula, Ronan Le Bras, and Yejin Choi. [Maieutic prompting: Logically consistent reasoning with recursive explanations](https://md.research.elamur.ai/free/en/papers/jung-2022-maieutic-prompting-logically-consistent-reasoning/). arXiv preprint arXiv:2205.11822, 2022.
36. Omar Khattab, Keshav Santhanam, Xiang Lisa Li, David Hall, Percy Liang, Christopher Potts, and Matei Zaharia. [Demonstrate-search-predict: Composing retrieval and language models for knowledge-intensive nlp](https://md.research.elamur.ai/free/en/papers/khattab-2022-demonstrate-search-predict-composing-retrieval/). arXiv preprint arXiv:2212.14024, 2022.
37. Tushar Khot, Harsh Trivedi, Matthew Finlayson, Yao Fu, Kyle Richardson, Peter Clark, and Ashish Sabharwal. [Decomposed prompting: A modular approach for solving complex tasks](https://md.research.elamur.ai/free/en/papers/khot-2022-decomposed-prompting-modular-approach/). arXiv preprint arXiv:2210.02406, 2022.
38. Geunwoo Kim, Pierre Baldi, and Stephen McAleer. [Language models can solve computer tasks](https://md.research.elamur.ai/free/en/papers/kim-2023-language-models-solve-computer-tasks/). arXiv preprint arXiv:2303.17491, 2023.
39. Hyuhng Joon Kim, Hyunsoo Cho, Junyeob Kim, Taeuk Kim, Kang Min Yoo, and Sang-goo Lee. Self-generated in-context learning: Leveraging auto-regressive language models as a demonstration generator. arXiv preprint arXiv:2206.08082, 2022. — [arXiv:2206.08082](https://arxiv.org/abs/2206.08082) [find](https://scholar.google.com/scholar?q=Hyuhng+Joon+Kim%2C+Hyunsoo+Cho%2C+Junyeob+Kim%2C+Taeuk+Kim%2C+Kang+Min+Yoo%2C+and+Sang%2Dgoo+Lee%2E+Self%2Dgenerated+in%2Dcontext+learning%3A+Leveraging+auto%2Dregressive+language+models+as+a+demonstration+generator%2E+arXiv)
40. Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. [Large language models are zero-shot reasoners](https://md.research.elamur.ai/free/en/papers/kojima-2022-large-language-models-zero-shot/). In Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022), 2022. URL https://arxiv.org/abs/2205.11916. [↗](https://arxiv.org/abs/2205.11916)
41. Sumith Kulal, Panupong Pasupat, Kartik Chandra, Mina Lee, Oded Padon, Alex Aiken, and Percy S Liang. [Spoc: Search-based pseudocode to code](https://md.research.elamur.ai/free/en/papers/kulal-2019-spoc-search-based-pseudocode-code/). Advances in Neural Information Processing Systems, 32, 2019.
42. Junlong Li, Zhuosheng Zhang, and Hai Zhao. Self-prompting large language models for open-domain qa. arXiv preprint arXiv:2212.08635, 2022a. — [arXiv:2212.08635](https://arxiv.org/abs/2212.08635) [find](https://scholar.google.com/scholar?q=Junlong+Li%2C+Zhuosheng+Zhang%2C+and+Hai+Zhao%2E+Self%2Dprompting+large+language+models+for+open%2Ddomain+qa%2E+arXiv+preprint+arXiv%3A2212%2E08635%2C+2022a%2E+%E2%80%94+%5BarXiv%3A2212%2E08635%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2212%2E08635%29)
43. Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, et al. [Competition-level code generation with alphacode](https://md.research.elamur.ai/free/en/papers/li-2022-competition-level-code-generation-alphacode/). Science, 378(6624):1092–1097, 2022b.
44. Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, et al. Holistic evaluation of language models. arXiv preprint arXiv:2211.09110, 2022. [find](https://scholar.google.com/scholar?q=Percy+Liang%2C+Rishi+Bommasani%2C+Tony+Lee%2C+Dimitris+Tsipras%2C+Dilara+Soylu%2C+Michihiro+Yasunaga%2C+Yian+Zhang%2C+Deepak+Narayanan%2C+Yuhuai+Wu%2C+Ananya+Kumar%2C+et+al%2E+Holistic+evaluation+of+language+models%2E+arXiv+)
45. Hunter Lightman, Vineet Kosaraju, Yura Burda, Harri Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, and Ilya Sutskever. Improving mathematical reasoning with process supervision. 2023. URL [https://openai.com/research/](https://openai.com/research/) improving-mathematical-reasoning-with-process-supervision. [↗](https://openai.com/research/)
46. Bill Yuchen Lin, Xinyue Chen, Jamin Chen, and Xiang Ren. Kagnet: Knowledge-aware graph networks for commonsense reasoning. In Empirical Methods in Natural Language Processing (EMNLP), 2019. [find](https://scholar.google.com/scholar?q=Bill+Yuchen+Lin%2C+Xinyue+Chen%2C+Jamin+Chen%2C+and+Xiang+Ren%2E+Kagnet%3A+Knowledge%2Daware+graph+networks+for+commonsense+reasoning%2E+In+Empirical+Methods+in+Natural+Language+Processing+%28EMNLP%29%2C+2019%2E)
47. Jiachang Liu, Dinghan Shen, Yizhe Zhang, William B Dolan, Lawrence Carin, and Weizhu Chen. [What makes good in-context examples for gpt-3?](https://md.research.elamur.ai/free/en/papers/liu-2022-what-makes-good-context-examples/) In Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures, pp. 100–114, 2…
48. Inbal Magar and Roy Schwartz. Data contamination: From memorization to exploitation. arXiv preprint arXiv:2203.08242, 2022. [find](https://scholar.google.com/scholar?q=Inbal+Magar+and+Roy+Schwartz%2E+Data+contamination%3A+From+memorization+to+exploitation%2E+arXiv+preprint+arXiv%3A2203%2E08242%2C+2022%2E)
49. Swaroop Mishra, Daniel Khashabi, Chitta Baral, and Hannaneh Hajishirzi. Cross-task generalization via natural language crowdsourcing instructions. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 3470–3487, 2022. doi: 10.18653/v1… [find](https://scholar.google.com/scholar?q=Swaroop+Mishra%2C+Daniel+Khashabi%2C+Chitta+Baral%2C+and+Hannaneh+Hajishirzi%2E+Cross%2Dtask+generalization+via+natural+language+crowdsourcing+instructions%2E+In+Proceedings+of+the+60th+Annual+Meeting+of+the+Asso)
50. Tom M Mitchell, Jaime G Carbonell, Ryszard S Michalski, and Rogers Hall. Analogical reasoning in the context of acquiring problem solving expertise. Machine Learning: A Guide to Current Research, pp. 85–88, 1986. [find](https://scholar.google.com/scholar?q=Tom+M+Mitchell%2C+Jaime+G+Carbonell%2C+Ryszard+S+Michalski%2C+and+Rogers+Hall%2E+Analogical+reasoning+in+the+context+of+acquiring+problem+solving+expertise%2E+Machine+Learning%3A+A+Guide+to+Current+Research%2C+pp%2E+)
51. Michael Moor, Qian Huang, Shirley Wu, Michihiro Yasunaga, Yash Dalmia, Jure Leskovec, Cyril Zakka, Eduardo Pontes Reis, and Pranav Rajpurkar. [Med-flamingo: a multimodal medical few-shot learner](https://md.research.elamur.ai/free/en/papers/moor-2023-med-flamingo-multimodal-medical-few/). In Machine Learning for Health (ML4H), pp. 353–367. PMLR, 2023.
52. OpenAI. [Gpt-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). 2023.
53. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. [Training language models to follow instructions with human feedback](https://md.research.elamur.ai/free/en/papers/ouyang-2022-training-language-models-follow-instructions/). Advances in Neural Information Processing Systems, 35:27730–27744, 2022.
54. Joon Sung Park, Joseph C O’Brien, Carrie J Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interactive simulacra of human behavior. arXiv preprint arXiv:2304.03442, 2023. [find](https://scholar.google.com/scholar?q=Joon+Sung+Park%2C+Joseph+C+O%E2%80%99Brien%2C+Carrie+J+Cai%2C+Meredith+Ringel+Morris%2C+Percy+Liang%2C+and+Michael+S+Bernstein%2E+Generative+agents%3A+Interactive+simulacra+of+human+behavior%2E+arXiv+preprint+arXiv%3A2304%2E0344)
55. George Polya. How to solve it: A new aspect of mathematical method, volume 85. Princeton university press, 2004. [find](https://scholar.google.com/scholar?q=George+Polya%2E+How+to+solve+it%3A+A+new+aspect+of+mathematical+method%2C+volume+85%2E+Princeton+university+press%2C+2004%2E)
56. Ofir Press, Muru Zhang, Sewon Min, Ludwig Schmidt, Noah A Smith, and Mike Lewis. Measuring and narrowing the compositionality gap in language models. arXiv preprint arXiv:2210.03350, 2022. [find](https://scholar.google.com/scholar?q=Ofir+Press%2C+Muru+Zhang%2C+Sewon+Min%2C+Ludwig+Schmidt%2C+Noah+A+Smith%2C+and+Mike+Lewis%2E+Measuring+and+narrowing+the+compositionality+gap+in+language+models%2E+arXiv+preprint+arXiv%3A2210%2E03350%2C+2022%2E)
57. Chengwei Qin, Aston Zhang, Zhuosheng Zhang, Jiaao Chen, Michihiro Yasunaga, and Diyi Yang. [Is chatgpt a general-purpose natural language processing task solver?](https://md.research.elamur.ai/free/en/papers/qin-2023-chatgpt-general-purpose-natural-language/) arXiv preprint arXiv:2302.06476, 2023.
58. Nils Reimers and Iryna Gurevych. [Sentence-BERT: Sentence embeddings using Siamese BERT-networks](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 3982–3992, Hong Kon…
59. Hongyu Ren, Hanjun Dai, Bo Dai, Xinyun Chen, Michihiro Yasunaga, Haitian Sun, Dale Schuurmans, Jure Leskovec, and Denny Zhou. Lego: Latent execution-guided reasoning for multi-hop question answering on knowledge graphs. In International Conference on Machine Learning (ICML), 2021. [find](https://scholar.google.com/scholar?q=Hongyu+Ren%2C+Hanjun+Dai%2C+Bo+Dai%2C+Xinyun+Chen%2C+Michihiro+Yasunaga%2C+Haitian+Sun%2C+Dale+Schuurmans%2C+Jure+Leskovec%2C+and+Denny+Zhou%2E+Lego%3A+Latent+execution%2Dguided+reasoning+for+multi%2Dhop+question+answering+o)
60. Timo Schick, Jane Dwivedi-Yu, Roberto Dessı̀, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom. [Toolformer: Language models can teach themselves to use tools](https://md.research.elamur.ai/free/en/papers/schick-2023-toolformer-language-models-can-teach/). arXiv preprint arXiv:2302.04761, 2023.
61. Weijia Shi, Sewon Min, Michihiro Yasunaga, Minjoon Seo, Rich James, Mike Lewis, Luke Zettlemoyer, and Wen-tau Yih. [Replug: Retrieval-augmented black-box language models](https://md.research.elamur.ai/free/en/papers/shi-2023-replug-retrieval-augmented-black-box/). arXiv preprint arXiv:2301.12652, 2023.
62. KaShun Shum, Shizhe Diao, and Tong Zhang. [Automatic prompt augmentation and selection with chain-of-thought from labeled data](https://md.research.elamur.ai/free/en/papers/shum-2023-automatic-prompt-augmentation-selection-chain/). arXiv preprint arXiv:2302.12822, 2023.
63. Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, et al. [Beyond the imitation game: Quantifying and extrapolating the capabilities of language models](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/). arXiv preprint arXiv:2206.04615, 2022.
64. Hongjin Su, Jungo Kasai, Chen Henry Wu, Weijia Shi, Tianlu Wang, Jiayi Xin, Rui Zhang, Mari Ostendorf, Luke Zettlemoyer, Noah A Smith, et al. Selective annotation makes language models better few-shot learners. arXiv preprint arXiv:2209.01975, 2022. URL https://arxiv.org/abs/2209.01975. [↗](https://arxiv.org/abs/2209.01975)
65. Zhiqing Sun, Xuezhi Wang, Yi Tay, Yiming Yang, and Denny Zhou. Recitation-augmented language models. arXiv preprint arXiv:2210.01296, 2022. [find](https://scholar.google.com/scholar?q=Zhiqing+Sun%2C+Xuezhi+Wang%2C+Yi+Tay%2C+Yiming+Yang%2C+and+Denny+Zhou%2E+Recitation%2Daugmented+language+models%2E+arXiv+preprint+arXiv%3A2210%2E01296%2C+2022%2E)
66. Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V Le, Ed H Chi, Denny Zhou, et al. [Challenging big-bench tasks and whether chain-of-thought can solve them](https://md.research.elamur.ai/free/en/papers/suzgun-2023-challenging-big-bench-tasks-whether/). arXiv preprint arXiv:2210.09261, 2022.
67. Alon Talmor, Jonathan Herzig, Nicholas Lourie, and Jonathan Berant. [Commonsenseqa: A question answering challenge targeting commonsense knowledge](https://md.research.elamur.ai/free/en/papers/talmor-2019-commonsenseqa-question-answering-challenge-targeting/). arXiv preprint arXiv:1811.00937, 2018.
68. Stella Vosniadou and Andrew Ortony. Similarity and analogical reasoning. Cambridge University Press, 1989. [find](https://scholar.google.com/scholar?q=Stella+Vosniadou+and+Andrew+Ortony%2E+Similarity+and+analogical+reasoning%2E+Cambridge+University+Press%2C+1989%2E)
69. Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. [Self-consistency improves chain of thought reasoning in language models](https://md.research.elamur.ai/free/en/papers/wang-2022-self-consistency-improves-chain-thought/). arXiv preprint arXiv:2203.11171, 2022.
70. Thomas B Ward, Steven M Smith, and Jyotsna Ed Vaid. Creative thought: An investigation of conceptual structures and processes. American Psychological Association, 1997. [find](https://scholar.google.com/scholar?q=Thomas+B+Ward%2C+Steven+M+Smith%2C+and+Jyotsna+Ed+Vaid%2E+Creative+thought%3A+An+investigation+of+conceptual+structures+and+processes%2E+American+Psychological+Association%2C+1997%2E)
71. Taylor Webb, Keith J Holyoak, and Hongjing Lu. Emergent analogical reasoning in large language models. Nature Human Behaviour, pp. 1–16, 2023. [find](https://scholar.google.com/scholar?q=Taylor+Webb%2C+Keith+J+Holyoak%2C+and+Hongjing+Lu%2E+Emergent+analogical+reasoning+in+large+language+models%2E+Nature+Human+Behaviour%2C+pp%2E+1%E2%80%9316%2C+2023%2E)
72. Jason Wei, Maarten Bosma, Vincent Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, and Quoc V Le. [Finetuned language models are zero-shot learners](https://md.research.elamur.ai/free/en/papers/wei-2021-finetuned-language-models-zero-shot/). In International Conference on Learning Representations, 2022a. URL [https://openreview.net/forum?id=gEZrGCozdqR](https://openreview.net/forum?id=gEZrGCozdqR). [↗](https://openreview.net/forum?id=gEZrGCozdqR)
73. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Ed Chi, Quoc Le, and Denny Zhou. Chain of thought prompting elicits reasoning in large language models. In Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022), 2022b. URL https://arxiv.org/abs/2201.11903. — [Chain-of-Thought Prompting Elicits Reasoning in Large Language Models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/) [↗](https://arxiv.org/abs/2201.11903)
74. Yuhuai Wu, Markus N Rabe, Wenda Li, Jimmy Ba, Roger B Grosse, and Christian Szegedy. Lime: Learning inductive bias for primitives of mathematical reasoning. In International Conference on Machine Learning, pp. 11251–11262. PMLR, 2021. [find](https://scholar.google.com/scholar?q=Yuhuai+Wu%2C+Markus+N+Rabe%2C+Wenda+Li%2C+Jimmy+Ba%2C+Roger+B+Grosse%2C+and+Christian+Szegedy%2E+Lime%3A+Learning+inductive+bias+for+primitives+of+mathematical+reasoning%2E+In+International+Conference+on+Machine+Lear)
75. Tianbao Xie, Chen Henry Wu, Peng Shi, Ruiqi Zhong, Torsten Scholak, Michihiro Yasunaga, Chien-Sheng Wu, Ming Zhong, Pengcheng Yin, Sida I Wang, et al. [Unifiedskg: Unifying and multi-tasking structured knowledge grounding with text-to-text language models](https://md.research.elamur.ai/free/en/papers/xie-2022-unifiedskg-unifying-multi-tasking-structured/). arXiv preprint arXiv:2201.05966, 2022.
76. Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William W Cohen, Ruslan Salakhutdinov, and Christopher D Manning. [Hotpotqa: A dataset for diverse, explainable multi-hop question answering](https://md.research.elamur.ai/free/en/papers/yang-2018-hotpotqa-dataset-diverse-explainable-multi/). arXiv preprint arXiv:1809.09600, 2018.
77. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. [React: Synergizing reasoning and acting in language models](https://md.research.elamur.ai/free/en/papers/yao-2022-react-synergizing-reasoning-acting-language/). arXiv preprint arXiv:2210.03629, 2022.
78. Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L Griffiths, Yuan Cao, and Karthik Narasimhan. Tree of thoughts: Deliberate problem solving with large language models. arXiv preprint arXiv:2305.10601, 2023. [find](https://scholar.google.com/scholar?q=Shunyu+Yao%2C+Dian+Yu%2C+Jeffrey+Zhao%2C+Izhak+Shafran%2C+Thomas+L+Griffiths%2C+Yuan+Cao%2C+and+Karthik+Narasimhan%2E+Tree+of+thoughts%3A+Deliberate+problem+solving+with+large+language+models%2E+arXiv+preprint+arXiv%3A23)
79. Michihiro Yasunaga and Percy Liang. Graph-based, self-supervised program repair from diagnostic feedback. In International Conference on Machine Learning (ICML), pp. 10799–10808. PMLR, 2020. [find](https://scholar.google.com/scholar?q=Michihiro+Yasunaga+and+Percy+Liang%2E+Graph%2Dbased%2C+self%2Dsupervised+program+repair+from+diagnostic+feedback%2E+In+International+Conference+on+Machine+Learning+%28ICML%29%2C+pp%2E+10799%E2%80%9310808%2E+PMLR%2C+2020%2E)
80. Michihiro Yasunaga and Percy Liang. Break-it-fix-it: Unsupervised learning for program repair. In International Conference on Machine Learning, pp. 11941–11952. PMLR, 2021. [find](https://scholar.google.com/scholar?q=Michihiro+Yasunaga+and+Percy+Liang%2E+Break%2Dit%2Dfix%2Dit%3A+Unsupervised+learning+for+program+repair%2E+In+International+Conference+on+Machine+Learning%2C+pp%2E+11941%E2%80%9311952%2E+PMLR%2C+2021%2E)
81. Michihiro Yasunaga, Hongyu Ren, Antoine Bosselut, Percy Liang, and Jure Leskovec. QA-GNN: Reasoning with language models and knowledge graphs for question answering. In North American Chapter of the Association for Computational Linguistics (NAACL), 2021. [find](https://scholar.google.com/scholar?q=Michihiro+Yasunaga%2C+Hongyu+Ren%2C+Antoine+Bosselut%2C+Percy+Liang%2C+and+Jure+Leskovec%2E+QA%2DGNN%3A+Reasoning+with+language+models+and+knowledge+graphs+for+question+answering%2E+In+North+American+Chapter+of+the+A)
82. Michihiro Yasunaga, Antoine Bosselut, Hongyu Ren, Xikun Zhang, Christopher D Manning, Percy S Liang, and Jure Leskovec. Deep bidirectional language-knowledge graph pretraining. Advances in Neural Information Processing Systems, 35:37309–37323, 2022a. [find](https://scholar.google.com/scholar?q=Michihiro+Yasunaga%2C+Antoine+Bosselut%2C+Hongyu+Ren%2C+Xikun+Zhang%2C+Christopher+D+Manning%2C+Percy+S+Liang%2C+and+Jure+Leskovec%2E+Deep+bidirectional+language%2Dknowledge+graph+pretraining%2E+Advances+in+Neural+Info)
83. Michihiro Yasunaga, Jure Leskovec, and Percy Liang. [LinkBERT: Pretraining language models with document links](https://md.research.elamur.ai/free/en/papers/yasunaga-2022-linkbert-pretraining-language-models-document/). In Association for Computational Linguistics (ACL), 2022b.
84. Michihiro Yasunaga, Armen Aghajanyan, Weijia Shi, Rich James, Jure Leskovec, Percy Liang, Mike Lewis, Luke Zettlemoyer, and Wen-tau Yih. [Retrieval-augmented multimodal language modeling](https://md.research.elamur.ai/free/en/papers/yasunaga-2022-retrieval-augmented-multimodal-language-modeling/). In International Conference on Machine Learning (ICML), 2023.
85. Tao Yu, Rui Zhang, Kai Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma, Irene Li, Qingning Yao, Shanelle Roman, et al. [Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task](https://md.research.elamur.ai/free/en/papers/yu-2018-spider-large-scale-human-labeled/). arXiv preprint arXiv:1809.08887, 2018.
86. Eric Zelikman, Qian Huang, Gabriel Poesia, Noah D Goodman, and Nick Haber. Parsel: A unified natural language framework for algorithmic reasoning. arXiv preprint arXiv:2212.[10561, 2022](https://md.research.elamur.ai/free/en/papers/zelikman-2023-parsel-algorithmic-reasoning-language-models/).
87. Hanlin Zhang, Jiani Huang, Ziyang Li, Mayur Naik, and Eric Xing. Improved logical reasoning of language models via differentiable symbolic programming. arXiv preprint arXiv:2305.03742, 2023. [find](https://scholar.google.com/scholar?q=Hanlin+Zhang%2C+Jiani+Huang%2C+Ziyang+Li%2C+Mayur+Naik%2C+and+Eric+Xing%2E+Improved+logical+reasoning+of+language+models+via+differentiable+symbolic+programming%2E+arXiv+preprint+arXiv%3A2305%2E03742%2C+2023%2E)
88. Xikun Zhang, Antoine Bosselut, Michihiro Yasunaga, Hongyu Ren, Percy Liang, Christopher D Manning, and Jure Leskovec. Greaselm: Graph reasoning enhanced language models for question answering. In International Conference on Learning Representations (ICLR), 2022a. [find](https://scholar.google.com/scholar?q=Xikun+Zhang%2C+Antoine+Bosselut%2C+Michihiro+Yasunaga%2C+Hongyu+Ren%2C+Percy+Liang%2C+Christopher+D+Manning%2C+and+Jure+Leskovec%2E+Greaselm%3A+Graph+reasoning+enhanced+language+models+for+question+answering%2E+In+Inte)
89. Zhuosheng Zhang, Aston Zhang, Mu Li, and Alex Smola. [Automatic chain of thought prompting in large language models](https://md.research.elamur.ai/free/en/papers/zhang-2022-automatic-chain-thought-prompting-large/). arXiv preprint arXiv:2210.03493, 2022b.
90. Wenting Zhao, Mor Geva, Bill Yuchen Lin, Michihiro Yasunaga, Aman Madaan, and Tao Yu. Complex reasoning in natural language. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 6: Tutorial Abstracts), pp. 11–20, Toronto, Canada, July 2023. Association f… [find](https://scholar.google.com/scholar?q=Wenting+Zhao%2C+Mor+Geva%2C+Bill+Yuchen+Lin%2C+Michihiro+Yasunaga%2C+Aman+Madaan%2C+and+Tao+Yu%2E+Complex+reasoning+in+natural+language%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+Association+for+Computatio)
91. Aojun Zhou, Ke Wang, Zimu Lu, Weikang Shi, Sichun Luo, Zipeng Qin, Shaoqing Lu, Anya Jia, Linqi Song, Mingjie Zhan, et al. [Solving challenging math word problems using gpt-4 code interpreter with code-based self-verification](https://md.research.elamur.ai/free/en/papers/zhou-2023-solving-challenging-math-word-problems/). arXiv preprint arXiv:2308.07921, 2023.
92. Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Olivier Bousquet, Quoc Le, and Ed Chi. [Least-to-most prompting enables complex reasoning in large language models](https://md.research.elamur.ai/free/en/papers/al-2022-least-most-prompting-enables-complex/). arXiv preprint arXiv:2205.10625, 2022. URL https://arxiv.org/abs/2205. 10625. [↗](https://arxiv.org/abs/2205)

*Updated 2 November 2026*