---
title: "Who cites A Systematic Evaluation of — 108 citing papers"
description: "108 papers of the Elamur Research library cite «A Systematic Evaluation of Large Language Models of Code», found in their bibliographies…"
canonical: "https://research.elamur.ai/free/en/papers/xu-2022-systematic-evaluation-large-language-models/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/xu-2022-systematic-evaluation-large-language-models/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [A Systematic Evaluation of Large Language Models…](https://md.research.elamur.ai/free/en/papers/xu-2022-systematic-evaluation-large-language-models/) / cited by

# Who cites «A Systematic Evaluation of Large Language Models of Code»

108 papers of our library cite it (of the 149,439 whose bibliographies we read) · 30 with a page here, the most cited first · [← back to «A Systematic Evaluation of Large Language Models of Code»](https://md.research.elamur.ai/free/en/papers/xu-2022-systematic-evaluation-large-language-models/)

1. **[A Survey of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/) [Frontiers of Computer Science](https://md.research.elamur.ai/free/en/venues/frontiers-of-computer-science/)**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,875 citations*
2. **[The Rise and Potential of Large Language Model Based Agents: A Survey](https://md.research.elamur.ai/free/en/papers/xi-2023-rise-potential-large-language/) [Science China Information Sciences](https://md.research.elamur.ai/free/en/venues/science-china-information-sciences/)**Zhiheng Xi, Wenxiang Chen, Xin Guo, et al.*2023 · 1,272 citations*
3. **[Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation](https://md.research.elamur.ai/free/en/papers/liu-2023-your-code-generated-chatgpt-really/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang, et al.*2023 · 648 citations*
4. [**A Categorical Archive of ChatGPT Failures arXiv:2302.03494**Ali Borji*2023 · 559 citations*](https://md.research.elamur.ai/free/en/papers/borji-2023-categorical-archive-chatgpt-failures/)
5. **[Gorilla: Large Language Model Connected with Massive APIs](https://md.research.elamur.ai/free/en/papers/patil-2023-gorilla-large-language-model-connected/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Shishir G. Patil, Tianjun Zhang, Xin Wang, et al.*2023 · 546 citations*
6. **[CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X](https://md.research.elamur.ai/free/en/papers/zheng-2023-codegeex-pre-trained-model-code/) [ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)](https://md.research.elamur.ai/free/en/venues/acm-sigkdd-conference-on-knowledge-discovery-and-data-mining-kdd/)**Qinkai Zheng, Xiao Xia, Xu Zou, et al.*2023 · 465 citations*
7. [**The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery arXiv:2408.06292**Chris Lu, Cong Lu, Robert Tjarko Lange, et al.*2024 · 372 citations*](https://md.research.elamur.ai/free/en/papers/lu-2024-ai-scientist-fully-automated/)
8. **[A Survey on Large Language Models for Code Generation](https://md.research.elamur.ai/free/en/papers/jiang-2024-survey-large-language-models-code/) [ACM Transactions on Software Engineering and Methodology](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-software-engineering-and-methodology/)**Juyong Jiang, Fan Wang, Jiasi Shen, et al.*2024 · 367 citations*
9. [**Challenges and Applications of Large Language Models arXiv:2307.10169**Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.*2023 · 301 citations*](https://md.research.elamur.ai/free/en/papers/kaddour-2023-challenges-applications-large-language-models/)
10. **[The Effect of Sampling Temperature on Problem Solving in Large Language Models](https://md.research.elamur.ai/free/en/papers/renze-2024-effect-sampling-temperature-problem-solving/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Matthew Renze*2024 · 263 citations*
11. **[Language Models of Code are Few-Shot Commonsense Learners](https://md.research.elamur.ai/free/en/papers/madaan-2022-language-models-code-few-shot/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Aman Madaan, Shuyan Zhou, Uri Alon, et al.*2022 · 212 citations*
12. [**Evaluating Large Language Models: A Comprehensive Survey arXiv:2310.19736**Zishan Guo, Renren Jin, Chuang Liu, et al.*2023 · 182 citations*](https://md.research.elamur.ai/free/en/papers/guo-2023-evaluating-large-language-models-comprehensive/)
13. [**SantaCoder: don't reach for the stars! arXiv:2301.03988**Loubna Ben Allal, Raymond Li, Denis Kocetkov, et al.*2023 · 167 citations*](https://md.research.elamur.ai/free/en/papers/allal-2023-santacoder-don-t-reach-stars/)
14. [**Reasoning with Language Model Prompting: A Survey arXiv:2212.09597**Shuofei Qiao, Yixin Ou, Ningyu Zhang, et al.*2022 · 161 citations*](https://md.research.elamur.ai/free/en/papers/qiao-2022-reasoning-language-model-prompting-survey/)
15. **[Emergent and Predictable Memorization in Large Language Models](https://md.research.elamur.ai/free/en/papers/biderman-2023-emergent-predictable-memorization-large-language/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Stella Biderman, USVSN Sai Prashanth, Lintang Sutawika, et al.*2023 · 123 citations*
16. [**CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution arXiv:2401.03065**Alex Gu, Baptiste Rozière, Hugh Leather, et al.*2024 · 122 citations*](https://md.research.elamur.ai/free/en/papers/gu-2024-cruxeval-benchmark-code-reasoning-understanding/)
17. [**RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems arXiv:2306.03091**Tianyang Liu, Canwen Xu, Julian McAuley*2023 · 122 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-repobench-benchmarking-repository-level-code/)
18. **[Self-Edit: Fault-Aware Code Editor for Code Generation](https://md.research.elamur.ai/free/en/papers/zhang-2023-self-edit-fault-aware-code/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Kechi Zhang, Zhuo Li, Jia Li, et al.*2023 · 105 citations*
19. [**MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation arXiv:2208.08227**Federico Cassano, John Gouwar, Daniel Nguyen, et al.*2022 · 88 citations*](https://md.research.elamur.ai/free/en/papers/cassano-2022-multipl-e-scalable-extensible-approach/)
20. [**Large Language Models Are Not Strong Abstract Reasoners arXiv:2305.19555**Gael Gendron, Qiming Bao, Michael Witbrock, et al.*2023 · 61 citations*](https://md.research.elamur.ai/free/en/papers/gendron-2023-large-language-models-strong-abstract/)
21. **[Parsel: Algorithmic Reasoning with Language Models by Composing Decompositions](https://md.research.elamur.ai/free/en/papers/zelikman-2023-parsel-algorithmic-reasoning-language-models/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Eric Zelikman, Qian Huang, Gabriel Poesia, et al.*2023 · 56 citations*
22. **[CoCoMIC: Code Completion by Jointly Modeling In-file and Cross-file Context](https://md.research.elamur.ai/free/en/papers/ding-2024-cocomic-code-completion-jointly-modeling/) [Language Resources and Evaluation Conference (LREC)](https://md.research.elamur.ai/free/en/venues/lrec/)**Yangruibo Ding, Zijian Wang, Wasi Ahmad, et al.*2024 · 45 citations*
23. [**ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages arXiv:2212.06742**Yekun Chai, Shuohuan Wang, Chao Pang, et al.*2022 · 32 citations*](https://md.research.elamur.ai/free/en/papers/chai-2022-ernie-code-english-centric/)
24. **[AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZ](https://md.research.elamur.ai/free/en/papers/belouadi-2023-automatikz-text-guided-synthesis-scientific/) [International Conference on Learning Representations (ICLR)](https://md.research.elamur.ai/free/en/venues/international-conference-on-learning-representations-iclr/)**Jonas Belouadi, Anne Lauscher, Steffen Eger*2023 · 31 citations*
25. **[PaSa: An LLM Agent for Comprehensive Academic Paper Search](https://md.research.elamur.ai/free/en/papers/he-2025-pasa-llm-agent-comprehensive-academic/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yichen He, Guanhua Huang, Peiyuan Feng, et al.*2025 · 29 citations*
26. **[Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMs](https://md.research.elamur.ai/free/en/papers/yang-2025-code-think-think-code-survey/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Dayu Yang, Tianyang Liu, Daoan Zhang, et al.*2025 · 19 citations*
27. **[NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User Queries](https://md.research.elamur.ai/free/en/papers/zhang-2024-naturalcodebench-examining-coding-performance-mismatch/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Shudan Zhang, Hanlin Zhao, Xiao Liu, et al.*2024 · 17 citations*
28. **[M2RC-EVAL: Massively Multilingual Repository-level Code Completion Evaluation](https://md.research.elamur.ai/free/en/papers/liu-2025-m2rc-eval-massively-multilingual-repository/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Jiaheng Liu, Ken Deng, Congnan Liu, et al.*2025 · 8 citations*
29. **[Deep Learning Based Code Generation Methods: Literature Review (基于深度学习的代码生成方法研究进展)](https://md.research.elamur.ai/free/en/papers/yang-2023-deep-learning-code/) [Journal of Software](https://md.research.elamur.ai/free/en/venues/journal-of-software/)**Zezhou Yang (杨泽洲), Sirong Chen (陈思榕), Cuiyun Gao (高翠芸), et al.*2023 · 1 citation*
30. **[STCOR: A Trilevel Syllogism-Driven Reasoning Framework](https://md.research.elamur.ai/free/en/papers/yang-2026-stcor-trilevel-syllogism-driven-reasoning/) [Workshop on Argument Mining](https://md.research.elamur.ai/free/en/venues/argmining/)**Keying Yang, Hao Wang, Chengtao Jian, et al.*2026*

78 more papers of our library cite it; they have no page here yet.

- [← back to](https://md.research.elamur.ai/free/en/papers/xu-2022-systematic-evaluation-large-language-models/) — A Systematic Evaluation of Large Language Models of Code