---
title: "Across Programming Language Silos — paper by Zhu et al. (2026)"
description: "Retrieval-augmented code generation (RACG) has mostly been studied within a single programming language (PL), usually… 36 references."
authors: ["Qiming Zhu", "Jialun Cao", "Xuanang Chen", "Weili Zhang", "Yaojie Lu", "Hongyu Lin", "Xianpei Han", "Le Sun", "Shing-Chi Cheung"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: ACL 2026"
source: "https://aclanthology.org/2026.findings-acl.1216/"
doi: "10.18653/v1/2026.findings-acl.1216"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhu-2026-across-programming-language-silos-study/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhu-2026-across-programming-language-silos-study/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/21/) / Across Programming Language Silos: A Study on Cross-Lingual Retrieval-Augmented Code Generation

# Across Programming Language Silos: A Study on Cross-Lingual Retrieval-Augmented Code Generation

**Authors:** [Qiming Zhu](https://md.research.elamur.ai/free/en/authors/qiming-zhu/), Jialun Cao, [Xuanang Chen](https://md.research.elamur.ai/free/en/authors/xuanang-chen/), Weili Zhang, [Yaojie Lu](https://md.research.elamur.ai/free/en/authors/yaojie-lu/), [Hongyu Lin](https://md.research.elamur.ai/free/en/authors/hongyu-lin/), [Xianpei Han](https://md.research.elamur.ai/free/en/authors/xianpei-han/), [Le Sun](https://md.research.elamur.ai/free/en/authors/le-sun/) and Shing-Chi Cheung · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.1216/) · [PDF](https://aclanthology.org/2026.findings-acl.1216.pdf) · [DOI 10.18653/v1/2026.findings-acl.1216](https://doi.org/10.18653/v1/2026.findings-acl.1216) · [OpenAlex](https://openalex.org/W4416073056)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Retrieval-augmented code generation (RACG) has mostly been studied within a single programming language (PL), usually Python or Java. This paper asks whether code retrieved in one PL can help an LLM write code in another. Such transfer would benefit less-resourced languages like Scala and support code migration. The authors run three experimental settings. The first injects an oracle "golden" solution, using HumanEval-X (164 parallel problems in 5 PLs). The second is a full retrieval pipeline over a newly built dataset of nearly 14K instances in 13 PLs, each with an NL prompt, a verified solution and tests. The third uses the same corpus with all natural-language comments removed. Five small code LLMs are scored with Pass@1. Cross-PL transfer works but is uneven. It depends on how closely related the two PLs are and how broadly the model was pretrained. Python-only models gain little from foreign-language context. Removing comments and docstrings costs only a few points, provided a code-specific retriever is used. These findings give practical guidance for building multilingual code assistants.

## Key points
- **Resources:** about 14K instances across 13 PLs (roughly 1,000 per language), plus HumanEval-X for the controlled oracle experiments. Code is at github.com/icip-cas/Cross-Lingual-RACG.
- **Models:** three multilingual models (CodeLlama-7B-Instruct, Deepseek-Coder-6.7B-Instruct, Qwen2.5-Coder-7B-Instruct) and two Python-specialized models (Phi-1, Phi-1.5). Decoding was greedy and the metric was Pass@1.
- **Effect of comments:** stripping NL from the corpus lowered the average gain only modestly. For multilingual LLMs it fell from +11.67% to +9.30%. For Python-specialized LLMs it fell from +1.04% to +0.45%.
- **Retrievers on code without comments:**

  | Retriever | Precision@5 | Recall@20 |
  |---|---|---|
  | BM25 | 6.57% | 4.79% |
  | Qwen3-Embedding-8B | 77.29% | not stated |
  | CodeRankEmbed | 91.60% | 88.04% |

  BM25 performed worst, Qwen3-Embedding-8B was strong, and CodeRankEmbed was clearly best.
- **Limitations:** all evaluated models have at most 14B parameters, and the dataset is relatively small per language.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Hong Kong University of Science and Technology](https://md.research.elamur.ai/free/en/universities/hong-kong-university-of-science-and-technology/) — University, Hong Kong, China · 170 works · 26,341 citations
- [Chinese Academy of Sciences](https://md.research.elamur.ai/free/en/government/chinese-academy-of-sciences/) — Government body, Beijing, China · 246 works · 24,951 citations
- [University of Chinese Academy of Sciences](https://md.research.elamur.ai/free/en/universities/university-of-chinese-academy-of-sciences/) — University, Beijing, China · 188 works · 8,743 citations
- [Institute of Software](https://md.research.elamur.ai/free/en/labs/institute-of-software/) — Research institute, Beijing, China · 27 works · 4,979 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,730 works

🧭 Topics (2): [🌍 Multilingual & cross-lingual NLP](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · 882 works · [💻 Code & programming languages](https://md.research.elamur.ai/free/en/topics/code-and-programming/) · 168 works

## Cite

Cite as: Qiming Zhu, Jialun Cao, Xuanang Chen, Weili Zhang, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun and Shing-Chi Cheung. 2026. Across Programming Language Silos: A Study on Cross-Lingual Retrieval-Augmented Code Generation. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhu2026across,
  title = {{Across Programming Language Silos: A Study on Cross-Lingual Retrieval-Augmented Code Generation}},
  author = {Qiming Zhu, Jialun Cao, Xuanang Chen, Weili Zhang, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun and Shing-Chi Cheung},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.1216},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.1216}
}
```

- [← previous ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue](https://md.research.elamur.ai/free/en/papers/shen-2026-acr-adaptive-context-refactoring-context/)
- [next → ACSE: An Ancient Character Semantic-Aware Embedding for Large Language Models](https://md.research.elamur.ai/free/en/papers/zhou-2026-acse-ancient-character-semantic-aware/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/21/)

## References

36 references, 14 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Ben Athiwaratkun, Sanjay Krishna Gouda, Zijian Wang, Xiaopeng Li, Yuchen Tian, Ming Tan, Wasi Uddin Ahmad, Shiqi Wang, Qing Sun, Mingyue Shang, Sujan Kumar Gonugondla, Hantian Ding, Varun Kumar, Nathan Fulton, Arash Farahani, Siddhartha Jain, Robert Giaquinto, Haifeng Qian, Murali Krishna Ramanathan… [find](https://scholar.google.com/scholar?q=Ben+Athiwaratkun%2C+Sanjay+Krishna+Gouda%2C+Zijian+Wang%2C+Xiaopeng+Li%2C+Yuchen+Tian%2C+Ming+Tan%2C+Wasi+Uddin+Ahmad%2C+Shiqi+Wang%2C+Qing+Sun%2C+Mingyue+Shang%2C+Sujan+Kumar+Gonugondla%2C+Hantian+Ding%2C+Varun+Kumar%2C+Natha)
2. Jialun Cao, Yuk-Kit Chan, Zixuan Ling, Wenxuan Wang, Shuqing Li, Mingwei Liu, Ruixi Qiao, Yuting Han, Chaozheng Wang, Boxi Yu, Pinjia He, Shuai Wang, Zibin Zheng, Michael R. Lyu, and Shing-Chi Cheung. 2025. How should I build A benchmark? revisiting code-related benchmarks for llms. CoRR, abs/2501.1… — [arXiv:2501.10711](https://arxiv.org/abs/2501.10711) [find](https://scholar.google.com/scholar?q=Jialun+Cao%2C+Yuk%2DKit+Chan%2C+Zixuan+Ling%2C+Wenxuan+Wang%2C+Shuqing+Li%2C+Mingwei+Liu%2C+Ruixi+Qiao%2C+Yuting+Han%2C+Chaozheng+Wang%2C+Boxi+Yu%2C+Pinjia+He%2C+Shuai+Wang%2C+Zibin+Zheng%2C+Michael+R%2E+Lyu%2C+and+Shing%2DChi+Cheung%2E)
3. Federico Cassano, John Gouwar, Francesca Lucchetti, Claire Schlesinger, Anders Freeman, Carolyn Jane Anderson, Molly Q. Feldman, Michael Greenberg, Abhinav Jangda, and Arjun Guha. 2024. Knowledge transfer from high-resource to low-resource programming languages for code llms. Proc. ACM Program. Lang… [find](https://scholar.google.com/scholar?q=Federico+Cassano%2C+John+Gouwar%2C+Francesca+Lucchetti%2C+Claire+Schlesinger%2C+Anders+Freeman%2C+Carolyn+Jane+Anderson%2C+Molly+Q%2E+Feldman%2C+Michael+Greenberg%2C+Abhinav+Jangda%2C+and+Arjun+Guha%2E+2024%2E+Knowledge+tran)
4. Federico Cassano, John Gouwar, Daniel Nguyen, Sydney Nguyen, Luna Phipps-Costin, Donald Pinckney, Ming-Ho Yee, Yangtian Zi, Carolyn Jane Anderson, Molly Q. Feldman, Arjun Guha, Michael Greenberg, and Abhinav Jangda. 2023. Multipl-e: A scalable and polyglot approach to benchmarking neural code genera… [find](https://scholar.google.com/scholar?q=Federico+Cassano%2C+John+Gouwar%2C+Daniel+Nguyen%2C+Sydney+Nguyen%2C+Luna+Phipps%2DCostin%2C+Donald+Pinckney%2C+Ming%2DHo+Yee%2C+Yangtian+Zi%2C+Carolyn+Jane+Anderson%2C+Molly+Q%2E+Feldman%2C+Arjun+Guha%2C+Michael+Greenberg%2C+and+)
5. Linzheng Chai, Shukai Liu, Jian Yang, Yuwei Yin, Ke Jin, Jiaheng Liu, Tao Sun, Ge Zhang, Changyu Ren, Hongcheng Guo, Noah Wang, Boyang Wang, Xianjie Wu, Bing Wang, Tongliang Li, Liqun Yang, Sufeng Duan, Zhaoxiang Zhang, and Zhoujun Li. 2025. Mceval: Massively multilingual code evaluation. [find](https://scholar.google.com/scholar?q=Linzheng+Chai%2C+Shukai+Liu%2C+Jian+Yang%2C+Yuwei+Yin%2C+Ke+Jin%2C+Jiaheng+Liu%2C+Tao+Sun%2C+Ge+Zhang%2C+Changyu+Ren%2C+Hongcheng+Guo%2C+Noah+Wang%2C+Boyang+Wang%2C+Xianjie+Wu%2C+Bing+Wang%2C+Tongliang+Li%2C+Liqun+Yang%2C+Sufeng+Dua)
6. Jingyi Chen, Songqiang Chen, Jialun Cao, Jiasi Shen, and Shing-Chi Cheung. 2025. When llms meet API documentation: Can retrieval augmentation aid code generation just as it helps developers? CoRR, abs/2503.15231. — [arXiv:2503.15231](https://arxiv.org/abs/2503.15231) [find](https://scholar.google.com/scholar?q=Jingyi+Chen%2C+Songqiang+Chen%2C+Jialun+Cao%2C+Jiasi+Shen%2C+and+Shing%2DChi+Cheung%2E+2025%2E+When+llms+meet+API+documentation%3A+Can+retrieval+augmentation+aid+code+generation+just+as+it+helps+developers%3F+CoRR%2C+abs)
7. Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Pondé de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhai… — [Evaluating Large Language Models Trained on Code](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/)
8. Darko DJurdjev. 2024. Popularity of programming languages. AIDASCO Reviews, 2(2):24–29. [find](https://scholar.google.com/scholar?q=Darko+DJurdjev%2E+2024%2E+Popularity+of+programming+languages%2E+AIDASCO+Reviews%2C+2%282%29%3A24%E2%80%9329%2E)
9. Kounianhua Du, Renting Rui, Huacan Chai, Lingyue Fu, Wei Xia, Yasheng Wang, Ruiming Tang, Yong Yu, and Weinan Zhang. 2024. Codegrag: Extracting composed syntax graphs for retrieval augmented cross-lingual code generation. CoRR, abs/2405.02355. — [arXiv:2405.02355](https://arxiv.org/abs/2405.02355) [find](https://scholar.google.com/scholar?q=Kounianhua+Du%2C+Renting+Rui%2C+Huacan+Chai%2C+Lingyue+Fu%2C+Wei+Xia%2C+Yasheng+Wang%2C+Ruiming+Tang%2C+Yong+Yu%2C+and+Weinan+Zhang%2E+2024%2E+Codegrag%3A+Extracting+composed+syntax+graphs+for+retrieval+augmented+cross%2Dlin)
10. Avik Dutta, Mukul Singh, Gust Verbruggen, Sumit Gulwani, and Vu Le. 2024. RAR: retrieval-augmented retrieval for code generation in low resource languages. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024, Miami, FL, USA, November 12-16, 2024, pag… [find](https://scholar.google.com/scholar?q=Avik+Dutta%2C+Mukul+Singh%2C+Gust+Verbruggen%2C+Sumit+Gulwani%2C+and+Vu+Le%2E+2024%2E+RAR%3A+retrieval%2Daugmented+retrieval+for+code+generation+in+low+resource+languages%2E+In+Proceedings+of+the+2024+Conference+on+Emp)
11. Vladimir Filkov, Baishakhi Ray, and Minghui Zhou, editors. 2024. Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering, ASE 2024, Sacramento, CA, USA, October 27 - November 1, 2024. ACM. [find](https://scholar.google.com/scholar?q=Vladimir+Filkov%2C+Baishakhi+Ray%2C+and+Minghui+Zhou%2C+editors%2E+2024%2E+Proceedings+of+the+39th+IEEE%2FACM+International+Conference+on+Automated+Software+Engineering%2C+ASE+2024%2C+Sacramento%2C+CA%2C+USA%2C+October+27+)
12. Tianyu Gao, Xingcheng Yao, and Danqi Chen. 2021. [Simcse: Simple contrastive learning of sentence embeddings](https://md.research.elamur.ai/free/en/papers/gao-2021-simcse-simple-contrastive-learning-sentence/). In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021, pages 6894– 6910. A…
13. Alex Gu, Baptiste Rozière, Hugh James Leather, Armando Solar-Lezama, Gabriel Synnaeve, and Sida Wang. 2024. [Cruxeval: A benchmark for code reasoning, understanding and execution](https://md.research.elamur.ai/free/en/papers/gu-2024-cruxeval-benchmark-code-reasoning-understanding/). In Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024, Proceedings of…
14. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020. [Retrieval-augmented generation for knowledge-intensive NLP tasks](https://md.research.elamur.ai/free/en/papers/lewis-2020-retrieval-augmented-generation-knowledge-intensive/). In Advances in Neural Information Proc…
15. Jia Li, Chongyang Tao, Jia Li Male, Ge Li, Zhi Jin, Huangzhao Zhang, Zheng Fang, and Fang Liu. 2025a. Large language model-aware in-context learning for code generation. ACM Trans. Softw. Eng. Methodol., 34(7):190:1–190:33. [find](https://scholar.google.com/scholar?q=Jia+Li%2C+Chongyang+Tao%2C+Jia+Li+Male%2C+Ge+Li%2C+Zhi+Jin%2C+Huangzhao+Zhang%2C+Zheng+Fang%2C+and+Fang+Liu%2E+2025a%2E+Large+language+model%2Daware+in%2Dcontext+learning+for+code+generation%2E+ACM+Trans%2E+Softw%2E+Eng%2E+Methodo)
16. Xinze Li, Hanbin Wang, Zhenghao Liu, Shi Yu, Shuo Wang, Yukun Yan, Yukai Fu, Yu Gu, and Ge Yu. 2025b. Building a coding assistant via the retrieval-augmented language model. ACM Trans. Inf. Syst., 43(2):39:1–39:25. [find](https://scholar.google.com/scholar?q=Xinze+Li%2C+Hanbin+Wang%2C+Zhenghao+Liu%2C+Shi+Yu%2C+Shuo+Wang%2C+Yukun+Yan%2C+Yukai+Fu%2C+Yu+Gu%2C+and+Ge+Yu%2E+2025b%2E+Building+a+coding+assistant+via+the+retrieval%2Daugmented+language+model%2E+ACM+Trans%2E+Inf%2E+Syst%2E%2C+43%28)
17. Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, and Yin Tat Lee. 2023. [Textbooks are all you need II: phi-1.5 technical report](https://md.research.elamur.ai/free/en/papers/li-2023-textbooks-all-need-ii-phi/). CoRR, abs/2309.05463.
18. Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio César Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, Sébastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Yin Tat Lee, and Yuanzhi… [find](https://scholar.google.com/scholar?q=Suriya+Gunasekar%2C+Yi+Zhang%2C+Jyoti+Aneja%2C+Caio+C%C3%A9sar+Teodoro+Mendes%2C+Allie+Del+Giorno%2C+Sivakanth+Gopi%2C+Mojan+Javaheripi%2C+Piero+Kauffmann%2C+Gustavo+de+Rosa%2C+Olli+Saarikivi%2C+Adil+Salim%2C+Shital+Shah%2C+Harki)
19. Shuai Lu, Nan Duan, Hojae Han, Daya Guo, Seung-won Hwang, and Alexey Svyatkovskiy. 2022. [Reacc: A retrieval-augmented code completion framework](https://md.research.elamur.ai/free/en/papers/lu-2022-reacc-retrieval-augmented-code-completion/). In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2…
20. Daya Guo, Qihao Zhu, Dejian Yang, Zhenda Xie, Kai Dong, Wentao Zhang, Guanting Chen, Xiao Bi, Y. Wu, Y. K. Li, Fuli Luo, Yingfei Xiong, and Wenfeng Liang. 2024. Deepseek-coder: When the large language model meets programming - the rise of code intelligence. CoRR, abs/2401.14196. [find](https://scholar.google.com/scholar?q=Daya+Guo%2C+Qihao+Zhu%2C+Dejian+Yang%2C+Zhenda+Xie%2C+Kai+Dong%2C+Wentao+Zhang%2C+Guanting+Chen%2C+Xiao+Bi%2C+Y%2E+Wu%2C+Y%2E+K%2E+Li%2C+Fuli+Luo%2C+Yingfei+Xiong%2C+and+Wenfeng+Liang%2E+2024%2E+Deepseek%2Dcoder%3A+When+the+large+language)
21. Philip Mayer, Michael Kirsch, and Minh Anh Le. 2017. On multi-language software development, cross-language links and accompanying tools: a survey of professional software developers. J. Softw. Eng. Res. Dev., 5:1. [find](https://scholar.google.com/scholar?q=Philip+Mayer%2C+Michael+Kirsch%2C+and+Minh+Anh+Le%2E+2017%2E+On+multi%2Dlanguage+software+development%2C+cross%2Dlanguage+links+and+accompanying+tools%3A+a+survey+of+professional+software+developers%2E+J%2E+Softw%2E+Eng%2E+R)
22. Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Ming-Wei Chang. 2020. [Retrieval augmented language model pre-training](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/). In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event, Proceedings of Machine Learning Research, pages 3929– 39…
23. Binyuan Hui, Jian Yang, Zeyu Cui, Jiaxi Yang, Dayiheng Liu, Lei Zhang, Tianyu Liu, Jiajun Zhang, Bowen Yu, Kai Dang, An Yang, Rui Men, Fei Huang, Xingzhang Ren, Xuancheng Ren, Jingren Zhou, and Junyang Lin. 2024. [Qwen2.5-coder technical report](https://md.research.elamur.ai/free/en/papers/hui-2024-qwen2-5-coder-technical-report/). CoRR, abs/2409.12186.
24. Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R. Narasimhan. 2024. [Swe-bench: Can language models resolve real-world github issues?](https://md.research.elamur.ai/free/en/papers/jimenez-2024-swe-bench-can-language-models/) In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenRe…
25. Md. Rizwan Parvez, Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, and Kai-Wei Chang. 2021. [Retrieval augmented code generation and summarization](https://md.research.elamur.ai/free/en/papers/parvez-2021-retrieval-augmented-code-generation-summarization/). In Findings of the Association for Computational Linguistics: EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 16-20 November, 2021, Find…
26. Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, Sten Sootla, Itai Gat, Xiaoqing Ellen Tan, Yossi Adi, Jingyu Liu, Tal Remez, Jérémy Rapin, Artyom Kozhevnikov, Ivan Evtimov, Joanna Bitton, Manish Bhatt, Cristian Canton-Ferrer, Aaron Grattafiori, Wenhan Xiong, Alexandre Défossez, Jade Copet, Faisal… — [Code Llama: Open Foundation Models for Code](https://md.research.elamur.ai/free/en/papers/roziere-2024-code-llama-open-foundation-models/)
27. Xiaotao Song, Hailong Sun, Xu Wang, and Jiafei Yan. 2019. A survey of automatic generation of source code comments: Algorithms and techniques. IEEE Access, 7:111411–111428. [find](https://scholar.google.com/scholar?q=Xiaotao+Song%2C+Hailong+Sun%2C+Xu+Wang%2C+and+Jiafei+Yan%2E+2019%2E+A+survey+of+automatic+generation+of+source+code+comments%3A+Algorithms+and+techniques%2E+IEEE+Access%2C+7%3A111411%E2%80%93111428%2E)
28. Hongjin Su, Shuyang Jiang, Yuhang Lai, Haoyuan Wu, Boao Shi, Che Liu, Qian Liu, and Tao Yu. 2024. Evor: Evolving retrieval for code generation. In Findings of the Association for Computational Linguistics: EMNLP 2024, Miami, Florida, USA, November 12-16, 2024, Findings of ACL, pages 2538–2554. Assoc… [find](https://scholar.google.com/scholar?q=Hongjin+Su%2C+Shuyang+Jiang%2C+Yuhang+Lai%2C+Haoyuan+Wu%2C+Boao+Shi%2C+Che+Liu%2C+Qian+Liu%2C+and+Tao+Yu%2E+2024%2E+Evor%3A+Evolving+retrieval+for+code+generation%2E+In+Findings+of+the+Association+for+Computational+Linguis)
29. Tarun Suresh, Revanth Gangi Reddy, Yifei Xu, Zach Nussbaum, Andriy Mulyar, Brandon Duderstadt, and Heng Ji. 2024. Cornstack: High-quality contrastive data for better code ranking. CoRR, abs/2412.01007. — [arXiv:2412.01007](https://arxiv.org/abs/2412.01007) [find](https://scholar.google.com/scholar?q=Tarun+Suresh%2C+Revanth+Gangi+Reddy%2C+Yifei+Xu%2C+Zach+Nussbaum%2C+Andriy+Mulyar%2C+Brandon+Duderstadt%2C+and+Heng+Ji%2E+2024%2E+Cornstack%3A+High%2Dquality+contrastive+data+for+better+code+ranking%2E+CoRR%2C+abs%2F2412%2E01007)
30. Hanzhuo Tan, Qi Luo, Ling Jiang, Zizheng Zhan, Jing Li, Haotian Zhang, and Yuqun Zhang. 2026. Prompt-based code completion via multi-retrieval augmented generation. ACM Trans. Softw. Eng. Methodol., 35(1):9:1–9:28. [find](https://scholar.google.com/scholar?q=Hanzhuo+Tan%2C+Qi+Luo%2C+Ling+Jiang%2C+Zizheng+Zhan%2C+Jing+Li%2C+Haotian+Zhang%2C+and+Yuqun+Zhang%2E+2026%2E+Prompt%2Dbased+code+completion+via+multi%2Dretrieval+augmented+generation%2E+ACM+Trans%2E+Softw%2E+Eng%2E+Methodol%2E%2C+3)
31. Zora Zhiruo Wang, Akari Asai, Xinyan Velocity Yu, Frank F. Xu, Yiqing Xie, Graham Neubig, and Daniel Fried. 2025. Coderag-bench: Can retrieval augment code generation? In Findings of the Association for Computational Linguistics: NAACL 2025, Albuquerque, New Mexico, USA, April 29 - May 4, 2025, Find… [find](https://scholar.google.com/scholar?q=Zora+Zhiruo+Wang%2C+Akari+Asai%2C+Xinyan+Velocity+Yu%2C+Frank+F%2E+Xu%2C+Yiqing+Xie%2C+Graham+Neubig%2C+and+Daniel+Fried%2E+2025%2E+Coderag%2Dbench%3A+Can+retrieval+augment+code+generation%3F+In+Findings+of+the+Association+f)
32. Shitao Xiao, Zheng Liu, Peitian Zhang, and Niklas Muennighoff. 2023. [C-pack: Packaged resources to advance general chinese embedding](https://md.research.elamur.ai/free/en/papers/xiao-2023-c-pack-packed-resources/). CoRR, abs/2309.07597.
33. Ruiyang Xu, Jialun Cao, Yaojie Lu, Ming Wen, Hongyu Lin, Xianpei Han, Ben He, Shing-Chi Cheung, and Le Sun. 2025. CRUXEVAL-X: A benchmark for multilingual code reasoning, understanding and execution. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1… [find](https://scholar.google.com/scholar?q=Ruiyang+Xu%2C+Jialun+Cao%2C+Yaojie+Lu%2C+Ming+Wen%2C+Hongyu+Lin%2C+Xianpei+Han%2C+Ben+He%2C+Shing%2DChi+Cheung%2C+and+Le+Sun%2E+2025%2E+CRUXEVAL%2DX%3A+A+benchmark+for+multilingual+code+reasoning%2C+understanding+and+execution%2E+)
34. Qinkai Zheng, Xiao Xia, Xu Zou, Yuxiao Dong, Shan Wang, Yufei Xue, Lei Shen, Zihan Wang, Andi Wang, Yang Li, Teng Su, Zhilin Yang, and Jie Tang. 2023. [Codegeex: A pre-trained model for code generation with multilingual benchmarking on humaneval-x](https://md.research.elamur.ai/free/en/papers/zheng-2023-codegeex-pre-trained-model-code/). In Proceedings of the 29th ACM SIGKDD Conference on…
35. Shuyan Zhou, Uri Alon, Frank F. Xu, Zhengbao Jiang, and Graham Neubig. 2023. Docprompting: Generating code by retrieving the docs. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net. [find](https://scholar.google.com/scholar?q=Shuyan+Zhou%2C+Uri+Alon%2C+Frank+F%2E+Xu%2C+Zhengbao+Jiang%2C+and+Graham+Neubig%2E+2023%2E+Docprompting%3A+Generating+code+by+retrieving+the+docs%2E+In+The+Eleventh+International+Conference+on+Learning+Representations%2C)
36. Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari, Imam Nur Bani Yusuf, Haolan Zhan, Junda He, Indraneil Paul, Simon Brunner, Chen Gong, James Hoang, Armel Randy Zebaze, Xiaoheng Hong, Wen-Ding Li, Jean Kaddour, Ming Xu, Zhihan Zhang, Prateek Yadav, and et al. 2025. B… — [BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions](https://md.research.elamur.ai/free/en/papers/zhuo-2024-bigcodebench-benchmarking-code-generation-diverse/)

*Updated 2 November 2026*