---
title: "Domain-Specific Data Generation Framework for RAG Adaptation"
description: "The authors present RAGen, a data-centric framework that turns raw domain documents into question–answer–context (QAC)… 40 references."
authors: ["Chris Xing Tian", "Weihao Xie", "Zhen Chen", "Hui Liu", "Zhengyuan Yi", "Haoliang Li", "Shiqi Wang", "Siwei Ma"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: ACL 2026"
source: "https://aclanthology.org/2026.findings-acl.960/"
doi: "10.18653/v1/2026.findings-acl.960"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/tian-2026-domain-specific-data-generation-framework/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/tian-2026-domain-specific-data-generation-framework/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/28/) / Domain-Specific Data Generation Framework for RAG Adaptation

# Domain-Specific Data Generation Framework for RAG Adaptation

**Authors:** [Chris Xing Tian](https://md.research.elamur.ai/free/en/authors/chris-xing-tian/), Weihao Xie, [Zhen Chen](https://md.research.elamur.ai/free/en/authors/zhen-chen/), [Hui Liu](https://md.research.elamur.ai/free/en/authors/hui-liu/), Zhengyuan Yi, [Haoliang Li](https://md.research.elamur.ai/free/en/authors/haoliang-li/), Shiqi Wang and Siwei Ma · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.960/) · [PDF](https://aclanthology.org/2026.findings-acl.960.pdf) · [DOI 10.18653/v1/2026.findings-acl.960](https://doi.org/10.18653/v1/2026.findings-acl.960) · [OpenAlex](https://openalex.org/W7166871976)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Off-the-shelf RAG pipelines often perform poorly in specialised domains. Adapting their components, such as the embedding model or the generator LLM, requires domain-grounded training data, which is rarely available. The authors present RAGen, a data-centric framework that turns raw domain documents into question–answer–context (QAC) triples for adapting several RAG components at once. The pipeline works in three stages:
- It splits documents into semantic chunks and extracts concepts from each chunk with ChatGPT-4o.
- It merges these into document-level concepts by embedding them with OpenAI Ada and clustering with K-means.
- For each concept, it retrieves evidence from multiple chunks and generates questions at different Bloom's Taxonomy levels, each paired with answers and context variants that include distractors.

The resulting data serves two purposes: training embedding models with a contrastive objective and adapting Qwen2.5 LLMs through supervised training. Across three domains, RAGen data improves both retrieval and answer quality compared with datasets built using AutoRAG and LlamaIndex. Training with distractors makes the generator more robust to noisy retrieval. This matters for organisations that run smaller local models over private, changing knowledge bases.

## Key points
- **Pipeline components:**
  - Chunking uses the llamaindex chunker.
  - The number of document-level concepts K is a manually set hyperparameter.
  - Each question comes with four context types: fully supportive, partially supportive, irrelevant and misleading.
- **Evaluation setup:** experiments cover three domains (PPFS, TradePolicy, BusinessAI). Retrieval is compared against Vanilla, AutoRAG and LlamaIndex baselines, with results averaged over 3 runs.
- **Retrieval:** the fine-tuned embedding model trained on RAGen data scored highest on every reported retrieval metric in all three domains.
- **Generation:**
  - Qwen2.5-1.5B/3B Instruct models fine-tuned on RAGen data beat the baselines on both ROUGE-L and BERT-F1 in all settings.
  - RAGen's ROUGE-L ranged from about 0.34 to 0.40, while the best baseline scores ranged from about 0.27 to 0.36.
- **Distractor training:** on PPFS, Qwen2.5-3B was tested with real top-3 retrieval. Adding distractors during training raised ROUGE-L from 0.3143 to 0.4074 and BERT-F1 from 0.8957 to 0.9121.
- **Limitations:**
  - The pipeline handles text-only input.
  - Errors from early stages can propagate to later ones.
  - The evaluation includes no human study.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Peking University](https://md.research.elamur.ai/free/en/universities/peking-university/) — University, Beijing, China · 244 works · 39,359 citations
- [City University of Hong Kong](https://md.research.elamur.ai/free/en/universities/city-university-of-hong-kong/) — University, Hong Kong, China · 45 works · 3,014 citations
- [Peng Cheng Laboratory](https://md.research.elamur.ai/free/en/labs/peng-cheng-laboratory/) — Research institute, Shenzhen, China · 38 works · 2,504 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works

## Cite

Cite as: Chris Xing Tian, Weihao Xie, Zhen Chen, Hui Liu, Zhengyuan Yi, Haoliang Li, Shiqi Wang and Siwei Ma. 2026. Domain-Specific Data Generation Framework for RAG Adaptation. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{tian2026domain,
  title = {{Domain-Specific Data Generation Framework for RAG Adaptation}},
  author = {Chris Xing Tian, Weihao Xie, Zhen Chen, Hui Liu, Zhengyuan Yi, Haoliang Li, Shiqi Wang and Siwei Ma},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.960},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.960}
}
```

- [← previous Domain-Aware Error Correction for Citation NER in Medieval Hebrew Responsa](https://md.research.elamur.ai/free/en/papers/liebeskind-2026-domain-aware-error-correction-citation/)
- [next → Don't Just Listen, Try Planning: Graph-based Retrieval-Generation Agent for Long-form Audio Meeting Understanding](https://md.research.elamur.ai/free/en/papers/tang-2026-don-t-just-listen-try/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/28/)

## References

40 references, 20 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi. 2023. [Self-rag: Learning to retrieve, generate, and critique through self-reflection](https://md.research.elamur.ai/free/en/papers/asai-2023-self-rag-learning-retrieve-generate/). In The Twelfth International Conference on Learning Representations.
2. BAAI. 2024. Bge large en v1.5 model. [https://huggingface.co/BAAI/bge-large-en-v1.5](https://huggingface.co/BAAI/bge-large-en-v1.5). [↗](https://huggingface.co/BAAI/bge-large-en-v1.5)
3. BAAI. 2025. Flag embedding. [https://github.com/](https://github.com/) FlagOpen/FlagEmbedding. [↗](https://github.com/)
4. Scott Barnett, Stefanus Kurniawan, Srikanth Thudumu, Zach Brannelly, and Mohamed Abdelrazek. 2024. Seven failure points when engineering a retrieval augmented generation system. In Proceedings of the IEEE/ACM 3rd International Conference on AI Engineering-Software Engineering for AI, pages 194– 199. [find](https://scholar.google.com/scholar?q=Scott+Barnett%2C+Stefanus+Kurniawan%2C+Srikanth+Thudumu%2C+Zach+Brannelly%2C+and+Mohamed+Abdelrazek%2E+2024%2E+Seven+failure+points+when+engineering+a+retrieval+augmented+generation+system%2E+In+Proceedings+of+the+)
5. Jian Chen, Peilin Zhou, Yining Hua, Yingxin Loh, Kehui Chen, Ziyuan Li, Bing Zhu, and Junwei Liang. 2024a. Fintextqa: A dataset for long-form financial question answering. arXiv preprint arXiv:2405.09980. [find](https://scholar.google.com/scholar?q=Jian+Chen%2C+Peilin+Zhou%2C+Yining+Hua%2C+Yingxin+Loh%2C+Kehui+Chen%2C+Ziyuan+Li%2C+Bing+Zhu%2C+and+Junwei+Liang%2E+2024a%2E+Fintextqa%3A+A+dataset+for+long%2Dform+financial+question+answering%2E+arXiv+preprint+arXiv%3A2405%2E09)
6. Jianlv Chen, Shitao Xiao, Peitian Zhang, Kun Luo, Defu Lian, and Zheng Liu. 2024b. [Bge m3-embedding: Multi-lingual, multi-functionality, multi-granularity text embeddings through self-knowledge distillation](https://md.research.elamur.ai/free/en/papers/chen-2024-m3-embedding-multi-linguality/). arXiv preprint arXiv:2402.03216.
7. Jiawei Chen, Hongyu Lin, Xianpei Han, and Le Sun. 2024c. [Benchmarking large language models in retrieval-augmented generation](https://md.research.elamur.ai/free/en/papers/chen-2023-benchmarking-large-language-models-retrieval/). In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 17754–17762.
8. Filippo Chiarello, Vito Giordano, Irene Spada, Simone Barandoni, and Gualtiero Fantoni. 2024. Future applications of generative large language models: A data-driven case study on chatgpt. Technovation, 133:103002. [find](https://scholar.google.com/scholar?q=Filippo+Chiarello%2C+Vito+Giordano%2C+Irene+Spada%2C+Simone+Barandoni%2C+and+Gualtiero+Fantoni%2E+2024%2E+Future+applications+of+generative+large+language+models%3A+A+data%2Ddriven+case+study+on+chatgpt%2E+Technovation)
9. Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith, and Matt Gardner. 2021. [A dataset of information-seeking questions and answers anchored in research papers](https://md.research.elamur.ai/free/en/papers/dasigi-2021-dataset-information-seeking-questions-answers/).
10. Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, Dasha Metropolitansky, Robert Osazuwa Ness, and Jonathan Larson. 2024. From local to global: A graph rag approach to query-focused summarization. arXiv preprint arXiv:2404.16130. [find](https://scholar.google.com/scholar?q=Darren+Edge%2C+Ha+Trinh%2C+Newman+Cheng%2C+Joshua+Bradley%2C+Alex+Chao%2C+Apurva+Mody%2C+Steven+Truitt%2C+Dasha+Metropolitansky%2C+Robert+Osazuwa+Ness%2C+and+Jonathan+Larson%2E+2024%2E+From+local+to+global%3A+A+graph+rag+app)
11. Shahul Es, Jithin James, Luis Espinosa Anke, and Steven Schockaert. 2024. [RAGAs: Automated evaluation of retrieval augmented generation](https://md.research.elamur.ai/free/en/papers/es-2023-ragas-automated-evaluation-retrieval-augmented/). In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, pages 150–158, St. Julians,…
12. Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, and 1 others. 2022. [Lora: Low-rank adaptation of large language models](https://md.research.elamur.ai/free/en/papers/hu-2021-lora-low-rank-adaptation-large/). ICLR, 1(2):3.
13. Seonjeong Hwang, Yunsu Kim, and Gary Geunbae Lee. 2024. Explainable multi-hop question generation: An end-to-end approach without intermediate question labeling. arXiv preprint arXiv:2404.00571. [find](https://scholar.google.com/scholar?q=Seonjeong+Hwang%2C+Yunsu+Kim%2C+and+Gary+Geunbae+Lee%2E+2024%2E+Explainable+multi%2Dhop+question+generation%3A+An+end%2Dto%2Dend+approach+without+intermediate+question+labeling%2E+arXiv+preprint+arXiv%3A2404%2E00571%2E)
14. Shayekh Bin Islam, Md Asib Rahman, KSM Hossain, Enamul Hoque, Shafiq Joty, and Md Rizwan Parvez. 2024. Open-rag: Enhanced retrieval-augmented reasoning with open-source large language models. arXiv preprint arXiv:2410.01782. [find](https://scholar.google.com/scholar?q=Shayekh+Bin+Islam%2C+Md+Asib+Rahman%2C+KSM+Hossain%2C+Enamul+Hoque%2C+Shafiq+Joty%2C+and+Md+Rizwan+Parvez%2E+2024%2E+Open%2Drag%3A+Enhanced+retrieval%2Daugmented+reasoning+with+open%2Dsource+large+language+models%2E+arXiv+pr)
15. Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick SH Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. 2020. [Dense passage retrieval for open-domain question answering](https://md.research.elamur.ai/free/en/papers/karpukhin-2020-dense-passage-retrieval-open-domain/). In EMNLP (1), pages 6769–6781.
16. Dongkyu Kim, Byoungwook Kim, Donggeon Han, and Matouš Eibich. 2024. Autorag: Automated framework for optimization of retrieval augmented generation pipeline. Preprint, arXiv:2410.20878. — [arXiv:2410.20878](https://arxiv.org/abs/2410.20878) [find](https://scholar.google.com/scholar?q=Dongkyu+Kim%2C+Byoungwook+Kim%2C+Donggeon+Han%2C+and+Matou%C5%A1+Eibich%2E+2024%2E+Autorag%3A+Automated+framework+for+optimization+of+retrieval+augmented+generation+pipeline%2E+Preprint%2C+arXiv%3A2410%2E20878%2E+%E2%80%94+%5BarXiv%3A2410%2E)
17. David R Krathwohl. 2002. A revision of bloom’s taxonomy: An overview. Theory into practice, 41(4):212– 218. [find](https://scholar.google.com/scholar?q=David+R+Krathwohl%2E+2002%2E+A+revision+of+bloom%E2%80%99s+taxonomy%3A+An+overview%2E+Theory+into+practice%2C+41%284%29%3A212%E2%80%93+218%2E)
18. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, and 1 others. 2020. [Retrieval-augmented generation for knowledge-intensive nlp tasks](https://md.research.elamur.ai/free/en/papers/lewis-2020-retrieval-augmented-generation-knowledge-intensive/). Advances in neural information processing systems, 33:9459–…
19. Hui Liu, Wenya Wang, Hao Sun, Chris Xing Tian, Chenqi Kong, Xin Dong, and Haoliang Li. 2025. [Unraveling the mechanics of learning-based demonstration selection for in-context learning](https://md.research.elamur.ai/free/en/papers/liu-2025-unraveling-mechanics-learning-based-demonstration/). In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers),…
20. LlamaIndex. 2025. Llamaindex datasetgenerator. [https://developers.llamaindex.ai/python/](https://developers.llamaindex.ai/python/) framework-api-reference/evaluation/ dataset_generation/. [↗](https://developers.llamaindex.ai/python/)
21. Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Daniel Khashabi, and Hannaneh Hajishirzi. 2022. When not to trust language models: Investigating effectiveness of parametric and non-parametric memories. arXiv preprint arXiv:2212.10511. [find](https://scholar.google.com/scholar?q=Alex+Mallen%2C+Akari+Asai%2C+Victor+Zhong%2C+Rajarshi+Das%2C+Daniel+Khashabi%2C+and+Hannaneh+Hajishirzi%2E+2022%2E+When+not+to+trust+language+models%3A+Investigating+effectiveness+of+parametric+and+non%2Dparametric+mem)
22. Aaron van den Oord, Yazhe Li, and Oriol Vinyals. 2018. [Representation learning with contrastive predictive coding](https://md.research.elamur.ai/free/en/papers/oord-2018-representation-learning-contrastive-predictive-coding/). arXiv preprint arXiv:1807.03748.
23. OpenAI. 2025a. Openai chatgpt4o. //platform.openai.com/docs/models/ chatgpt-4o-latest. https: [find](https://scholar.google.com/scholar?q=OpenAI%2E+2025a%2E+Openai+chatgpt4o%2E+%2F%2Fplatform%2Eopenai%2Ecom%2Fdocs%2Fmodels%2F+chatgpt%2D4o%2Dlatest%2E+https%3A)
24. OpenAI. 2025b. Openai embedding api. [https://platform.openai.com/docs/models/](https://platform.openai.com/docs/models/) text-embedding-ada-002. [↗](https://platform.openai.com/docs/models/)
25. Crystal Qian, Michael Xieyang Liu, Emily Reif, Grady Simon, Nada Hussein, Nathan Clement, James Wexler, Carrie J Cai, Michael Terry, and Minsuk Kahng. 2024. The evolution of llm adoption in industry data curation practices. arXiv preprint arXiv:2412.16089. — [arXiv:2412.16089](https://arxiv.org/abs/2412.16089) [find](https://scholar.google.com/scholar?q=Crystal+Qian%2C+Michael+Xieyang+Liu%2C+Emily+Reif%2C+Grady+Simon%2C+Nada+Hussein%2C+Nathan+Clement%2C+James+Wexler%2C+Carrie+J+Cai%2C+Michael+Terry%2C+and+Minsuk+Kahng%2E+2024%2E+The+evolution+of+llm+adoption+in+industry+d)
26. Qwen, An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, and 24 others. 2025. Qwen2.5 Technical Report. arXiv preprint. ArXiv:2… [find](https://scholar.google.com/scholar?q=Qwen%2C+An+Yang%2C+Baosong+Yang%2C+Beichen+Zhang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+Haoran+Wei%2C+Huan+Lin%2C+Jian+Yang%2C+Jianhong+Tu%2C+Jianwei+Zhang%2C+Jianxin+Yang%2C+Jiaxi+Yan)
27. Parth Sarthi, Salman Abdullah, Aditi Tuli, Shubh Khanna, Anna Goldie, and Christopher D Manning. 2024. [Raptor: Recursive abstractive processing for tree-organized retrieval](https://md.research.elamur.ai/free/en/papers/sarthi-2024-raptor-recursive-abstractive-processing-tree/). In The Twelfth International Conference on Learning Representations.
28. Shamane Siriwardhana, Rivindu Weerasekera, Elliott Wen, Tharindu Kaluarachchi, Rajib Rana, and Suranga Nanayakkara. 2023. [Improving the domain adaptation of retrieval augmented generation (rag) models for open domain question answering](https://md.research.elamur.ai/free/en/papers/siriwardhana-2023-improving-domain-adaptation-retrieval-augmented/). Transactions of the Association for Computational Linguistics,…
29. Huatong Song, Jinhao Jiang, Yingqian Min, Jie Chen, Zhipeng Chen, Wayne Xin Zhao, Lei Fang, and Ji-Rong Wen. 2025. [R1-searcher: Incentivizing the search capability in llms via reinforcement learning](https://md.research.elamur.ai/free/en/papers/song-2025-r1-searcher-incentivizing-search/). arXiv preprint arXiv:2503.05592.
30. Asahi Ushio, Fernando Alva-Manchego, and Jose Camacho-Collados. 2023. An empirical comparison of lm-based question and answer generation methods. arXiv preprint arXiv:2305.17002. [find](https://scholar.google.com/scholar?q=Asahi+Ushio%2C+Fernando+Alva%2DManchego%2C+and+Jose+Camacho%2DCollados%2E+2023%2E+An+empirical+comparison+of+lm%2Dbased+question+and+answer+generation+methods%2E+arXiv+preprint+arXiv%3A2305%2E17002%2E)
31. Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, and Furu Wei. 2022. [Text embeddings by weakly-supervised contrastive pre-training](https://md.research.elamur.ai/free/en/papers/wang-2022-text-embeddings-weakly-supervised-contrastive/). arXiv preprint arXiv:2212.03533.
32. Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, and Furu Wei. 2023. [Improving text embeddings with large language models](https://md.research.elamur.ai/free/en/papers/wang-2024-improving-text-embeddings-large-language/). arXiv preprint arXiv:2401.00368.
33. Shitao Xiao, Zheng Liu, Peitian Zhang, and Niklas Muennighoff. 2023. [C-pack: Packaged resources to advance general chinese embedding](https://md.research.elamur.ai/free/en/papers/xiao-2023-c-pack-packed-resources/). Preprint, arXiv:2309.07597.
34. Xiang Yue, Xinliang Frederick Zhang, Ziyu Yao, Simon Lin, and Huan Sun. 2021. Cliniqg4qa: Generating diverse questions for domain adaptation of clinical question answering. In 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pages 580–587. IEEE. [find](https://scholar.google.com/scholar?q=Xiang+Yue%2C+Xinliang+Frederick+Zhang%2C+Ziyu+Yao%2C+Simon+Lin%2C+and+Huan+Sun%2E+2021%2E+Cliniqg4qa%3A+Generating+diverse+questions+for+domain+adaptation+of+clinical+question+answering%2E+In+2021+IEEE+International+)
35. Mingtian Zhang, Shawn Lan, Peter Hayes, and David Barber. 2024a. Mafin: Enhancing black-box embeddings with model augmented fine-tuning. arXiv preprint arXiv:2402.12177. — [arXiv:2402.12177](https://arxiv.org/abs/2402.12177) [find](https://scholar.google.com/scholar?q=Mingtian+Zhang%2C+Shawn+Lan%2C+Peter+Hayes%2C+and+David+Barber%2E+2024a%2E+Mafin%3A+Enhancing+black%2Dbox+embeddings+with+model+augmented+fine%2Dtuning%2E+arXiv+preprint+arXiv%3A2402%2E12177%2E+%E2%80%94+%5BarXiv%3A2402%2E12177%5D%28https%3A%2F%2Fa)
36. Peitian Zhang, Zheng Liu, Shitao Xiao, Ninglu Shao, Qiwei Ye, and Zhicheng Dou. 2024b. [Soaring from 4k to 400k: Extending llm’s context with activation beacon](https://md.research.elamur.ai/free/en/papers/zhang-2024-long-context-compression-activation-beacon/). arXiv preprint arXiv:2401.03462, 2(3):5.
37. Peitian Zhang, Shitao Xiao, Zheng Liu, Zhicheng Dou, and Jian-Yun Nie. 2023. Retrieve anything to augment large language models. Preprint, arXiv:2310.07554. — [arXiv:2310.07554](https://arxiv.org/abs/2310.07554) [find](https://scholar.google.com/scholar?q=Peitian+Zhang%2C+Shitao+Xiao%2C+Zheng+Liu%2C+Zhicheng+Dou%2C+and+Jian%2DYun+Nie%2E+2023%2E+Retrieve+anything+to+augment+large+language+models%2E+Preprint%2C+arXiv%3A2310%2E07554%2E+%E2%80%94+%5BarXiv%3A2310%2E07554%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F)
38. Tianjun Zhang, Shishir G Patil, Naman Jain, Sheng Shen, Matei Zaharia, Ion Stoica, and Joseph E Gonzalez. 2024c. [Raft: Adapting language model to domain specific rag](https://md.research.elamur.ai/free/en/papers/zhang-2024-raft-adapting-language-model-domain/). In First Conference on Language Modeling.
39. Yaowei Zheng, Richong Zhang, Junhao Zhang, Yanhan Ye, Zheyan Luo, Zhangchi Feng, and Yongqiang Ma. 2024. [Llamafactory: Unified efficient fine-tuning of 100+ language models](https://md.research.elamur.ai/free/en/papers/zheng-2024-llamafactory-unified-efficient-fine-tuning/). arXiv preprint arXiv:2403.13372.
40. Kunlun Zhu, Yifan Luo, Dingling Xu, Yukun Yan, Zhenghao Liu, Shi Yu, Ruobing Wang, Shuo Wang, Yishan Li, Nan Zhang, and 1 others. 2024. [Rageval: Scenario specific rag evaluation dataset generation framework](https://md.research.elamur.ai/free/en/papers/zhu-2025-rageval-scenario-specific-rag-evaluation/). arXiv preprint arXiv:2408.01262.

*Updated 1 November 2026*