--- title: "The Data Frontier for Large Language Models: Selection," description: "It argues that LLM progress now depends more on training data (its quality, variety, and mixture) than on sheer volume, and that collecting…" authors: ["Lijun Wu", "Wentao Zhang", "Conghui He"] year: 2026 venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts)" source: "https://aclanthology.org/2026.acl-tutorials.2/" doi: "10.18653/v1/2026.acl-tutorials.2" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/wu-2026-data-frontier-large-language-models/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wu-2026-data-frontier-large-language-models/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/52/) / The Data Frontier for Large Language Models: Selection, Synthesis, and Tools # The Data Frontier for Large Language Models: Selection, Synthesis, and Tools **Authors:** [Lijun Wu](https://md.research.elamur.ai/free/en/authors/lijun-wu/), [Wentao Zhang](https://md.research.elamur.ai/free/en/authors/wentao-zhang/) and [Conghui He](https://md.research.elamur.ai/free/en/authors/conghui-he/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.acl-tutorials.2/) · [PDF](https://aclanthology.org/2026.acl-tutorials.2.pdf) · [DOI 10.18653/v1/2026.acl-tutorials.2](https://doi.org/10.18653/v1/2026.acl-tutorials.2) · [OpenAlex](https://openalex.org/W7166882089) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary This is a tutorial abstract, not an empirical study, so it reports no experiments or benchmark figures. It argues that LLM progress now depends more on training data (its quality, variety, and mixture) than on sheer volume, and that collecting and curating such data remains expensive and difficult. The presenters, from Shanghai AI Laboratory and Peking University, offer a structured overview of current data-centric research in two main blocks. The first covers selection: extracting the most useful examples from large, noisy collections. Examples include LLM-as-a-judge for automatic quality scoring and active learning for efficient use of annotation budgets. The second covers synthesis: generating training data artificially. This ranges from Chain-of-Thought reasoning traces to multi-agent pipelines that turn small seed sets into diverse instruction data. A final segment surveys open-source tools and platforms that support these workflows. The aim is to give practitioners a principled, actionable framework for building specialized and aligned models through better data. ## Key points - Published in the Proceedings of ACL 2026 (64th Annual Meeting), Volume 5: Tutorial Abstracts, pages 3–4. It introduces no new corpus, model, or results. - The selection part covers LLM-as-a-judge for quality filtering and active learning for reducing annotation cost. - The synthesis part covers Chain-of-Thought trace generation and multi-agent workflows that build instruction data from raw seeds. - The closing part surveys open-source data tooling. The abstract names no specific tools, but the presenters' bios list involvement in DataFlow, MinerU (created by Conghui He), and Angel. - Conghui He's team curates training datasets for InternLM and InternVL. Wentao Zhang leads the Data-centric AI (DCAI) group at PKU. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* 📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 3,486 works 🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,894 works ## Cite Cite as: Lijun Wu, Wentao Zhang and Conghui He. 2026. The Data Frontier for Large Language Models: Selection, Synthesis, and Tools. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{wu2026data, title = {{The Data Frontier for Large Language Models: Selection, Synthesis, and Tools}}, author = {Lijun Wu, Wentao Zhang and Conghui He}, booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts)}, year = {2026}, doi = {10.18653/v1/2026.acl-tutorials.2}, url = {https://doi.org/10.18653/v1/2026.acl-tutorials.2} } ``` - [← previous The Curse of Verbalization: How Presentation Order Constrains LLM Reasoning](https://md.research.elamur.ai/free/en/papers/zhou-2026-curse-verbalization-how-presentation-order/) - [next → The Development of Spectral and Temporal Encodings in Speech Sounds](https://md.research.elamur.ai/free/en/papers/tan-2026-development-spectral-temporal-encodings-speech/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/52/) *Updated 2 November 2026*