---
title: "dLLM: Simple Diffusion Language Modeling (2026)"
description: "The authors present dLLM, an MIT-licensed open-source library that puts DLM training, inference, and… 43 references, cited by 3 papers here."
authors: ["Zhanhui Zhou", "Lingjie Chen", "Hanghang Tong", "Dawn Song"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)"
source: "https://aclanthology.org/2026.acl-demo.8/"
doi: "10.18653/v1/2026.acl-demo.8"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhou-2026-dllm-simple-diffusion-language-modeling/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhou-2026-dllm-simple-diffusion-language-modeling/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/5/) / dLLM: Simple Diffusion Language Modeling

# dLLM: Simple Diffusion Language Modeling

**Authors:** [Zhanhui Zhou](https://md.research.elamur.ai/free/en/authors/zhanhui-zhou/), [Lingjie Chen](https://md.research.elamur.ai/free/en/authors/lingjie-chen/), [Hanghang Tong](https://md.research.elamur.ai/free/en/authors/hanghang-tong/) and [Dawn Song](https://md.research.elamur.ai/free/en/authors/dawn-song/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-demo.8/) · [PDF](https://aclanthology.org/2026.acl-demo.8.pdf) · [DOI 10.18653/v1/2026.acl-demo.8](https://doi.org/10.18653/v1/2026.acl-demo.8) · [OpenAlex](https://openalex.org/W7166827752)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · 3 in our library, of the 149,439 papers whose bibliographies we read

## Summary
Diffusion language models (DLMs) are a growing alternative to autoregressive generation, but each open model tends to ship with its own one-off code. This makes results hard to reproduce, compare, or build on. The authors present dLLM, an MIT-licensed open-source library that puts DLM training, inference, and evaluation behind shared interfaces.

- **Training:** trainers wrap the HuggingFace transformers Trainer and cover Masked Diffusion (MDLM) and Block Diffusion (BD3LM). Moving between pretraining, SFT, and AR-to-diffusion adaptation needs only small configuration edits.
- **Inference:** a sampler abstraction lets decoding algorithms such as Fast-dLLM be swapped in without changing model code.
- **Evaluation:** the pipeline reproduces officially reported scores for LLaDA and Dream. It also shows how strongly DLM performance depends on decoding hyperparameters.

The authors also release small recipes and checkpoints. These convert ModernBERT encoders and Qwen3-0.6B into chat-capable DLMs using SFT alone. The converted models are usable but mostly lag their AR counterparts. The main contribution is lowering the cost of entry for DLM research.

## Key points
- Main components:
  - `MDLMTrainer` and `BD3LMTrainer`, plus a reference EditFlow trainer that supports insertion, substitution, and deletion edits.
  - `MDLMSampler` and its drop-in accelerated version `MDLMFastdLLMSampler`.
  - A terminal visualizer that shows the order in which tokens are decoded.
- Infrastructure is built on accelerate (FSDP, DeepSpeed) and peft. Code is at github.com/ZHZisZZ/dllm, and checkpoints are on the dllm-hub HuggingFace page.
- The Fast-dLLM integration matches official speedups on LLaDA-Instruct and Dream-Base, tested with 256 and 512 max new tokens. Tasks were GSM8K, MATH, HumanEval, and MBPP.
- Released checkpoints:
  - ModernBERT-base-chat-v0.1 and ModernBERT-large-chat-v0.1 (BERT-Chat).
  - Qwen3-0.6B-diffusion-mdlm-v0.1 and Qwen3-0.6B-diffusion-bd3lm-v0.1 (Tiny-A2D).
- The BD3LM Qwen variant beats Qwen3-0.6B-Base on HumanEval and MBPP. Both diffusion variants trail their AR counterparts on knowledge and reasoning benchmarks such as MMLU and BBH.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of California, Berkeley](https://md.research.elamur.ai/free/en/universities/university-of-california-berkeley/) — University, Berkeley, United States · 175 works · 227,440 citations
- [University of Illinois Urbana-Champaign](https://md.research.elamur.ai/free/en/universities/university-of-illinois-urbana-champaign/) — University, Urbana, United States · 184 works · 69,372 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works

🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works

## Cite

Cite as: Zhanhui Zhou, Lingjie Chen, Hanghang Tong and Dawn Song. 2026. dLLM: Simple Diffusion Language Modeling. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhou2026dllm,
  title = {{dLLM: Simple Diffusion Language Modeling}},
  author = {Zhanhui Zhou, Lingjie Chen, Hanghang Tong and Dawn Song},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-demo.8},
  url = {https://doi.org/10.18653/v1/2026.acl-demo.8}
}
```

- [← previous Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering](https://md.research.elamur.ai/free/en/papers/zhao-2026-denoising-concept-vectors-sparse-autoencoders/)
- [next → Do Large Language Models Reflect Demographic Pluralism in Safety?](https://md.research.elamur.ai/free/en/papers/naseem-2026-do-large-language-models-reflect/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/5/)

## References

43 references, 18 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Marianne Arriola, Aaron Gokaslan, Justin T. Chiu, Zhihan Yang, Zhixuan Qi, Jiaqi Han, Subham Sekhar Sahoo, and Volodymyr Kuleshov. 2025. Block diffusion: Interpolating between autoregressive and diffusion language models. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Marianne+Arriola%2C+Aaron+Gokaslan%2C+Justin+T%2E+Chiu%2C+Zhihan+Yang%2C+Zhixuan+Qi%2C+Jiaqi+Han%2C+Subham+Sekhar+Sahoo%2C+and+Volodymyr+Kuleshov%2E+2025%2E+Block+diffusion%3A+Interpolating+between+autoregressive+and+diffu)
2. Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. 2021. [Training verifiers to solve math word problems](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/). arXiv preprint arXiv:2110.14168.
3. Jacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow, and Rianne van den Berg. 2021a. [Structured denoising diffusion models in discrete state-spaces](https://md.research.elamur.ai/free/en/papers/austin-2021-structured-denoising-diffusion-models-discrete/). In Advances in Neural Information Processing Systems.
4. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. [BERT: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,…
5. Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc Le, and Charles Sutton. 2021b. [Program synthesis with large language models](https://md.research.elamur.ai/free/en/papers/austin-2021-program-synthesis-large-language-models/). arXiv preprint arXiv:2108.07732.
6. Leo Gao, Jonathan Tow, Baber Abbasi, Stella Biderman, Sid Black, and 1 others. 2024. EleutherAI/lm-evaluation-harness: v0.4.3. Zenodo. [find](https://scholar.google.com/scholar?q=Leo+Gao%2C+Jonathan+Tow%2C+Baber+Abbasi%2C+Stella+Biderman%2C+Sid+Black%2C+and+1+others%2E+2024%2E+EleutherAI%2Flm%2Devaluation%2Dharness%3A+v0%2E4%2E3%2E+Zenodo%2E)
7. Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, and 29 others. 2023. [Qwen technical report](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-technical-report/). arXiv preprint arXiv:2309.16609.
8. Shansan Gong, Shivam Agarwal, Yizhe Zhang, Jiacheng Ye, Lin Zheng, Mukai Li, Chenxin An, Peilin Zhao, Wei Bi, Jiawei Han, Hao Peng, and Lingpeng Kong. 2025. Scaling diffusion language models via adaptation from autoregressive models. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Shansan+Gong%2C+Shivam+Agarwal%2C+Yizhe+Zhang%2C+Jiacheng+Ye%2C+Lin+Zheng%2C+Mukai+Li%2C+Chenxin+An%2C+Peilin+Zhao%2C+Wei+Bi%2C+Jiawei+Han%2C+Hao+Peng%2C+and+Lingpeng+Kong%2E+2025%2E+Scaling+diffusion+language+models+via+adapt)
9. Loubna Ben Allal, Anton Lozhkov, Guilherme Penedo, Lewis Tunstall, Colin Raffel, Leandro von Werra, Thomas Wolf, and 1 others. 2025. [SmolLM2: When Smol goes big – data-centric training of a small language model](https://md.research.elamur.ai/free/en/papers/allal-2025-smollm2-smol-goes-big-data/). arXiv preprint arXiv:2502.02737.
10. Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, and 1 others. 2024. [The Llama 3 herd of models](https://md.research.elamur.ai/free/en/papers/grattafiori-2024-llama-3-herd-models/). arXiv preprint arXiv:2407.21783.
11. Heli Ben-Hamu, Itai Gat, Daniel Severo, Niklas Nolte, and Brian Karrer. 2025. Accelerated sampling from masked diffusion models via entropy bounded unmasking. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Heli+Ben%2DHamu%2C+Itai+Gat%2C+Daniel+Severo%2C+Niklas+Nolte%2C+and+Brian+Karrer%2E+2025%2E+Accelerated+sampling+from+masked+diffusion+models+via+entropy+bounded+unmasking%2E+In+Advances+in+Neural+Information+Process)
12. Marton Havasi, Brian Karrer, Itai Gat, and Ricky T. Q. Chen. 2025. Edit flows: Variable length discrete flow matching with sequence-level edit operations. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Marton+Havasi%2C+Brian+Karrer%2C+Itai+Gat%2C+and+Ricky+T%2E+Q%2E+Chen%2E+2025%2E+Edit+flows%3A+Variable+length+discrete+flow+matching+with+sequence%2Dlevel+edit+operations%2E+In+Advances+in+Neural+Information+Processing+)
13. Tiwei Bie, Maosong Cao, Kun Chen, Lun Du, Mingliang Gong, Zhuochen Gong, Yanmei Gu, Jiaqi Hu, Zenan Huang, Zhenzhong Lan, Chengxi Li, Chongxuan Li, Jianguo Li, Zehuan Li, Huabin Liu, Lin Liu, Guoshan Lu, Xiaocheng Lu, Yuxin Ma, and 12 others. 2025. LLaDA2.0: Scaling up diffusion language models to 1… — [arXiv:2512.15745](https://arxiv.org/abs/2512.15745) [find](https://scholar.google.com/scholar?q=Tiwei+Bie%2C+Maosong+Cao%2C+Kun+Chen%2C+Lun+Du%2C+Mingliang+Gong%2C+Zhuochen+Gong%2C+Yanmei+Gu%2C+Jiaqi+Hu%2C+Zenan+Huang%2C+Zhenzhong+Lan%2C+Chengxi+Li%2C+Chongxuan+Li%2C+Jianguo+Li%2C+Zehuan+Li%2C+Huabin+Liu%2C+Lin+Liu%2C+Guoshan+)
14. Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021a. [Measuring massive multitask language understanding](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/). In International Conference on Learning Representations.
15. Keshigeyan Chandrasegaran, Armin W. Thomas, Jerome Ku, Federico Berto, Jae Myung Kim, Garyk Brixi, Eric Nguyen, Stefano Massaroli, and Michael Poli. 2025. RND1: Simple, scalable AR-to-Diffusion conversion. Radical Numerics Technical Report. [find](https://scholar.google.com/scholar?q=Keshigeyan+Chandrasegaran%2C+Armin+W%2E+Thomas%2C+Jerome+Ku%2C+Federico+Berto%2C+Jae+Myung+Kim%2C+Garyk+Brixi%2C+Eric+Nguyen%2C+Stefano+Massaroli%2C+and+Michael+Poli%2E+2025%2E+RND1%3A+Simple%2C+scalable+AR%2Dto%2DDiffusion+conver)
16. Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021b. [Measuring mathematical problem solving with the MATH dataset](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/). In NeurIPS Datasets and Benchmarks.
17. The content of the information in this document does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright nota… — [OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models](https://md.research.elamur.ai/free/en/papers/huang-2025-opencoder-open-cookbook-top-tier/)
18. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, and 1 others. 2019. Language models are unsupervised multitask learners. OpenAI blog. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeffrey+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+Ilya+Sutskever%2C+and+1+others%2E+2019%2E+Language+models+are+unsupervised+multitask+learners%2E+OpenAI+blog%2E)
19. Samar Khanna, Siddhant Kharbanda, Shufan Li, Harshit Varma, Eric Wang, Sawyer Birnbaum, Ziyang Luo, Yanis Miraoui, Akash Palrecha, Stefano Ermon, Aditya Grover, and Volodymyr Kuleshov. 2025. Mercury: Ultra-fast language models based on diffusion. arXiv preprint arXiv:2506.17298. [find](https://scholar.google.com/scholar?q=Samar+Khanna%2C+Siddhant+Kharbanda%2C+Shufan+Li%2C+Harshit+Varma%2C+Eric+Wang%2C+Sawyer+Birnbaum%2C+Ziyang+Luo%2C+Yanis+Miraoui%2C+Akash+Palrecha%2C+Stefano+Ermon%2C+Aditya+Grover%2C+and+Volodymyr+Kuleshov%2E+2025%2E+Mercury%3A+)
20. Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase, and Yuxiong He. 2020. ZeRO: memory optimizations toward training trillion parameter models. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2020, Virtual Event / Atlanta, Georgia, US… [find](https://scholar.google.com/scholar?q=Samyam+Rajbhandari%2C+Jeff+Rasley%2C+Olatunji+Ruwase%2C+and+Yuxiong+He%2E+2020%2E+ZeRO%3A+memory+optimizations+toward+training+trillion+parameter+models%2E+In+Proceedings+of+the+International+Conference+for+High+Pe)
21. Nathan Lambert, Jacob Morrison, Valentina Pyatkin, Shengyi Huang, Hamish Ivison, Faeze Brahman, Lester James V. Miranda, Alisa Liu, Nouha Dziri, Shane Lyu, Yuling Gu, Saumya Malik, Victoria Graf, Jena D. Hwang, Jiangjiang Yang, Ronan Le Bras, Oyvind Tafjord, Chris Wilhelm, Luca Soldaini, and 4 other… — [Tulu 3: Pushing Frontiers in Open Language Model Post-Training](https://md.research.elamur.ai/free/en/papers/lambert-2024-tulu-3-pushing-frontiers-open/)
22. Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan, Edgar Marroquin, Justin T. Chiu, Alexander Rush, and Volodymyr Kuleshov. 2024. [Simple and effective masked diffusion language models](https://md.research.elamur.ai/free/en/papers/sahoo-2024-simple-effective-masked-diffusion-language/). In Advances in Neural Information Processing Systems.
23. Yair Schiff, Subham Sekhar Sahoo, Hao Phung, Guanghan Wang, Sam Boshar, Hugo Dalla-torre, Bernardo P. de Almeida, Alexander M. Rush, Thomas Pierrot, and Volodymyr Kuleshov. 2025. Simple guidance mechanisms for discrete diffusion models. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Yair+Schiff%2C+Subham+Sekhar+Sahoo%2C+Hao+Phung%2C+Guanghan+Wang%2C+Sam+Boshar%2C+Hugo+Dalla%2Dtorre%2C+Bernardo+P%2E+de+Almeida%2C+Alexander+M%2E+Rush%2C+Thomas+Pierrot%2C+and+Volodymyr+Kuleshov%2E+2025%2E+Simple+guidance+mecha)
24. Xiang Lisa Li, John Thickstun, Ishaan Gulrajani, Percy Liang, and Tatsunori B. Hashimoto. 2022. [Diffusion-LM improves controllable text generation](https://md.research.elamur.ai/free/en/papers/li-2022-diffusion-lm-improves-controllable-text/). In Advances in Neural Information Processing Systems.
25. Aaron Lou, Chenlin Meng, and Stefano Ermon. 2024. Discrete diffusion modeling by estimating the ratios of the data distribution. In Proceedings of the 41st International Conference on Machine Learning. [find](https://scholar.google.com/scholar?q=Aaron+Lou%2C+Chenlin+Meng%2C+and+Stefano+Ermon%2E+2024%2E+Discrete+diffusion+modeling+by+estimating+the+ratios+of+the+data+distribution%2E+In+Proceedings+of+the+41st+International+Conference+on+Machine+Learning)
26. Jiaxin Shi, Kehang Han, Zhe Wang, Arnaud Doucet, and Michalis K. Titsias. 2024. Simplified and generalized masked diffusion for discrete data. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Jiaxin+Shi%2C+Kehang+Han%2C+Zhe+Wang%2C+Arnaud+Doucet%2C+and+Michalis+K%2E+Titsias%2E+2024%2E+Simplified+and+generalized+masked+diffusion+for+discrete+data%2E+In+Advances+in+Neural+Information+Processing+Systems%2E)
27. Xinyin Ma, Runpeng Yu, Gongfan Fang, and Xinchao Wang. 2025. dKV-Cache: The cache for diffusion language models. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Xinyin+Ma%2C+Runpeng+Yu%2C+Gongfan+Fang%2C+and+Xinchao+Wang%2E+2025%2E+dKV%2DCache%3A+The+cache+for+diffusion+language+models%2E+In+Advances+in+Neural+Information+Processing+Systems%2E)
28. Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V. Le, Ed H. Chi, Denny Zhou, and Jason Wei. 2023. [Challenging BIG-Bench tasks and whether chain-of-thought can solve them](https://md.research.elamur.ai/free/en/papers/suzgun-2023-challenging-big-bench-tasks-whether/). In Findings of the Association for Computational Linguist…
29. Niklas Muennighoff, Zitong Yang, Weijia Shi, Xiang Lisa Li, Li Fei-Fei, Hannaneh Hajishirzi, Luke Zettlemoyer, Percy Liang, Emmanuel Candès, and Tatsunori B Hashimoto. 2025. [s1: Simple test-time scaling](https://md.research.elamur.ai/free/en/papers/muennighoff-2025-s1-simple-test-time-scaling/). In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing.
30. Guanghan Wang, Yair Schiff, Subham Sekhar Sahoo, and Volodymyr Kuleshov. 2025. Remasking discrete diffusion models with inference-time scaling. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Guanghan+Wang%2C+Yair+Schiff%2C+Subham+Sekhar+Sahoo%2C+and+Volodymyr+Kuleshov%2E+2025%2E+Remasking+discrete+diffusion+models+with+inference%2Dtime+scaling%2E+In+Advances+in+Neural+Information+Processing+Systems%2E)
31. John Nguyen, Marton Havasi, Tariq Berrada, Luke Zettlemoyer, and Ricky T. Q. Chen. 2025. OneFlow: Concurrent mixed-modal and interleaved generation with edit flows. arXiv preprint arXiv:2510.03506. [find](https://scholar.google.com/scholar?q=John+Nguyen%2C+Marton+Havasi%2C+Tariq+Berrada%2C+Luke+Zettlemoyer%2C+and+Ricky+T%2E+Q%2E+Chen%2E+2025%2E+OneFlow%3A+Concurrent+mixed%2Dmodal+and+interleaved+generation+with+edit+flows%2E+arXiv+preprint+arXiv%3A2510%2E03506%2E)
32. Benjamin Warner, Antoine Chaffin, Benjamin Clavié, Orion Weller, Oskar Hallström, Said Taghadouini, Alexis Gallagher, Raja Biswas, Faisal Ladhak, Tom Aarsen, Griffin Thomas Adams, Jeremy Howard, and Iacopo Poli. 2025. [Smarter, better, faster, longer: A modern bidirectional encoder for fast, memory e…](https://md.research.elamur.ai/free/en/papers/warner-2024-smarter-better-faster-longer-modern/)
33. Shen Nie, Fengqi Zhu, Chao Du, Tianyu Pang, Qian Liu, Guangtao Zeng, Min Lin, and Chongxuan Li. 2025a. Scaling up masked diffusion models on text. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Shen+Nie%2C+Fengqi+Zhu%2C+Chao+Du%2C+Tianyu+Pang%2C+Qian+Liu%2C+Guangtao+Zeng%2C+Min+Lin%2C+and+Chongxuan+Li%2E+2025a%2E+Scaling+up+masked+diffusion+models+on+text%2E+In+International+Conference+on+Learning+Representatio)
34. Shen Nie, Fengqi Zhu, Zebin You, Xiaolu Zhang, Jingyang Ou, Jun Hu, Jun Zhou, Yankai Lin, Ji-Rong Wen, and Chongxuan Li. 2025b. [Large language diffusion models](https://md.research.elamur.ai/free/en/papers/nie-2025-large-language-diffusion-models/). In Advances in Neural Information Processing Systems.
35. Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pier-ric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, and 3 others. 2020. Transf… [find](https://scholar.google.com/scholar?q=Thomas+Wolf%2C+Lysandre+Debut%2C+Victor+Sanh%2C+Julien+Chaumond%2C+Clement+Delangue%2C+Anthony+Moi%2C+Pier%2Dric+Cistac%2C+Tim+Rault%2C+R%C3%A9mi+Louf%2C+Morgan+Funtowicz%2C+Joe+Davison%2C+Sam+Shleifer%2C+Patrick+von+Platen%2C+Clara+)
36. Methods in Natural Language Processing: System Demonstrations. [find](https://scholar.google.com/scholar?q=Methods+in+Natural+Language+Processing%3A+System+Demonstrations%2E)
37. Chengyue Wu, Hao Zhang, Shuchen Xue, Shizhe Diao, Yonggan Fu, Zhijian Liu, Pavlo Molchanov, Ping Luo, Song Han, and Enze Xie. 2026a. Fast-dLLM v2: Efficient block-diffusion LLM. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Chengyue+Wu%2C+Hao+Zhang%2C+Shuchen+Xue%2C+Shizhe+Diao%2C+Yonggan+Fu%2C+Zhijian+Liu%2C+Pavlo+Molchanov%2C+Ping+Luo%2C+Song+Han%2C+and+Enze+Xie%2E+2026a%2E+Fast%2DdLLM+v2%3A+Efficient+block%2Ddiffusion+LLM%2E+In+International+Confe)
38. Chengyue Wu, Hao Zhang, Shuchen Xue, Zhijian Liu, Shizhe Diao, Ligeng Zhu, Ping Luo, Song Han, and Enze Xie. 2026b. Fast-dLLM: Training-free acceleration of diffusion LLM by enabling KV cache and parallel decoding. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Chengyue+Wu%2C+Hao+Zhang%2C+Shuchen+Xue%2C+Zhijian+Liu%2C+Shizhe+Diao%2C+Ligeng+Zhu%2C+Ping+Luo%2C+Song+Han%2C+and+Enze+Xie%2E+2026b%2E+Fast%2DdLLM%3A+Training%2Dfree+acceleration+of+diffusion+LLM+by+enabling+KV+cache+and+para)
39. An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, and 1 others. 2025. [Qwen3 technical report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/). arXiv preprint arXiv:2505.09388.
40. Jiacheng Ye, Zhihui Xie, Lin Zheng, Jiahui Gao, Zirui Wu, Xin Jiang, Zhenguo Li, and Lingpeng Kong. 2025. Dream 7B: Diffusion large language models. arXiv preprint arXiv:2508.15487. [find](https://scholar.google.com/scholar?q=Jiacheng+Ye%2C+Zhihui+Xie%2C+Lin+Zheng%2C+Jiahui+Gao%2C+Zirui+Wu%2C+Xin+Jiang%2C+Zhenguo+Li%2C+and+Lingpeng+Kong%2E+2025%2E+Dream+7B%3A+Diffusion+large+language+models%2E+arXiv+preprint+arXiv%3A2508%2E15487%2E)
41. Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. 2019. HellaSwag: Can a machine really finish your sentence? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Rowan+Zellers%2C+Ari+Holtzman%2C+Yonatan+Bisk%2C+Ali+Farhadi%2C+and+Yejin+Choi%2E+2019%2E+HellaSwag%3A+Can+a+machine+really+finish+your+sentence%3F+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Com)
42. Siyan Zhao, Devaansh Gupta, Qinqing Zheng, and Aditya Grover. 2025. d1: Scaling reasoning in diffusion large language models via reinforcement learning. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Siyan+Zhao%2C+Devaansh+Gupta%2C+Qinqing+Zheng%2C+and+Aditya+Grover%2E+2025%2E+d1%3A+Scaling+reasoning+in+diffusion+large+language+models+via+reinforcement+learning%2E+In+Advances+in+Neural+Information+Processing+Sy)
43. Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can Balioglu, Pritam Damania, Bernard Nguyen, Geeta Chauhan, Yuchen Hao, Ajit Mathews, and Shen Li. 2023. PyTorch FSDP: Experiences on scaling fully shard… [find](https://scholar.google.com/scholar?q=Yanli+Zhao%2C+Andrew+Gu%2C+Rohan+Varma%2C+Liang+Luo%2C+Chien%2DChin+Huang%2C+Min+Xu%2C+Less+Wright%2C+Hamid+Shojanazeri%2C+Myle+Ott%2C+Sam+Shleifer%2C+Alban+Desmaison%2C+Can+Balioglu%2C+Pritam+Damania%2C+Bernard+Nguyen%2C+Geeta+Ch)

*Updated 31 October 2026*