---
title: "F5-TTS — paper by Chen et al. (2025) — summary and ideas"
description: "F5-TTS is a fully non-autoregressive zero-shot text-to-speech system. 1.61 WER. 72 references, cited by 64 papers here."
authors: ["Yushen Chen", "Zhikang Niu", "Ziyang Ma", "Keqi Deng", "Chunhui Wang", "Jian Zhao", "Kai Yu", "Xie Chen"]
year: 2025
venue: "Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2025.acl-long.313/"
doi: "10.18653/v1/2025.acl-long.313"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/chen-2025-f5-tts-fairytaler-that-fakes/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/chen-2025-f5-tts-fairytaler-that-fakes/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/) / F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching

# F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching

**Authors:** Yushen Chen, Zhikang Niu, Ziyang Ma, Keqi Deng, Chunhui Wang, [Jian Zhao](https://md.research.elamur.ai/free/en/authors/jian-zhao/), [Kai Yu](https://md.research.elamur.ai/free/en/authors/kai-yu/) and Xie Chen · **Year:** 2025 · **Venue:** [Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2025](https://md.research.elamur.ai/free/en/venues/acl/2025/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2025.acl-long.313/) · [PDF](https://aclanthology.org/2025.acl-long.313.pdf) · [DOI 10.18653/v1/2025.acl-long.313](https://doi.org/10.18653/v1/2025.acl-long.313) · [OpenAlex](https://openalex.org/W4412945617)

**Citations:** 88 citations (OpenAlex, 2026-10-14) · [64](https://md.research.elamur.ai/free/en/papers/chen-2025-f5-tts-fairytaler-that-fakes/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
F5-TTS is a fully non-autoregressive zero-shot text-to-speech system. It drops the usual alignment machinery: no duration model, no text encoder, and no phoneme alignment. Like E2 TTS, it turns the transcript into a character sequence, pads it with filler tokens to the length of the mel spectrogram, and trains a Diffusion Transformer (DiT) with conditional flow matching on a text-guided speech-infilling task. The authors found that E2 TTS converges slowly and aligns text to speech unreliably. They attribute this to semantic and acoustic features being tangled together. To fix it, F5-TTS first refines the padded text with ConvNeXt V2 blocks and only then joins it with the speech input. They also add Sway Sampling, an inference-time rule that concentrates flow steps early in the trajectory. It can be applied to existing flow-matching models without retraining. The model was trained on about 100K hours of public multilingual speech. It produces natural zero-shot speech, handles code-switching and speed control, and trains and runs faster than comparable diffusion systems. This matters because a simple, fully released pipeline makes strong TTS reproducible for the community.

## Key points
- Inference reaches a real-time factor (RTF) of 0.15, which the authors describe as a large improvement over state-of-the-art diffusion-based TTS models.
- Input text is represented as raw characters for English and full pinyin for Chinese. It is padded with filler tokens ⟨F⟩ to match the number of mel frames.
- In ablations, adding a ConvNeXt branch for audio as well (F5-TTS+Conv2Audio) cost 1.61 WER in exchange for only +0.01 SIM. Long skip connections did not transfer to DiT, and ConvNeXt text refinement did not transfer to E2 TTS's flat U-Net Transformer.
- Sway Sampling with a negative coefficient s improves results on Seed-TTS test-zh. A "leak and override" test (t′ = 0.1) indicates that early flow steps determine how faithfully the output follows the prompt.
- All code and checkpoints are released. Stated limitations are long mel sequences and no fine-grained control of paralinguistic features such as emotion.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,085 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,888 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 1,282 works · [🔊 Signal Processing](https://md.research.elamur.ai/free/en/shelves/computer-science/signal-processing/) · 213 works

🧭 Topics (1): [🎙️ Speech & spoken language](https://md.research.elamur.ai/free/en/topics/speech/) · 233 works

## Cite

Cite as: Yushen Chen, Zhikang Niu, Ziyang Ma, Keqi Deng, Chunhui Wang, Jian Zhao, Kai Yu and Xie Chen. 2025. F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{chen2025f5,
  title = {{F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching}},
  author = {Yushen Chen, Zhikang Niu, Ziyang Ma, Keqi Deng, Chunhui Wang, Jian Zhao, Kai Yu and Xie Chen},
  booktitle = {Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2025},
  doi = {10.18653/v1/2025.acl-long.313},
  url = {https://doi.org/10.18653/v1/2025.acl-long.313}
}
```

- [← previous Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models](https://md.research.elamur.ai/free/en/papers/sui-2025-stop-overthinking-survey-efficient-reasoning/)
- [next → LLM-based NLG Evaluation: Current Status and Challenges](https://md.research.elamur.ai/free/en/papers/gao-2025-llm-based-nlg-evaluation-current/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/)

## References

72 references, 15 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Philip Anastassiou, Jiawei Chen, Jitong Chen, Yuanzhe Chen, et al. 2024. [Seed-TTS: A family of high-quality versatile speech generation models](https://md.research.elamur.ai/free/en/papers/anastassiou-2024-seed-tts-family-high/). arXiv preprint arXiv:2406.02430.
2. Rosana Ardila, Megan Branson, Kelly Davis, Michael Henretty, Michael Kohler, Josh Meyer, Reuben Morais, Lindsay Saunders, Francis M Tyers, and Gregor Weber. 2019. [Common voice: A massively-multilingual speech corpus](https://md.research.elamur.ai/free/en/papers/ardila-2019-common-voice-massively-multilingual-speech/). arXiv preprint arXiv:1912.06670.
3. Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, and Furu Wei. 2024. VALL-E 2: Neural codec language models are human parity zero-shot text to speech synthesizers. arXiv preprint arXiv:2406.05370. — [arXiv:2406.05370](https://arxiv.org/abs/2406.05370) [find](https://scholar.google.com/scholar?q=Sanyuan+Chen%2C+Shujie+Liu%2C+Long+Zhou%2C+Yanqing+Liu%2C+Xu+Tan%2C+Jinyu+Li%2C+Sheng+Zhao%2C+Yao+Qian%2C+and+Furu+Wei%2E+2024%2E+VALL%2DE+2%3A+Neural+codec+language+models+are+human+parity+zero%2Dshot+text+to+speech+synthesiz)
4. Zhengyang Chen, Sanyuan Chen, Yu Wu, Yao Qian, Chengyi Wang, Shujie Liu, Yanmin Qian, and Michael Zeng. 2022. Large-scale self-supervised speech representation learning for automatic speaker verification. In Proc. ICASSP, pages 6147–6151. IEEE. [find](https://scholar.google.com/scholar?q=Zhengyang+Chen%2C+Sanyuan+Chen%2C+Yu+Wu%2C+Yao+Qian%2C+Chengyi+Wang%2C+Shujie+Liu%2C+Yanmin+Qian%2C+and+Michael+Zeng%2E+2022%2E+Large%2Dscale+self%2Dsupervised+speech+representation+learning+for+automatic+speaker+verificat)
5. Alexandre Défossez, Jade Copet, Gabriel Synnaeve, and Yossi Adi. 2022. [High fidelity neural audio compression](https://md.research.elamur.ai/free/en/papers/defossez-2022-high-fidelity-neural-audio-compression/). arXiv preprint arXiv:2210.13438.
6. Prafulla Dhariwal and Alexander Nichol. 2021. Diffusion models beat gans on image synthesis. Advances in neural information processing systems, 34:8780– 8794. [find](https://scholar.google.com/scholar?q=Prafulla+Dhariwal+and+Alexander+Nichol%2E+2021%2E+Diffusion+models+beat+gans+on+image+synthesis%2E+Advances+in+neural+information+processing+systems%2C+34%3A8780%E2%80%93+8794%2E)
7. Chenpeng Du, Yiwei Guo, Hankun Wang, Yifan Yang, Zhikang Niu, Shuai Wang, Hui Zhang, Xie Chen, and Kai Yu. 2024a. VALL-T: Decoder-only generative transducer for robust and decoding-controllable text-to-speech. arXiv preprint arXiv:2401.14321. — [arXiv:2401.14321](https://arxiv.org/abs/2401.14321) [find](https://scholar.google.com/scholar?q=Chenpeng+Du%2C+Yiwei+Guo%2C+Hankun+Wang%2C+Yifan+Yang%2C+Zhikang+Niu%2C+Shuai+Wang%2C+Hui+Zhang%2C+Xie+Chen%2C+and+Kai+Yu%2E+2024a%2E+VALL%2DT%3A+Decoder%2Donly+generative+transducer+for+robust+and+decoding%2Dcontrollable+text%2Dt)
8. Zhihao Du, Qian Chen, Shiliang Zhang, Kai Hu, et al. 2024b. Cosyvoice: A scalable multilingual zero-shot text-to-speech synthesizer based on supervised semantic tokens. arXiv preprint arXiv:2407.05407. [find](https://scholar.google.com/scholar?q=Zhihao+Du%2C+Qian+Chen%2C+Shiliang+Zhang%2C+Kai+Hu%2C+et+al%2E+2024b%2E+Cosyvoice%3A+A+scalable+multilingual+zero%2Dshot+text%2Dto%2Dspeech+synthesizer+based+on+supervised+semantic+tokens%2E+arXiv+preprint+arXiv%3A2407%2E05407)
9. Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Canrun Li, et al. 2024. E2 TTS: Embarrassingly easy fully non-autoregressive zero-shot TTS. arXiv preprint arXiv:2406.18009. — [arXiv:2406.18009](https://arxiv.org/abs/2406.18009) [find](https://scholar.google.com/scholar?q=Sefik+Emre+Eskimez%2C+Xiaofei+Wang%2C+Manthan+Thakker%2C+Canrun+Li%2C+et+al%2E+2024%2E+E2+TTS%3A+Embarrassingly+easy+fully+non%2Dautoregressive+zero%2Dshot+TTS%2E+arXiv+preprint+arXiv%3A2406%2E18009%2E+%E2%80%94+%5BarXiv%3A2406%2E18009%5D%28htt)
10. Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, et al. 2024. Scaling rectified flow transformers for high-resolution image synthesis. In Proc. ICML. [find](https://scholar.google.com/scholar?q=Patrick+Esser%2C+Sumith+Kulal%2C+Andreas+Blattmann%2C+Rahim+Entezari%2C+et+al%2E+2024%2E+Scaling+rectified+flow+transformers+for+high%2Dresolution+image+synthesis%2E+In+Proc%2E+ICML%2E)
11. Zhengcong Fei, Mingyuan Fan, Changqian Yu, and Junshi Huang. 2024. Flux that plays music. arXiv preprint arXiv:2409.00587. — [arXiv:2409.00587](https://arxiv.org/abs/2409.00587) [find](https://scholar.google.com/scholar?q=Zhengcong+Fei%2C+Mingyuan+Fan%2C+Changqian+Yu%2C+and+Junshi+Huang%2E+2024%2E+Flux+that+plays+music%2E+arXiv+preprint+arXiv%3A2409%2E00587%2E+%E2%80%94+%5BarXiv%3A2409%2E00587%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2409%2E00587%29)
12. Yuan Gao, Nobuyuki Morioka, Yu Zhang, and Nanxin Chen. 2023a. E3 TTS: Easy end-to-end diffusion-based text to speech. In Proc. ASRU, pages 1–8. IEEE. [find](https://scholar.google.com/scholar?q=Yuan+Gao%2C+Nobuyuki+Morioka%2C+Yu+Zhang%2C+and+Nanxin+Chen%2E+2023a%2E+E3+TTS%3A+Easy+end%2Dto%2Dend+diffusion%2Dbased+text+to+speech%2E+In+Proc%2E+ASRU%2C+pages+1%E2%80%938%2E+IEEE%2E)
13. Zhifu Gao, Zerui Li, Jiaming Wang, Haoneng Luo, Xian Shi, Mengzhe Chen, Yabin Li, Lingyun Zuo, Zhihao Du, Zhangyu Xiao, et al. 2023b. FunASR: A fundamental end-to-end speech recognition toolkit. arXiv preprint arXiv:2305.11013. — [arXiv:2305.11013](https://arxiv.org/abs/2305.11013) [find](https://scholar.google.com/scholar?q=Zhifu+Gao%2C+Zerui+Li%2C+Jiaming+Wang%2C+Haoneng+Luo%2C+Xian+Shi%2C+Mengzhe+Chen%2C+Yabin+Li%2C+Lingyun+Zuo%2C+Zhihao+Du%2C+Zhangyu+Xiao%2C+et+al%2E+2023b%2E+FunASR%3A+A+fundamental+end%2Dto%2Dend+speech+recognition+toolkit%2E+arXiv)
14. Wei Kang, Xiaoyu Yang, Zengwei Yao, Fangjun Kuang, Yifan Yang, Liyong Guo, Long Lin, and Daniel Povey. 2024. Libriheavy: a 50,000 hours asr corpus with punctuation casing and context. In Proc. ICASSP, pages 10991–10995. IEEE. [find](https://scholar.google.com/scholar?q=Wei+Kang%2C+Xiaoyu+Yang%2C+Zengwei+Yao%2C+Fangjun+Kuang%2C+Yifan+Yang%2C+Liyong+Guo%2C+Long+Lin%2C+and+Daniel+Povey%2E+2024%2E+Libriheavy%3A+a+50%2C000+hours+asr+corpus+with+punctuation+casing+and+context%2E+In+Proc%2E+ICASSP%2C)
15. Hao-Han Guo, Kun Liu, Fei-Yu Shen, Yi-Chen Wu, Feng-Long Xie, Kun Xie, and Kai-Tuo Xu. 2024a. FireRedTTS: A foundation text-to-speech framework for industry-level generative speech applications. arXiv preprint arXiv:2409.03283. — [arXiv:2409.03283](https://arxiv.org/abs/2409.03283) [find](https://scholar.google.com/scholar?q=Hao%2DHan+Guo%2C+Kun+Liu%2C+Fei%2DYu+Shen%2C+Yi%2DChen+Wu%2C+Feng%2DLong+Xie%2C+Kun+Xie%2C+and+Kai%2DTuo+Xu%2E+2024a%2E+FireRedTTS%3A+A+foundation+text%2Dto%2Dspeech+framework+for+industry%2Dlevel+generative+speech+applications%2E+arXiv)
16. Tero Karras, Miika Aittala, Jaakko Lehtinen, Janne Hellsten, Timo Aila, and Samuli Laine. 2024. Analyzing and improving the training dynamics of diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 24174–24184. [find](https://scholar.google.com/scholar?q=Tero+Karras%2C+Miika+Aittala%2C+Jaakko+Lehtinen%2C+Janne+Hellsten%2C+Timo+Aila%2C+and+Samuli+Laine%2E+2024%2E+Analyzing+and+improving+the+training+dynamics+of+diffusion+models%2E+In+Proceedings+of+the+IEEE%2FCVF+Confer)
17. Tingwei Guo, Cheng Wen, Dongwei Jiang, Ne Luo, et al. 2021. Didispeech: A large scale Mandarin speech corpus. In Proc. ICASSP, pages 6968–6972. IEEE. [find](https://scholar.google.com/scholar?q=Tingwei+Guo%2C+Cheng+Wen%2C+Dongwei+Jiang%2C+Ne+Luo%2C+et+al%2E+2021%2E+Didispeech%3A+A+large+scale+Mandarin+speech+corpus%2E+In+Proc%2E+ICASSP%2C+pages+6968%E2%80%936972%2E+IEEE%2E)
18. Yiwei Guo, Chenpeng Du, Ziyang Ma, Xie Chen, and Kai Yu. 2024b. Voiceflow: Efficient text-to-speech with rectified flow matching. In Proc. ICASSP, pages 11121–11125. IEEE. [find](https://scholar.google.com/scholar?q=Yiwei+Guo%2C+Chenpeng+Du%2C+Ziyang+Ma%2C+Xie+Chen%2C+and+Kai+Yu%2E+2024b%2E+Voiceflow%3A+Efficient+text%2Dto%2Dspeech+with+rectified+flow+matching%2E+In+Proc%2E+ICASSP%2C+pages+11121%E2%80%9311125%2E+IEEE%2E)
19. Bing Han, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Yanming Qian, Yanqing Liu, Sheng Zhao, Jinyu Li, and Furu Wei. 2024. VALL-E R: Robust and efficient zero-shot text-to-speech synthesis via monotonic alignment. arXiv preprint arXiv:2406.07855. — [arXiv:2406.07855](https://arxiv.org/abs/2406.07855) [find](https://scholar.google.com/scholar?q=Bing+Han%2C+Long+Zhou%2C+Shujie+Liu%2C+Sanyuan+Chen%2C+Lingwei+Meng%2C+Yanming+Qian%2C+Yanqing+Liu%2C+Sheng+Zhao%2C+Jinyu+Li%2C+and+Furu+Wei%2E+2024%2E+VALL%2DE+R%3A+Robust+and+efficient+zero%2Dshot+text%2Dto%2Dspeech+synthesis+via+)
20. Haorui He, Zengqiang Shang, Chaoren Wang, Xuyuan Li, et al. 2024. Emilia: An extensive, multilingual, and diverse speech dataset for large-scale speech generation. arXiv preprint arXiv:2407.05361. — [arXiv:2407.05361](https://arxiv.org/abs/2407.05361) [find](https://scholar.google.com/scholar?q=Haorui+He%2C+Zengqiang+Shang%2C+Chaoren+Wang%2C+Xuyuan+Li%2C+et+al%2E+2024%2E+Emilia%3A+An+extensive%2C+multilingual%2C+and+diverse+speech+dataset+for+large%2Dscale+speech+generation%2E+arXiv+preprint+arXiv%3A2407%2E05361%2E+%E2%80%94+%5B)
21. Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840– 6851. [find](https://scholar.google.com/scholar?q=Jonathan+Ho%2C+Ajay+Jain%2C+and+Pieter+Abbeel%2E+2020%2E+Denoising+diffusion+probabilistic+models%2E+Advances+in+neural+information+processing+systems%2C+33%3A6840%E2%80%93+6851%2E)
22. Jonathan Ho and Tim Salimans. 2022. [Classifier-free diffusion guidance](https://md.research.elamur.ai/free/en/papers/ho-2022-classifier-free-diffusion-guidance/). arXiv preprint arXiv:2207.12598.
23. Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, and Abdelrahman Mohamed. 2021. [Hubert: Self-supervised speech representation learning by masked prediction of hidden units](https://md.research.elamur.ai/free/en/papers/hsu-2021-hubert-self-supervised-speech-representation/). IEEE/ACM Transactions on Audio, Speech, and Language Processing, 29:3451–3460.
24. Keith Ito and Linda Johnson. 2017. The LJ speech dataset. [find](https://scholar.google.com/scholar?q=Keith+Ito+and+Linda+Johnson%2E+2017%2E+The+LJ+speech+dataset%2E)
25. Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, et al. 2024. Naturalspeech 3: Zero-shot speech synthesis with factorized codec and diffusion models. arXiv preprint arXiv:2403.03100. — [arXiv:2403.03100](https://arxiv.org/abs/2403.03100) [find](https://scholar.google.com/scholar?q=Zeqian+Ju%2C+Yuancheng+Wang%2C+Kai+Shen%2C+Xu+Tan%2C+Detai+Xin%2C+Dongchao+Yang%2C+Yanqing+Liu%2C+Yichong+Leng%2C+Kaitao+Song%2C+Siliang+Tang%2C+et+al%2E+2024%2E+Naturalspeech+3%3A+Zero%2Dshot+speech+synthesis+with+factorized+co)
26. Jacob Kahn, Morgane Riviere, Weiyi Zheng, Evgeny Kharitonov, et al. 2020. Libri-light: A benchmark for ASR with limited or no supervision. In Proc. ICASSP, pages 7669–7673. IEEE. [find](https://scholar.google.com/scholar?q=Jacob+Kahn%2C+Morgane+Riviere%2C+Weiyi+Zheng%2C+Evgeny+Kharitonov%2C+et+al%2E+2020%2E+Libri%2Dlight%3A+A+benchmark+for+ASR+with+limited+or+no+supervision%2E+In+Proc%2E+ICASSP%2C+pages+7669%E2%80%937673%2E+IEEE%2E)
27. Jaehyeon Kim, Sungwon Kim, Jungil Kong, and Sungroh Yoon. 2020. Glow-TTS: A generative flow for text-to-speech via monotonic alignment search. Advances in Neural Information Processing Systems, 33:8067–8077. [find](https://scholar.google.com/scholar?q=Jaehyeon+Kim%2C+Sungwon+Kim%2C+Jungil+Kong%2C+and+Sungroh+Yoon%2E+2020%2E+Glow%2DTTS%3A+A+generative+flow+for+text%2Dto%2Dspeech+via+monotonic+alignment+search%2E+Advances+in+Neural+Information+Processing+Systems%2C+33%3A806)
28. Jaehyeon Kim, Jungil Kong, and Juhee Son. 2021. Conditional variational autoencoder with adversarial learning for end-to-end text-to-speech. In International Conference on Machine Learning, pages 5530–5540. PMLR. [find](https://scholar.google.com/scholar?q=Jaehyeon+Kim%2C+Jungil+Kong%2C+and+Juhee+Son%2E+2021%2E+Conditional+variational+autoencoder+with+adversarial+learning+for+end%2Dto%2Dend+text%2Dto%2Dspeech%2E+In+International+Conference+on+Machine+Learning%2C+pages+5530)
29. Diederik Kingma and Ruiqi Gao. 2024. Understanding diffusion objectives as the ELBO with simple data augmentation. Advances in Neural Information Processing Systems, 36. [find](https://scholar.google.com/scholar?q=Diederik+Kingma+and+Ruiqi+Gao%2E+2024%2E+Understanding+diffusion+objectives+as+the+ELBO+with+simple+data+augmentation%2E+Advances+in+Neural+Information+Processing+Systems%2C+36%2E)
30. Matthew Le, Apoorv Vyas, Bowen Shi, Brian Karrer, et al. 2024. Voicebox: Text-guided multilingual universal speech generation at scale. Advances in neural information processing systems, 36. [find](https://scholar.google.com/scholar?q=Matthew+Le%2C+Apoorv+Vyas%2C+Bowen+Shi%2C+Brian+Karrer%2C+et+al%2E+2024%2E+Voicebox%3A+Text%2Dguided+multilingual+universal+speech+generation+at+scale%2E+Advances+in+neural+information+processing+systems%2C+36%2E)
31. Keon Lee, Dong Won Kim, Jaehyeon Kim, and Jaewoong Cho. 2024. DiTTo-TTS: Efficient and scalable zero-shot text-to-speech with diffusion transformer. arXiv preprint arXiv:2406.11427. — [arXiv:2406.11427](https://arxiv.org/abs/2406.11427) [find](https://scholar.google.com/scholar?q=Keon+Lee%2C+Dong+Won+Kim%2C+Jaehyeon+Kim%2C+and+Jaewoong+Cho%2E+2024%2E+DiTTo%2DTTS%3A+Efficient+and+scalable+zero%2Dshot+text%2Dto%2Dspeech+with+diffusion+transformer%2E+arXiv+preprint+arXiv%3A2406%2E11427%2E+%E2%80%94+%5BarXiv%3A2406%2E1142)
32. Sang-gil Lee, Wei Ping, Boris Ginsburg, Bryan Catanzaro, and Sungroh Yoon. 2022. Bigvgan: A universal neural vocoder with large-scale training. arXiv preprint arXiv:2206.04658. — [arXiv:2206.04658](https://arxiv.org/abs/2206.04658) [find](https://scholar.google.com/scholar?q=Sang%2Dgil+Lee%2C+Wei+Ping%2C+Boris+Ginsburg%2C+Bryan+Catanzaro%2C+and+Sungroh+Yoon%2E+2022%2E+Bigvgan%3A+A+universal+neural+vocoder+with+large%2Dscale+training%2E+arXiv+preprint+arXiv%3A2206%2E04658%2E+%E2%80%94+%5BarXiv%3A2206%2E04658%5D%28ht)
33. Naihan Li, Shujie Liu, Yanqing Liu, Sheng Zhao, and Ming Liu. 2019. Neural speech synthesis with transformer network. In Proceedings of the AAAI conference on artificial intelligence, volume 33, pages 6706–6713. [find](https://scholar.google.com/scholar?q=Naihan+Li%2C+Shujie+Liu%2C+Yanqing+Liu%2C+Sheng+Zhao%2C+and+Ming+Liu%2E+2019%2E+Neural+speech+synthesis+with+transformer+network%2E+In+Proceedings+of+the+AAAI+conference+on+artificial+intelligence%2C+volume+33%2C+pages)
34. Tianhong Li, Yonglong Tian, He Li, Mingyang Deng, and Kaiming He. 2024. Autoregressive image generation without vector quantization. arXiv preprint arXiv:2406.11838. — [arXiv:2406.11838](https://arxiv.org/abs/2406.11838) [find](https://scholar.google.com/scholar?q=Tianhong+Li%2C+Yonglong+Tian%2C+He+Li%2C+Mingyang+Deng%2C+and+Kaiming+He%2E+2024%2E+Autoregressive+image+generation+without+vector+quantization%2E+arXiv+preprint+arXiv%3A2406%2E11838%2E+%E2%80%94+%5BarXiv%3A2406%2E11838%5D%28https%3A%2F%2Farxiv)
35. Yaron Lipman, Ricky TQ Chen, Heli Ben-Hamu, Maximilian Nickel, and Matt Le. 2022. [Flow matching for generative modeling](https://md.research.elamur.ai/free/en/papers/lipman-2022-flow-matching-generative-modeling/). arXiv preprint arXiv:2210.02747.
36. Zhijun Liu, Shuai Wang, Sho Inoue, Qibing Bai, and Haizhou Li. 2024a. Autoregressive diffusion transformer for text-to-speech synthesis. arXiv preprint arXiv:2406.05551. — [arXiv:2406.05551](https://arxiv.org/abs/2406.05551) [find](https://scholar.google.com/scholar?q=Zhijun+Liu%2C+Shuai+Wang%2C+Sho+Inoue%2C+Qibing+Bai%2C+and+Haizhou+Li%2E+2024a%2E+Autoregressive+diffusion+transformer+for+text%2Dto%2Dspeech+synthesis%2E+arXiv+preprint+arXiv%3A2406%2E05551%2E+%E2%80%94+%5BarXiv%3A2406%2E05551%5D%28https%3A%2F%2Fa)
37. Zhijun Liu, Shuai Wang, Pengcheng Zhu, Mengxiao Bi, and Haizhou Li. 2024b. E1 TTS: Simple and fast non-autoregressive TTS. arXiv preprint arXiv:2409.09351. — [arXiv:2409.09351](https://arxiv.org/abs/2409.09351) [find](https://scholar.google.com/scholar?q=Zhijun+Liu%2C+Shuai+Wang%2C+Pengcheng+Zhu%2C+Mengxiao+Bi%2C+and+Haizhou+Li%2E+2024b%2E+E1+TTS%3A+Simple+and+fast+non%2Dautoregressive+TTS%2E+arXiv+preprint+arXiv%3A2409%2E09351%2E+%E2%80%94+%5BarXiv%3A2409%2E09351%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2)
38. Ofir Press, Noah A Smith, and Mike Lewis. 2021. Train short, test long: Attention with linear biases enables input length extrapolation. arXiv preprint arXiv:2108.12409. [find](https://scholar.google.com/scholar?q=Ofir+Press%2C+Noah+A+Smith%2C+and+Mike+Lewis%2E+2021%2E+Train+short%2C+test+long%3A+Attention+with+linear+biases+enables+input+length+extrapolation%2E+arXiv+preprint+arXiv%3A2108%2E12409%2E)
39. Zhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell, and Saining Xie. 2022. A convnet for the 2020s. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11976–11986. [find](https://scholar.google.com/scholar?q=Zhuang+Liu%2C+Hanzi+Mao%2C+Chao%2DYuan+Wu%2C+Christoph+Feichtenhofer%2C+Trevor+Darrell%2C+and+Saining+Xie%2E+2022%2E+A+convnet+for+the+2020s%2E+In+Proceedings+of+the+IEEE%2FCVF+conference+on+computer+vision+and+pattern+r)
40. Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2023. [Robust speech recognition via large-scale weak supervision](https://md.research.elamur.ai/free/en/papers/radford-2022-robust-speech-recognition-large-scale/). In International conference on machine learning, pages 28492–28518. PMLR.
41. I Loshchilov. 2017. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101. [find](https://scholar.google.com/scholar?q=I+Loshchilov%2E+2017%2E+Decoupled+weight+decay+regularization%2E+arXiv+preprint+arXiv%3A1711%2E05101%2E)
42. Yi Ren, Chenxu Hu, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, and Tie-Yan Liu. 2020. Fastspeech 2: Fast and high-quality end-to-end text to speech. arXiv preprint arXiv:2006.04558. [find](https://scholar.google.com/scholar?q=Yi+Ren%2C+Chenxu+Hu%2C+Xu+Tan%2C+Tao+Qin%2C+Sheng+Zhao%2C+Zhou+Zhao%2C+and+Tie%2DYan+Liu%2E+2020%2E+Fastspeech+2%3A+Fast+and+high%2Dquality+end%2Dto%2Dend+text+to+speech%2E+arXiv+preprint+arXiv%3A2006%2E04558%2E)
43. Linhan Ma, Dake Guo, Kun Song, Yuepeng Jiang, Shuai Wang, Liumeng Xue, Weiming Xu, Huan Zhao, Binbin Zhang, and Lei Xie. 2024. Wenet-Speech4TTS: A 12,800-hour Mandarin TTS corpus for large speech generation model benchmark. arXiv preprint arXiv:2406.05763. — [arXiv:2406.05763](https://arxiv.org/abs/2406.05763) [find](https://scholar.google.com/scholar?q=Linhan+Ma%2C+Dake+Guo%2C+Kun+Song%2C+Yuepeng+Jiang%2C+Shuai+Wang%2C+Liumeng+Xue%2C+Weiming+Xu%2C+Huan+Zhao%2C+Binbin+Zhang%2C+and+Lei+Xie%2E+2024%2E+Wenet%2DSpeech4TTS%3A+A+12%2C800%2Dhour+Mandarin+TTS+corpus+for+large+speech+gene)
44. Shivam Mehta, Ruibo Tu, Jonas Beskow, Éva Székely, and Gustav Eje Henter. 2024. Matcha-TTS: A fast TTS architecture with conditional flow matching. In Proc. ICASSP, pages 11341–11345. IEEE. [find](https://scholar.google.com/scholar?q=Shivam+Mehta%2C+Ruibo+Tu%2C+Jonas+Beskow%2C+%C3%89va+Sz%C3%A9kely%2C+and+Gustav+Eje+Henter%2E+2024%2E+Matcha%2DTTS%3A+A+fast+TTS+architecture+with+conditional+flow+matching%2E+In+Proc%2E+ICASSP%2C+pages+11341%E2%80%9311345%2E+IEEE%2E)
45. Aleksandr Meister, Matvei Novikov, Nikolay Karpov, Evelina Bakhturina, Vitaly Lavrukhin, and Boris Ginsburg. 2023. LibriSpeech-PC: Benchmark for evaluation of punctuation and capitalization capabilities of end-to-end ASR models. In Proc. ASRU, pages 1–7. IEEE. [find](https://scholar.google.com/scholar?q=Aleksandr+Meister%2C+Matvei+Novikov%2C+Nikolay+Karpov%2C+Evelina+Bakhturina%2C+Vitaly+Lavrukhin%2C+and+Boris+Ginsburg%2E+2023%2E+LibriSpeech%2DPC%3A+Benchmark+for+evaluation+of+punctuation+and+capitalization+capabiliti)
46. Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, et al. 2024. Autoregressive speech synthesis without vector quantization. arXiv preprint arXiv:2407.08551. [find](https://scholar.google.com/scholar?q=Lingwei+Meng%2C+Long+Zhou%2C+Shujie+Liu%2C+Sanyuan+Chen%2C+et+al%2E+2024%2E+Autoregressive+speech+synthesis+without+vector+quantization%2E+arXiv+preprint+arXiv%3A2407%2E08551%2E)
47. Zhikang Niu, Sanyuan Chen, Long Zhou, Ziyang Ma, Xie Chen, and Shujie Liu. 2024. NDVQ: Robust neural audio codec with normal distribution-based vector quantization. arXiv preprint arXiv:2409.12717. — [arXiv:2409.12717](https://arxiv.org/abs/2409.12717) [find](https://scholar.google.com/scholar?q=Zhikang+Niu%2C+Sanyuan+Chen%2C+Long+Zhou%2C+Ziyang+Ma%2C+Xie+Chen%2C+and+Shujie+Liu%2E+2024%2E+NDVQ%3A+Robust+neural+audio+codec+with+normal+distribution%2Dbased+vector+quantization%2E+arXiv+preprint+arXiv%3A2409%2E12717%2E+%E2%80%94+)
48. Takuma Okamoto, Yamato Ohtani, Tomoki Toda, and Hisashi Kawai. 2024. Convnext-TTS and Convnext-VC: Convnext-based fast end-to-end sequence-to-sequence text-to-speech and voice conversion. In Proc. ICASSP, pages 12456–12460. IEEE. [find](https://scholar.google.com/scholar?q=Takuma+Okamoto%2C+Yamato+Ohtani%2C+Tomoki+Toda%2C+and+Hisashi+Kawai%2E+2024%2E+Convnext%2DTTS+and+Convnext%2DVC%3A+Convnext%2Dbased+fast+end%2Dto%2Dend+sequence%2Dto%2Dsequence+text%2Dto%2Dspeech+and+voice+conversion%2E+In+Proc%2E+ICA)
49. William Peebles and Saining Xie. 2023. [Scalable diffusion models with transformers](https://md.research.elamur.ai/free/en/papers/peebles-2022-scalable-diffusion-models-transformers/). In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 4195–4205.
50. Puyuan Peng, Po-Yao Huang, Daniel Li, Abdelrahman Mohamed, and David Harwath. 2024. Voicecraft: Zero-shot speech editing and text-to-speech in the wild. arXiv preprint arXiv:2403.16973. [find](https://scholar.google.com/scholar?q=Puyuan+Peng%2C+Po%2DYao+Huang%2C+Daniel+Li%2C+Abdelrahman+Mohamed%2C+and+David+Harwath%2E+2024%2E+Voicecraft%3A+Zero%2Dshot+speech+editing+and+text%2Dto%2Dspeech+in+the+wild%2E+arXiv+preprint+arXiv%3A2403%2E16973%2E)
51. Vadim Popov, Ivan Vovk, Vladimir Gogoryan, Tasnima Sadekova, and Mikhail Kudinov. 2021. Grad-tts: A diffusion probabilistic model for text-to-speech. In International Conference on Machine Learning, pages 8599–8608. PMLR. [find](https://scholar.google.com/scholar?q=Vadim+Popov%2C+Ivan+Vovk%2C+Vladimir+Gogoryan%2C+Tasnima+Sadekova%2C+and+Mikhail+Kudinov%2E+2021%2E+Grad%2Dtts%3A+A+diffusion+probabilistic+model+for+text%2Dto%2Dspeech%2E+In+International+Conference+on+Machine+Learning%2C+p)
52. Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. [U-net: Convolutional networks for biomedical image segmentation](https://md.research.elamur.ai/free/en/papers/ronneberger-2015-u-net-convolutional-networks-biomedical/). In Proc. MICCAI, pages 234– 241. Springer.
53. Takaaki Saeki, Detai Xin, Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, and Hiroshi Saruwatari. 2022. Utmos: Utokyo-sarulab system for voicemos challenge 2022. arXiv preprint arXiv:2204.02152. [find](https://scholar.google.com/scholar?q=Takaaki+Saeki%2C+Detai+Xin%2C+Wataru+Nakata%2C+Tomoki+Koriyama%2C+Shinnosuke+Takamichi%2C+and+Hiroshi+Saruwatari%2E+2022%2E+Utmos%3A+Utokyo%2Dsarulab+system+for+voicemos+challenge+2022%2E+arXiv+preprint+arXiv%3A2204%2E02152%2E)
54. Tim Salimans and Jonathan Ho. 2022. Progressive distillation for fast sampling of diffusion models. arXiv preprint arXiv:2202.00512. — [arXiv:2202.00512](https://arxiv.org/abs/2202.00512) [find](https://scholar.google.com/scholar?q=Tim+Salimans+and+Jonathan+Ho%2E+2022%2E+Progressive+distillation+for+fast+sampling+of+diffusion+models%2E+arXiv+preprint+arXiv%3A2202%2E00512%2E+%E2%80%94+%5BarXiv%3A2202%2E00512%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2202%2E00512%29)
55. Jonathan Shen, Ruoming Pang, Ron J Weiss, Mike Schuster, et al. 2018. Natural TTS synthesis by conditioning wavenet on mel spectrogram predictions. In Proc. ICASSP, pages 4779–4783. IEEE. [find](https://scholar.google.com/scholar?q=Jonathan+Shen%2C+Ruoming+Pang%2C+Ron+J+Weiss%2C+Mike+Schuster%2C+et+al%2E+2018%2E+Natural+TTS+synthesis+by+conditioning+wavenet+on+mel+spectrogram+predictions%2E+In+Proc%2E+ICASSP%2C+pages+4779%E2%80%934783%2E+IEEE%2E)
56. Kai Shen, Zeqian Ju, Xu Tan, Yanqing Liu, et al. 2023. Naturalspeech 2: Latent diffusion models are natural and zero-shot speech and singing synthesizers. arXiv preprint arXiv:2304.09116. — [arXiv:2304.09116](https://arxiv.org/abs/2304.09116) [find](https://scholar.google.com/scholar?q=Kai+Shen%2C+Zeqian+Ju%2C+Xu+Tan%2C+Yanqing+Liu%2C+et+al%2E+2023%2E+Naturalspeech+2%3A+Latent+diffusion+models+are+natural+and+zero%2Dshot+speech+and+singing+synthesizers%2E+arXiv+preprint+arXiv%3A2304%2E09116%2E+%E2%80%94+%5BarXiv%3A230)
57. Hubert Siuzdak. 2023. Vocos: Closing the gap between time-domain and fourier-based neural vocoders for high-quality audio synthesis. arXiv preprint arXiv:2306.00814. — [arXiv:2306.00814](https://arxiv.org/abs/2306.00814) [find](https://scholar.google.com/scholar?q=Hubert+Siuzdak%2E+2023%2E+Vocos%3A+Closing+the+gap+between+time%2Ddomain+and+fourier%2Dbased+neural+vocoders+for+high%2Dquality+audio+synthesis%2E+arXiv+preprint+arXiv%3A2306%2E00814%2E+%E2%80%94+%5BarXiv%3A2306%2E00814%5D%28https%3A%2F%2Farxiv)
58. Yakun Song, Zhuo Chen, Xiaofei Wang, Ziyang Ma, and Xie Chen. 2024. ELLA-V: Stable neural codec language modeling with alignment-guided sequence reordering. arXiv preprint arXiv:2401.07333. — [arXiv:2401.07333](https://arxiv.org/abs/2401.07333) [find](https://scholar.google.com/scholar?q=Yakun+Song%2C+Zhuo+Chen%2C+Xiaofei+Wang%2C+Ziyang+Ma%2C+and+Xie+Chen%2E+2024%2E+ELLA%2DV%3A+Stable+neural+codec+language+modeling+with+alignment%2Dguided+sequence+reordering%2E+arXiv+preprint+arXiv%3A2401%2E07333%2E+%E2%80%94+%5BarXiv%3A2)
59. Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. 2020. [Score-based generative modeling through stochastic differential equations](https://md.research.elamur.ai/free/en/papers/song-2020-score-based-generative-modeling-through/). arXiv preprint arXiv:2011.13456.
60. Jianlin Su, Murtadha Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. 2024. [Roformer: Enhanced transformer with rotary position embedding](https://md.research.elamur.ai/free/en/papers/su-2021-roformer-enhanced-transformer-rotary-position/). Neurocomputing, 568:127063.
61. Xu Tan, Jiawei Chen, Haohe Liu, Jian Cong, et al. 2024. Naturalspeech: End-to-end text-to-speech synthesis with human-level quality. IEEE Transactions on Pattern Analysis and Machine Intelligence. [find](https://scholar.google.com/scholar?q=Xu+Tan%2C+Jiawei+Chen%2C+Haohe+Liu%2C+Jian+Cong%2C+et+al%2E+2024%2E+Naturalspeech%3A+End%2Dto%2Dend+text%2Dto%2Dspeech+synthesis+with+human%2Dlevel+quality%2E+IEEE+Transactions+on+Pattern+Analysis+and+Machine+Intelligence%2E)
62. Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, et al. 2023a. [Neural codec language models are zero-shot text to speech synthesizers](https://md.research.elamur.ai/free/en/papers/wang-2023-neural-codec-language-models-zero/). arXiv preprint arXiv:2301.02111.
63. Tianrui Wang, Long Zhou, Ziqiang Zhang, Yu Wu, Shujie Liu, Yashesh Gaur, Zhuo Chen, Jinyu Li, and Furu Wei. 2023b. VioLA: Unified codec language models for speech recognition, synthesis, and translation. arXiv preprint arXiv:2305.16107. — [arXiv:2305.16107](https://arxiv.org/abs/2305.16107) [find](https://scholar.google.com/scholar?q=Tianrui+Wang%2C+Long+Zhou%2C+Ziqiang+Zhang%2C+Yu+Wu%2C+Shujie+Liu%2C+Yashesh+Gaur%2C+Zhuo+Chen%2C+Jinyu+Li%2C+and+Furu+Wei%2E+2023b%2E+VioLA%3A+Unified+codec+language+models+for+speech+recognition%2C+synthesis%2C+and+translati)
64. Yuancheng Wang, Haoyue Zhan, Liwei Liu, Ruihong Zeng, Haotian Guo, Jiachen Zheng, Qiang Zhang, Shunsi Zhang, and Zhizheng Wu. 2024. MaskGCT: Zero-shot text-to-speech with masked generative codec transformer. arXiv preprint arXiv:2409.00750. — [arXiv:2409.00750](https://arxiv.org/abs/2409.00750) [find](https://scholar.google.com/scholar?q=Yuancheng+Wang%2C+Haoyue+Zhan%2C+Liwei+Liu%2C+Ruihong+Zeng%2C+Haotian+Guo%2C+Jiachen+Zheng%2C+Qiang+Zhang%2C+Shunsi+Zhang%2C+and+Zhizheng+Wu%2E+2024%2E+MaskGCT%3A+Zero%2Dshot+text%2Dto%2Dspeech+with+masked+generative+codec+trans)
65. Sanghyun Woo, Shoubhik Debnath, Ronghang Hu, Xinlei Chen, Zhuang Liu, In So Kweon, and Saining Xie. 2023. Convnext v2: Co-designing and scaling convnets with masked autoencoders. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 16133–16142. [find](https://scholar.google.com/scholar?q=Sanghyun+Woo%2C+Shoubhik+Debnath%2C+Ronghang+Hu%2C+Xinlei+Chen%2C+Zhuang+Liu%2C+In+So+Kweon%2C+and+Saining+Xie%2E+2023%2E+Convnext+v2%3A+Co%2Ddesigning+and+scaling+convnets+with+masked+autoencoders%2E+In+Proceedings+of+the)
66. Yi-Chiao Wu, Israel D Gebru, Dejan Marković, and Alexander Richard. 2023. Audiodec: An open-source streaming high-fidelity neural audio codec. In Proc. ICASSP, pages 1–5. IEEE. [find](https://scholar.google.com/scholar?q=Yi%2DChiao+Wu%2C+Israel+D+Gebru%2C+Dejan+Markovic%CC%81%2C+and+Alexander+Richard%2E+2023%2E+Audiodec%3A+An+open%2Dsource+streaming+high%2Dfidelity+neural+audio+codec%2E+In+Proc%2E+ICASSP%2C+pages+1%E2%80%935%2E+IEEE%2E)
67. Detai Xin, Xu Tan, Kai Shen, Zeqian Ju, et al. 2024. Rall-e: Robust codec language modeling with chain-of-thought prompting for text-to-speech synthesis. arXiv preprint arXiv:2404.03204. — [arXiv:2404.03204](https://arxiv.org/abs/2404.03204) [find](https://scholar.google.com/scholar?q=Detai+Xin%2C+Xu+Tan%2C+Kai+Shen%2C+Zeqian+Ju%2C+et+al%2E+2024%2E+Rall%2De%3A+Robust+codec+language+modeling+with+chain%2Dof%2Dthought+prompting+for+text%2Dto%2Dspeech+synthesis%2E+arXiv+preprint+arXiv%3A2404%2E03204%2E+%E2%80%94+%5BarXiv%3A2404)
68. Dongchao Yang, Songxiang Liu, Rongjie Huang, Jinchuan Tian, Chao Weng, and Yuexian Zou. 2023. Hifi-codec: Group-residual vector quantization for high fidelity audio codec. arXiv preprint arXiv:2305.02765. [find](https://scholar.google.com/scholar?q=Dongchao+Yang%2C+Songxiang+Liu%2C+Rongjie+Huang%2C+Jinchuan+Tian%2C+Chao+Weng%2C+and+Yuexian+Zou%2E+2023%2E+Hifi%2Dcodec%3A+Group%2Dresidual+vector+quantization+for+high+fidelity+audio+codec%2E+arXiv+preprint+arXiv%3A2305%2E02)
69. Neil Zeghidour, Alejandro Luebs, Ahmed Omran, Jan Skoglund, and Marco Tagliasacchi. 2021. [Soundstream: An end-to-end neural audio codec](https://md.research.elamur.ai/free/en/papers/zeghidour-2021-soundstream-end-end-neural-audio/). IEEE/ACM Transactions on Audio, Speech, and Language Processing, 30:495–507.
70. Heiga Zen, Viet Dang, Rob Clark, Yu Zhang, Ron J Weiss, Ye Jia, Zhifeng Chen, and Yonghui Wu. 2019. [Libritts: A corpus derived from librispeech for text-to-speech](https://md.research.elamur.ai/free/en/papers/zen-2019-libritts-corpus-derived-librispeech-text/). arXiv preprint arXiv:1904.02882.
71. Xin Zhang, Dong Zhang, Shimin Li, Yaqian Zhou, and Xipeng Qiu. 2023a. [Speechtokenizer: Unified speech tokenizer for speech large language models](https://md.research.elamur.ai/free/en/papers/zhang-2023-speechtokenizer-unified-speech-tokenizer-speech/). arXiv preprint arXiv:2308.16692.
72. Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, et al. 2023b. Speak foreign languages with your own voice: Cross-lingual neural codec language modeling. arXiv preprint arXiv:2303.03926. — [arXiv:2303.03926](https://arxiv.org/abs/2303.03926) [find](https://scholar.google.com/scholar?q=Ziqiang+Zhang%2C+Long+Zhou%2C+Chengyi+Wang%2C+Sanyuan+Chen%2C+et+al%2E+2023b%2E+Speak+foreign+languages+with+your+own+voice%3A+Cross%2Dlingual+neural+codec+language+modeling%2E+arXiv+preprint+arXiv%3A2303%2E03926%2E+%E2%80%94+%5BarXiv)

*Updated 24 October 2026*