---
title: "Automatic Prediction of Prominence and Boundary — Mas 2026"
description: "Text-to-speech systems struggle to infer prosody from text alone, though earlier work showed that oracle prosodic labels improve the rendering and…"
authors: ["Pauline Mas", "Kévin Vythelingum", "Jonathan Chevelu", "Marion Ouédraogo", "Damien Lolive", "Olivier Rosec"]
year: 2026
venue: "Proceedings of the Fifteenth Language Resources and Evaluation Conference"
source: "https://aclanthology.org/2026.lrec-1.437/"
doi: "10.63317/3k3ii2w38tnj"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/mas-2026-automatic-prediction-prominence-boundary-strength/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/mas-2026-automatic-prediction-prominence-boundary-strength/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/) / Automatic Prediction of Prominence and Boundary Strength from Text

# Automatic Prediction of Prominence and Boundary Strength from Text

**Authors:** Pauline Mas, Kévin Vythelingum, Jonathan Chevelu, Marion Ouédraogo, Damien Lolive, Olivier Rosec · **Year:** 2026 · **Venue:** Proceedings of the Fifteenth Language Resources and Evaluation Conference · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.lrec-1.437/) · [PDF](https://aclanthology.org/2026.lrec-1.437.pdf) · [DOI 10.63317/3k3ii2w38tnj](https://doi.org/10.63317/3k3ii2w38tnj) · [OpenAlex](https://openalex.org/W7160145953)

**Citations:** 0 citations (openalex-snapshot · 2026-10-14)

## Summary
Text-to-speech systems struggle to infer prosody from text alone, though earlier work showed that oracle prosodic labels improve the rendering and controllability of synthetic speech. This paper asks whether continuous prominence and boundary strength values can be estimated from French text only, with the values obtained using the wavelet-based prosody tool developed by Suni et al. (2017). The authors compare three syllable-level approaches on nine speakers from the Mufasa audiobook corpus. The first is a FastSpeech2 variant with two extra predictors placed before the duration predictor and trained jointly with the TTS model. The second is BIPP, a standalone transformer whose decoder uses encoded phonetized syllables to query frozen camemBERT embeddings via cross-attention. The third is an auto-regressive BIPP that conditions on previously predicted prosodic values instead of syllables. Standard BIPP performed best. This suggests that pairing syllable information with semantic embeddings from a BERT-like model is the most effective route. The approach avoids expert ToBI-style annotation and reference audio, which opens the way to interpretable prosody control and style transfer.

## Key points
- Targets are the toolkit's continuous prominence and boundary values rather than its discretized 0–2 labels. They are computed per syllable instead of per word, from F0, energy and duration via a continuous wavelet transform.
- Data: a subset of Mufasa (open-source French audiobooks) with 9 speakers (5 female, 4 male). The subset is unbalanced, with two female speakers accounting for almost a third of the audio.
- BIPP uses a frozen camemBERT encoder. Its last-layer embedding outperformed max-pooling over all hidden layers. The model also has a convolutional syllable encoder (output dimension 256), a 2-head transformer decoder, speaker embeddings and parallel prominence and boundary heads.
- Cross-attention removes the need to explicitly align syllables with camemBERT's subword tokens.
- Salient events were analyzed separately, using thresholds at 80% (prominence) and 90% (boundaries) of the cumulative distribution. Planned future work includes integrating BIPP into TTS, testing style transfer and building GUI-based prosody control.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{mas2026automatic,
  title = {{Automatic Prediction of Prominence and Boundary Strength from Text}},
  author = {Mas, Pauline and Vythelingum, Kévin and Chevelu, Jonathan and Ouédraogo, Marion and Lolive, Damien and Rosec, Olivier},
  booktitle = {Proceedings of the Fifteenth Language Resources and Evaluation Conference},
  year = {2026},
  doi = {10.63317/3k3ii2w38tnj},
  url = {https://doi.org/10.63317/3k3ii2w38tnj}
}
```

- [← previous AuthorMix: Modular Authorship Style Transfer via Layer-wise Adapter Mixing](https://md.research.elamur.ai/free/en/papers/thillainathan-2026-authormix-modular-authorship-style-transfer/)
- [next → Automatic Suggestions Help Extending Eventive Ontology: A Case Study on SynSemClass](https://md.research.elamur.ai/free/en/papers/strakova-2026-automatic-suggestions-help-extending-eventive/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/)

## References

22 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Chung-Ming Chien and Hung-yi Lee. 2021. Hierarchical prosody modeling for non-autoregressive speech synthesis. In 2021 IEEE Spoken Language Technology Workshop (SLT), pages 446– 453. [find](https://scholar.google.com/scholar?q=Chung%2DMing+Chien+and+Hung%2Dyi+Lee%2E+2021%2E+Hierarchical+prosody+modeling+for+non%2Dautoregressive+speech+synthesis%2E+In+2021+IEEE+Spoken+Language+Technology+Workshop+%28SLT%29%2C+pages+446%E2%80%93+453%2E)
2. Ziqian Dai, Jianwei Yu, Yan Wang, Nuo Chen, Yanyao Bian, Guangzhi Li, Deng Cai, and Dong Yu. 2022. Automatic Prosody Annotation with Pre-Trained Text-Speech Model. In Interspeech 2022, pages 5513–5517. [find](https://scholar.google.com/scholar?q=Ziqian+Dai%2C+Jianwei+Yu%2C+Yan+Wang%2C+Nuo+Chen%2C+Yanyao+Bian%2C+Guangzhi+Li%2C+Deng+Cai%2C+and+Dong+Yu%2E+2022%2E+Automatic+Prosody+Annotation+with+Pre%2DTrained+Text%2DSpeech+Model%2E+In+Interspeech+2022%2C+pages+5513%E2%80%935517)
3. Wietse De Vries, Andreas Van Cranenburgh, and Malvina Nissim. 2020. What’s so special about BERT’s layers? A closer look at the NLP pipeline in monolingual and multilingual models. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 4339–4350, Online. Association for Comp… [find](https://scholar.google.com/scholar?q=Wietse+De+Vries%2C+Andreas+Van+Cranenburgh%2C+and+Malvina+Nissim%2E+2020%2E+What%E2%80%99s+so+special+about+BERT%E2%80%99s+layers%3F+A+closer+look+at+the+NLP+pipeline+in+monolingual+and+multilingual+models%2E+In+Findings+of+the+)
4. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… [find](https://scholar.google.com/scholar?q=Jacob+Devlin%2C+Ming%2DWei+Chang%2C+Kenton+Lee%2C+and+Kristina+Toutanova%2E+2019%2E+BERT%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+In+Proceedings+of+the+2019+Conference+of+the+N)
5. Esther Grabe, Francis Nolan, and Kimberley J. Farrar. 1998. Ivie - a comparative transcription system for intonational variation in english. In 5th International Conference on Spoken Language Processing (ICSLP 1998), page paper 0099. [find](https://scholar.google.com/scholar?q=Esther+Grabe%2C+Francis+Nolan%2C+and+Kimberley+J%2E+Farrar%2E+1998%2E+Ivie+%2D+a+comparative+transcription+system+for+intonational+variation+in+english%2E+In+5th+International+Conference+on+Spoken+Language+Processi)
6. Ganesh Jawahar, Benoît Sagot, and Djamé Seddah. 2019. What does BERT learn about the structure of language? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3651–3657, Florence, Italy. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ganesh+Jawahar%2C+Beno%C3%AEt+Sagot%2C+and+Djam%C3%A9+Seddah%2E+2019%2E+What+does+BERT+learn+about+the+structure+of+language%3F+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+) [our card](https://md.research.elamur.ai/free/en/papers/jawahar-2019-what-does-bert-learn-about/)
7. Sofoklis Kakouros and Johannah O’Mahony. 2023. What does BERT learn about prosody? [find](https://scholar.google.com/scholar?q=Sofoklis+Kakouros+and+Johannah+O%E2%80%99Mahony%2E+2023%2E+What+does+BERT+learn+about+prosody%3F)
8. Taku Kudo and John Richardson. 2018. SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 66– 71, Brussels, Belgium. Assoc… [find](https://scholar.google.com/scholar?q=Taku+Kudo+and+John+Richardson%2E+2018%2E+SentencePiece%3A+A+simple+and+language+independent+subword+tokenizer+and+detokenizer+for+neural+text+processing%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+M) [our card](https://md.research.elamur.ai/free/en/papers/kudo-2018-sentencepiece-simple-language-independent-subword/)
9. Yongjie Lin, Yi Chern Tan, and Robert Frank. 2019. Open Sesame: Getting inside BERT’s Linguistic Knowledge. In Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 241–253, Florence, Italy. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Yongjie+Lin%2C+Yi+Chern+Tan%2C+and+Robert+Frank%2E+2019%2E+Open+Sesame%3A+Getting+inside+BERT%E2%80%99s+Linguistic+Knowledge%2E+In+Proceedings+of+the+2019+ACL+Workshop+BlackboxNLP%3A+Analyzing+and+Interpreting+Neural+Netwo) [our card](https://md.research.elamur.ai/free/en/papers/lin-2019-open-sesame-getting-inside-bert/)
10. Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont, Laurent Romary, Éric de la Clergerie, Djamé Seddah, and Benoît Sagot. 2020. CamemBERT: a tasty French language model. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7203–7219, O… [find](https://scholar.google.com/scholar?q=Louis+Martin%2C+Benjamin+Muller%2C+Pedro+Javier+Ortiz+Su%C3%A1rez%2C+Yoann+Dupont%2C+Laurent+Romary%2C+%C3%89ric+de+la+Clergerie%2C+Djam%C3%A9+Seddah%2C+and+Beno%C3%AEt+Sagot%2E+2020%2E+CamemBERT%3A+a+tasty+French+language+model%2E+In+Proceed) [our card](https://md.research.elamur.ai/free/en/papers/martin-2019-camembert-tasty-french-language-model/)
11. Hosein Mohebbi, Ali Modarressi, and Mohammad Taher Pilehvar. 2021. Exploring the Role of BERT Token Representations to Explain Sentence Probing Results. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 792–806, Online and Punta Cana, Dominican Republic… [find](https://scholar.google.com/scholar?q=Hosein+Mohebbi%2C+Ali+Modarressi%2C+and+Mohammad+Taher+Pilehvar%2E+2021%2E+Exploring+the+Role+of+BERT+Token+Representations+to+Explain+Sentence+Probing+Results%2E+In+Proceedings+of+the+2021+Conference+on+Empiri)
12. Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2022. Robust speech recognition via large-scale weak supervision. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jong+Wook+Kim%2C+Tao+Xu%2C+Greg+Brockman%2C+Christine+McLeavey%2C+and+Ilya+Sutskever%2E+2022%2E+Robust+speech+recognition+via+large%2Dscale+weak+supervision%2E) [our card](https://md.research.elamur.ai/free/en/papers/radford-2022-robust-speech-recognition-large-scale/)
13. Yi Ren, Chenxu Hu, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, and Tie-Yan Liu. 2021. FastSpeech 2: Fast and high-quality end-to-end text to speech. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Yi+Ren%2C+Chenxu+Hu%2C+Xu+Tan%2C+Tao+Qin%2C+Sheng+Zhao%2C+Zhou+Zhao%2C+and+Tie%2DYan+Liu%2E+2021%2E+FastSpeech+2%3A+Fast+and+high%2Dquality+end%2Dto%2Dend+text+to+speech%2E+In+International+Conference+on+Learning+Representations)
14. Noam Shazeer. 2019. Fast transformer decoding: One write-head is all you need. [find](https://scholar.google.com/scholar?q=Noam+Shazeer%2E+2019%2E+Fast+transformer+decoding%3A+One+write%2Dhead+is+all+you+need%2E)
15. Atli Thor Sigurgeirsson and Simon King. 2023. Do prosody transfer models transfer prosody? In ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1–5. [find](https://scholar.google.com/scholar?q=Atli+Thor+Sigurgeirsson+and+Simon+King%2E+2023%2E+Do+prosody+transfer+models+transfer+prosody%3F+In+ICASSP+2023+%2D+2023+IEEE+International+Conference+on+Acoustics%2C+Speech+and+Signal+Processing+%28ICASSP%29%2C+page)
16. Kim Silverman, Mary Beckman, John Pitrelli, Mori Ostendorf, Colin Wightman, Patti Price, Janet Pierrehumbert, and Julia Hirschberg. 1992. Tobi: a standard for labeling english prosody. In 2nd International Conference on Spoken Language Processing (ICSLP 1992), pages 867–870. [find](https://scholar.google.com/scholar?q=Kim+Silverman%2C+Mary+Beckman%2C+John+Pitrelli%2C+Mori+Ostendorf%2C+Colin+Wightman%2C+Patti+Price%2C+Janet+Pierrehumbert%2C+and+Julia+Hirschberg%2E+1992%2E+Tobi%3A+a+standard+for+labeling+english+prosody%2E+In+2nd+Internat)
17. Antti Suni, Sofoklis Kakouros, Martti Vainio, and Juraj Šimko. 2020. Prosodic Prominence and Boundaries in Sequence-to-Sequence Speech Synthesis. In Speech Prosody 2020, pages 940– 944, ISCA. ISCA. [find](https://scholar.google.com/scholar?q=Antti+Suni%2C+Sofoklis+Kakouros%2C+Martti+Vainio%2C+and+Juraj+%C5%A0imko%2E+2020%2E+Prosodic+Prominence+and+Boundaries+in+Sequence%2Dto%2DSequence+Speech+Synthesis%2E+In+Speech+Prosody+2020%2C+pages+940%E2%80%93+944%2C+ISCA%2E+ISCA%2E)
18. Antti Suni, Juraj Šimko, Daniel Aalto, and Martti Vainio. 2017. Hierarchical representation and estimation of prosody using continuous wavelet transform. Computer Speech & Language, 45:123–136. [find](https://scholar.google.com/scholar?q=Antti+Suni%2C+Juraj+%C5%A0imko%2C+Daniel+Aalto%2C+and+Martti+Vainio%2E+2017%2E+Hierarchical+representation+and+estimation+of+prosody+using+continuous+wavelet+transform%2E+Computer+Speech+%26+Language%2C+45%3A123%E2%80%93136%2E)
19. Jacqueline Vaissière. 2020. Chapitre IX - Prosodie. In La Phonétique, volume 4e éd. of Que sais-je ?, pages 96–117. Presses Universitaires de France, Paris cedex 14. [find](https://scholar.google.com/scholar?q=Jacqueline+Vaissi%C3%A8re%2E+2020%2E+Chapitre+IX+%2D+Prosodie%2E+In+La+Phon%C3%A9tique%2C+volume+4e+%C3%A9d%2E+of+Que+sais%2Dje+%3F%2C+pages+96%E2%80%93117%2E+Presses+Universitaires+de+France%2C+Paris+cedex+14%2E)
20. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems, NIPS’17, page 6000–6010, Red Hook, NY, USA. Cur… [find](https://scholar.google.com/scholar?q=Ashish+Vaswani%2C+Noam+Shazeer%2C+Niki+Parmar%2C+Jakob+Uszkoreit%2C+Llion+Jones%2C+Aidan+N%2E+Gomez%2C+%C5%81ukasz+Kaiser%2C+and+Illia+Polosukhin%2E+2017%2E+Attention+is+all+you+need%2E+In+Proceedings+of+the+31st+International+)
21. Yuxiang Zou, Shichao Liu, Xiang Yin, Haopeng Lin, Chunfeng Wang, Haoyu Zhang, and Zejun Ma. 2021. Fine-grained prosody modeling in neural speech synthesis using tobi representation. In Interspeech 2021, pages 3146–3150. 9. [find](https://scholar.google.com/scholar?q=Yuxiang+Zou%2C+Shichao+Liu%2C+Xiang+Yin%2C+Haopeng+Lin%2C+Chunfeng+Wang%2C+Haoyu+Zhang%2C+and+Zejun+Ma%2E+2021%2E+Fine%2Dgrained+prosody+modeling+in+neural+speech+synthesis+using+tobi+representation%2E+In+Interspeech+202)
22. Language Resource References Sini, Aghilas and Wadoux, Lily and Perquin, Antoine and Vidal, Gaëlle and Guennec, David and Lolive, Damien and Alain, Pierre and Barbot, Nelly and Chevelu, Jonathan and Delhay, Arnaud. 2022. Techniques de synthèse vocale neuronale à l’épreuve des données d’apprentissage… [find](https://scholar.google.com/scholar?q=Language+Resource+References+Sini%2C+Aghilas+and+Wadoux%2C+Lily+and+Perquin%2C+Antoine+and+Vidal%2C+Ga%C3%ABlle+and+Guennec%2C+David+and+Lolive%2C+Damien+and+Alain%2C+Pierre+and+Barbot%2C+Nelly+and+Chevelu%2C+Jonathan+and+D)