---
title: "How Does a Deep Neural Network Look at Lexical Stress in"
description: "Neural networks detect lexical stress well, but it is unclear which acoustic evidence drives their decisions. 92% accuracy. Cited by 1 paper here."
authors: ["Itai Allouche; Itay Asael; Rotem Rousso; Vered Dassa; Ann Bradlow; Seung-Eun Kim; Matthew Goldrick;", "Joseph Keshet"]
year: 2025
venue: "arXiv:2508.07229 · The Journal of the Acoustical Society of America. 159(2), 1348-1358 (2026)"
source: "https://arxiv.org/abs/2508.07229"
doi: "10.1121/10.0042429"
arxiv: "2508.07229"
licence: "arXiv — non-exclusive license to distribute"
licence_url: "http://arxiv.org/licenses/nonexclusive-distrib/1.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/allouche-2025-deep-neural-network-look-lexical/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/allouche-2025-deep-neural-network-look-lexical/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/15/) / How Does a Deep Neural Network Look at Lexical Stress in English Words?

# How Does a Deep Neural Network Look at Lexical Stress in English Words?

**Authors:** Itai Allouche; Itay Asael; Rotem Rousso; Vered Dassa; Ann Bradlow; Seung-Eun Kim; Matthew Goldrick; and [Joseph Keshet](https://md.research.elamur.ai/free/en/authors/joseph-keshet/) · **Year:** 2025 · **Venue:** arXiv:2508.07229 · The Journal of the Acoustical Society of America. 159(2), 1348-1358 (2026) · **Licence:** [arXiv — non-exclusive license to distribute](http://arxiv.org/licenses/nonexclusive-distrib/1.0/)

**Links:** [Publisher's page](https://doi.org/10.1121/10.0042429) · [PDF](https://arxiv.org/pdf/2508.07229) · [DOI 10.1121/10.0042429](https://doi.org/10.1121/10.0042429) · [arXiv 2508.07229](https://arxiv.org/abs/2508.07229) · [OpenAlex](https://openalex.org/W4416241843)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/allouche-2025-deep-neural-network-look-lexical/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Neural networks detect lexical stress well, but it is unclear which acoustic evidence drives their decisions. The authors address this for English disyllabic words. They built a dataset with no human annotation of stress. ChatGPT 4o supplied word lists: 25 noun/verb stress minimal pairs such as protest, and 249 words without a minimal-pair counterpart. Tokens were cut from LibriSpeech, the Supreme Court corpus and TED-LIUM using forced alignment. Stress labels came from SpaCy part-of-speech tags for minimal pairs (noun means initial stress, verb means final stress) and from the CMU Pronouncing Dictionary for the other words. Several CNNs were trained on spectrograms of the non-minimal-pair words only and reached up to 92% accuracy on held-out data. Layerwise Relevance Propagation (LRP), applied to the unseen minimal pairs, shows the networks rely mostly on the stressed syllable, especially its vowel, while still using cues spread across the whole word. A new feature-specific relevance analysis points to F1 and F2 of the stressed vowel as the dominant cues, with some role for pitch and F3. The work shows that deep models learn distributed stress cues from natural, uncontrolled speech.

## Key points
- The dataset is released as MLSpeech/lexical_stress_dataset on Hugging Face. It has 7,446 initial-stress samples (124 types) and 3,263 final-stress samples (125 types) among the no-minimal-pair words.
- Alignment used the Montreal Forced Aligner for LibriSpeech and Supreme Court, and the provided timestamps for TED-LIUM. Each word sits in a fixed 0.5 s zero-padded window, and syllables were segmented with the P2TK syllabifier.
- The POS tagger mislabelled address, content, export, extract and decrease often enough that every instance of these words was manually relabelled.
- Training and test vocabularies were kept apart: models learned from non-minimal-pair words and were evaluated on minimal pairs they had never seen. This addresses lexical overlap left undocumented in earlier work.
- The contribution of syllabic and sub-syllabic regions to LRP heatmaps was quantified with an IOU metric. Feature-specific heatmaps for the stressed vowel were then compared against the full heatmap.

## Interesting ideas
- Holding out whole word types, here the hardest ambiguous ones, keeps memorised vocabulary from inflating accuracy and makes the test a real check of generalisation.
- Labels were derived automatically from another system's output (POS → stress), and human review was spent only on the few word types where that proxy failed systematically.
- Attribution maps were scored against linguistically defined spans (syllables, vowels) with IOU, turning a vague heatmap into a measurable claim about where the model looks.
- Building a relevance map restricted to one hypothesised cue and comparing it with the overall relevance tests whether the model uses known, theory-backed features.
- Noun/verb stress homographs such as protest and record exposed weaknesses in an off-the-shelf POS tagger.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (learn): Build evaluation splits for the tagger and parsers where test lemmas or constructions never occur in training, as a negative control against memorisation.
- **I2** (learn): When creating silver data from witness parsers, group disagreements by lemma or type and send only the clusters with systematic errors to the LLM teacher or manual review.
- **I3** (tree): Score gparse attributions against expected spans, such as the candidate head and its dependent, to check that attachment decisions rest on the right words.
- **I4** (tree): Restrict attribution to a single input feature group (morphology, POS, word form) to test whether gparse relies on interpretable cues rather than lexical identity.
- **I5** (tokens): Keep a targeted regression set of noun/verb homographs for the tagger, since errors there spread into the tree and frames.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Technion – Israel Institute of Technology](https://md.research.elamur.ai/free/en/universities/technion-israel-institute-of-technology/) — University, Haifa, Israel · 54 works · 7,237 citations
- [Northwestern University](https://md.research.elamur.ai/free/en/universities/northwestern-university/) — University, Evanston, United States · 46 works · 2,850 citations

📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,649 works · [💭 Experimental and Cognitive Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/experimental-and-cognitive-psychology/) · 930 works · [🔊 Signal Processing](https://md.research.elamur.ai/free/en/shelves/computer-science/signal-processing/) · 493 works

🧭 Topics (1): [English](https://md.research.elamur.ai/free/en/topics/english/) · 2,379 works

## Cite

Cite as: Itai Allouche; Itay Asael; Rotem Rousso; Vered Dassa; Ann Bradlow; Seung-Eun Kim; Matthew Goldrick; and Joseph Keshet. 2025. How Does a Deep Neural Network Look at Lexical Stress in English Words?. arXiv:2508.07229 · The Journal of the Acoustical Society of America. 159(2), 1348-1358 (2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{goldrick2025how,
  title = {{How Does a Deep Neural Network Look at Lexical Stress in English Words?}},
  author = {Itai Allouche; Itay Asael; Rotem Rousso; Vered Dassa; Ann Bradlow; Seung-Eun Kim; Matthew Goldrick; and Joseph Keshet},
  year = {2025},
  doi = {10.1121/10.0042429},
  eprint = {2508.07229},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.1121/10.0042429}
}
```

- [← previous Hope Speech Detection in Social Media English Corpora: Performance of Traditional and Transformer Models](https://md.research.elamur.ai/free/en/papers/ramos-2025-hope-speech-detection-social-media/)
- [next → HTU at MAHED Shared Task: Ensemble-Based Classification of Arabic Hate and Hope Speech Using Pre-trained Dialectal Arabic Models](https://md.research.elamur.ai/free/en/papers/saleh-2025-htu-mahed-shared-task-ensemble/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/15/)

*Updated 29 October 2026*