--- title: "QVoice: Arabic Speech Pronunciation Learning — Kheir 2023" description: "QVoice is a mobile app for practising Arabic pronunciation." authors: ["Yassine El Kheir", "Fouad Khnaisser", "Shammur Absar Chowdhury", "Hamdy Mubarak", "Shazia Afzal", "Ahmed Ali"] year: 2023 venue: "arXiv:2305.07445 · InterSpeech 2023" source: "https://arxiv.org/abs/2305.07445" doi: "10.48550/arxiv.2305.07445" arxiv: "2305.07445" licence: "CC BY-NC-SA 4.0 (arXiv)" licence_url: "http://creativecommons.org/licenses/by-nc-sa/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/kheir-2023-qvoice-arabic-speech-pronunciation-learning/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/kheir-2023-qvoice-arabic-speech-pronunciation-learning/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/page/6/) / QVoice: Arabic Speech Pronunciation Learning Application # QVoice: Arabic Speech Pronunciation Learning Application **Authors:** [Yassine El Kheir](https://md.research.elamur.ai/free/en/authors/yassine-el-kheir/), Fouad Khnaisser, [Shammur Absar Chowdhury](https://md.research.elamur.ai/free/en/authors/shammur-absar-chowdhury/), [Hamdy Mubarak](https://md.research.elamur.ai/free/en/authors/hamdy-mubarak/), Shazia Afzal, [Ahmed Ali](https://md.research.elamur.ai/free/en/authors/ahmed-ali/) · **Year:** 2023 · **Venue:** arXiv:2305.07445 · InterSpeech 2023 · **Licence:** [CC BY-NC-SA 4.0 (arXiv)](http://creativecommons.org/licenses/by-nc-sa/4.0/) **Links:** [Publisher's page](https://arxiv.org/abs/2305.07445) · [PDF](https://arxiv.org/pdf/2305.07445) · [DOI 10.48550/arxiv.2305.07445](https://doi.org/10.48550/arxiv.2305.07445) · [arXiv 2305.07445](https://arxiv.org/abs/2305.07445) · [OpenAlex](https://openalex.org/W4376632789) **Citations:** 0 citations (openalex-snapshot · 2026-10-14) · [2](#cited-by) in our library, of the 140884 papers whose bibliographies we read ## Summary QVoice is a mobile app for practising Arabic pronunciation. It targets two groups: non-native learners, and native speakers whose regional dialect affects their Modern Standard Arabic (MSA). The authors present it as a system demo. The app has a Flutter front-end and a Flask back-end. The back-end runs an end-to-end mispronunciation detection model. This model scores each character of a recording and gives a separate score for the whole utterance, which lets it pinpoint insertions, deletions and substitutions. An extra attention component looks for errors caused by dialect. The practice content comes from more than 400 words and phrases drawn from educational sources. Each item carries: - a transliteration and an English translation, - reference audio, - an example sentence, - extra explanatory material. Items are vowelized with Farasa and voiced by a TTS engine. The paper reports response times but no detection accuracy figures. Its value is in showing how fine-grained diagnostic output can be combined with visual, audio and L1-linked cues to support self-paced pronunciation learning. ## Key points - The pipeline has three steps: the front-end fetches a practice item, the user's recording goes to a Flask API, and an end-to-end model returns character-level scores plus one utterance-level score. - The model detects insertions, deletions, substitutions and mispronounced characters. A dedicated attention mechanism targets errors driven by dialect. - The database holds more than 400 words/phrases from sources such as Aljazeera Learning and BTEC (Basic Travel Expression Corpus). - Text is vowelized with Farasa, and audio comes from QCRI's TTS (Natiq). - Supplementary material was produced by an internal generative model and verified for each item. - The interface has three views: - **Practice View:** the word, an image, a transliteration and a translation. - **Feedback View:** a star rating, color-coded characters on a red-to-green scale, the model's predicted sequence, and reference audio at normal and slowed speed. - **Assistant View:** an example sentence with its translation and TTS audio, plus a graphophonic explanation that uses English examples. - Reported latency is under 1 second to fetch an item and under 1.5 seconds to return feedback. No accuracy numbers are given in the paper. ## Interesting ideas - The model outputs what it believes was actually pronounced and aligns that against the reference, which turns a bare score into typed edits (inserted, dropped or swapped units). — For Mova (learn): Aligning a witness parser's output against agreed silver trees could label each disagreement by edit type (attachment, label, missing arc), giving structured input for self-induced repair rules. - Scores are reported at two granularities: fine per-unit scores shown in color, plus one coarse overall rating, so users can see both where it went wrong and how bad it was overall. — For Mova (tree): Each token's arc could carry a confidence shown as a color in the explanation view, alongside a sentence-level parse score, making weak spots in a tree easy to locate. - A separate model component is devoted to one known source of systematic error (dialect interference) instead of hoping the main model absorbs it. — For Mova (tree): During UD dialect conversion between treebanks, a dedicated detector for convention-specific constructions could flag arcs whose labels depend on the source dialect rather than on the sentence itself. - Each lexical item is stored as a rich bundle (translation, transliteration, usage sentence, audio), and the parts produced by a generative model are checked by humans for every item. — For Mova (world): Compiled lexicon entries could likewise pair each sense with an LLM-proposed example sentence that is verified before use, giving concrete contexts that ground frames and verb classes. - Showing a target word inside a full example sentence helps the learner see how it behaves in context, not just in isolation. — For Mova (back): The generator could be tested by producing a contextual sentence for a given lemma/frame and parsing it back, checking that the intended usage survives the round trip. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/) ## Cited by Cited by 2 papers of our library cite it (of the 140884 whose bibliographies we read); 1 of them have a page here, 1 not yet. - [IQRA 2026: Interspeech Challenge on Automatic Pronunciation Assessment for Modern Standard Arabic (MSA)](https://md.research.elamur.ai/free/en/papers/kheir-2026-iqra-2026-interspeech-challenge-automatic/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @misc{kheir2023qvoice, title = {{QVoice: Arabic Speech Pronunciation Learning Application}}, author = {Kheir, Yassine El and Khnaisser, Fouad and Chowdhury, Shammur Absar and Mubarak, Hamdy and Afzal, Shazia and Ali, Ahmed}, year = {2023}, doi = {10.48550/arxiv.2305.07445}, eprint = {2305.07445}, archivePrefix = {arXiv}, url = {https://doi.org/10.48550/arxiv.2305.07445} } ``` - [← previous Quranic Conversations: Developing a Semantic Search tool for the Quran using Arabic NLP Techniques](https://md.research.elamur.ai/free/en/papers/shohoud-2023-quranic-conversations-developing-semantic-search/) - [next → Qwen Technical Report](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-technical-report/) - [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/page/6/) ## References 2 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. [1] K. Darwish, H. Mubarak, and A. Abdelali, “Arabic diacritization: Stats, rules, and hacks,” in Proceedings of the third Arabic natural language processing workshop, 2017, pp. 9–17. [find](https://scholar.google.com/scholar?q=%5B1%5D+K%2E+Darwish%2C+H%2E+Mubarak%2C+and+A%2E+Abdelali%2C+%E2%80%9CArabic+diacritization%3A+Stats%2C+rules%2C+and+hacks%2C%E2%80%9D+in+Proceedings+of+the+third+Arabic+natural+language+processing+workshop%2C+2017%2C+pp%2E+9%E2%80%9317%2E) [our card](https://md.research.elamur.ai/free/en/papers/aclbulk-2017-darwish-arabic-diacritization-stats-rules-hacks/) 2. [2] A. Abdelali, N. Durrani, C. Demiroglu, F. Dalvi, H. Mubarak, and K. Darwish, “Natiq: An end-to-end text-to-speech system for arabic,” arXiv preprint arXiv:2206.07373, 2022. [↗](https://arxiv.org/abs/2206.07373)