--- title: "To Diverge or Not to Diverge — paper by Luo et al. (2024)" description: "Machine translation output is often described as more literal than human translation, but this gap had… 2 references, cited by 15 papers here." authors: ["Jiaming Luo", "Colin Cherry", "George Foster"] year: 2024 venue: "Transactions of the Association for Computational Linguistics" source: "https://aclanthology.org/2024.tacl-1.20/" doi: "10.1162/tacl_a_00645" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/luo-2024-diverge-or-not-diverge-morphosyntactic/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/luo-2024-diverge-or-not-diverge-morphosyntactic/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/7/) / To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation # To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation **Authors:** [Jiaming Luo](https://md.research.elamur.ai/free/en/authors/jiaming-luo/), [Colin Cherry](https://md.research.elamur.ai/free/en/authors/colin-cherry/) and [George Foster](https://md.research.elamur.ai/free/en/authors/george-foster/) · **Year:** 2024 · **Venue:** [Transactions of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/tacl/) ([Transactions of the Association for Computational Linguistics (TACL) 2024](https://md.research.elamur.ai/free/en/venues/tacl/2024/)) · **Publisher:** [The MIT Press](https://md.research.elamur.ai/free/en/publishers/the-mit-press/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2024.tacl-1.20/) · [PDF](https://aclanthology.org/2024.tacl-1.20.pdf) · [DOI 10.1162/tacl\_a\_00645](https://doi.org/10.1162/tacl_a_00645) · [OpenAlex](https://openalex.org/W4394773742) **Citations:** 9 citations (OpenAlex, 2026-10-14) · [15](https://md.research.elamur.ai/free/en/papers/luo-2024-diverge-or-not-diverge-morphosyntactic/cited-by/) in our library, of the 149,439 papers whose bibliographies we read ## Summary Machine translation output is often described as more literal than human translation, but this gap had rarely been measured at a fine structural level. Luo, Cherry and Foster quantify it through morphosyntactic divergence, meaning cases where the target structure departs from the source. For each of En→De, En→Zh and En→Fr, they hold out one million WMT sentence pairs. They parse both sides using the Universal Dependencies scheme, align words automatically, and compare thousands of patterns in human references and in outputs of bilingual Transformer-base systems. Two pattern types are used: word-based (POS plus parent and child dependencies) and arc-based (a source dependency arc versus the corresponding target path). In every pair, MT proves more cautious. It shows less structural variety, more convergent patterns and more one-to-one alignments, and it drifts further from HT for rarer source patterns. Experiments with different decoders identify beam search as the main driver of this pull toward convergence. Finally, most frequent divergences in references coincide with lower MT scores. The work matters for building more natural MT and for interpreting evaluation against human references. ## Key points - **Data and models.** The study uses WMT19 for En→De and En→Zh and WMT15 for En→Fr. Each training set was lightly filtered and deduplicated, and a 1M-sentence analysis subset was held out to avoid domain mismatch. The systems reach BLEU scores of 39.9 (Fr, newstest2014), 46.3 (De, newstest2018) and 34.4 (Zh, newstest2018). - **Tooling.** Dependency parsers were trained on UD treebanks (EWT for English, GSD for French, German and Chinese). The automatic word aligner achieves an F1 of about 83.6 (Fr) and 83.7 (Zh). - **Control verbs as a case study.** For English control constructions (xcomp) translated into French, MT keeps the source structure roughly 20% more often than human translators do. - **Role of beam search.** The bias toward convergence comes from beam search, not from ancestral sampling. It is strongest when the convergent rendering occurs in about half of the training examples for a source pattern. - **Effect on translation quality.** Experiment and control groups were built for each divergence, requiring at least 100 sentences per group. Divergences in HT are often linked to lower BLEU and BLEURT, but pattern frequency explains this only weakly. Pearson correlations with BLEURT are about 0.32 for Fr and 0.29 for De, and there is no correlation for Zh. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Google (Canada)](https://md.research.elamur.ai/free/en/companies/google-canada/) — Company, Waterloo, Canada · 5 works · 6,841 citations 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works 🧭 Topics (1): [🔁 Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/) · 1,087 works ## Cite Cite as: Jiaming Luo, Colin Cherry and George Foster. 2024. To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation. Transactions of the Association for Computational Linguistics. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @article{luo2024diverge, title = {{To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation}}, author = {Jiaming Luo, Colin Cherry and George Foster}, journal = {Transactions of the Association for Computational Linguistics}, year = {2024}, doi = {10.1162/tacl\_a\_00645}, url = {https://doi.org/10.1162/tacl_a_00645} } ``` - [← previous TeleChat Technical Report](https://md.research.elamur.ai/free/en/papers/he-2024-telechat-technical-report/) - [next → Adapting Multilingual LLMs to Low-Resource Languages with Knowledge Graphs via Adapters](https://md.research.elamur.ai/free/en/papers/gurgurov-2024-adapting-multilingual-llms-low-resource/) - [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/7/) ## References 2 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Roee Aharoni, Moshe Koppel, and Yoav Goldberg. 2014. Automatic detection of machine translated text and translation quality estimation. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 289–295, Baltimore, Maryland. Association… [find](https://scholar.google.com/scholar?q=Roee+Aharoni%2C+Moshe+Koppel%2C+and+Yoav+Goldberg%2E+2014%2E+Automatic+detection+of+machine+translated+text+and+translation+quality+estimation%2E+In+Proceedings+of+the+52nd+Annual+Meeting+of+the+Association+for) 2. Guangsheng Bao, Zhiyang Teng, and Yue Zhang. 2023. Target-side augmentation for document-level machine translation. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 10725–10742, Toronto, Canada. Association for Computational Li… [find](https://scholar.google.com/scholar?q=Guangsheng+Bao%2C+Zhiyang+Teng%2C+and+Yue+Zhang%2E+2023%2E+Target%2Dside+augmentation+for+document%2Dlevel+machine+translation%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+Association+for+Computational+Lingu) *Updated 30 October 2026*