---
title: "GuoFeng: A Benchmark for Zero Pronoun Recovery and — Xu 2022"
description: "Pro-drop languages such as Chinese often leave pronouns unstated, and machine translation into English then produces output that is missing a subject or…"
authors: ["Mingzhou Xu", "Longyue Wang", "Derek F. Wong", "Hongye Liu", "Linfeng Song", "Lidia S. Chao", "Shuming Shi", "Zhaopeng Tu"]
year: 2022
venue: "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing"
source: "https://aclanthology.org/2022.emnlp-main.774/"
doi: "10.18653/v1/2022.emnlp-main.774"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/xu-2022-guofeng-benchmark-zero-pronoun-recovery/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/xu-2022-guofeng-benchmark-zero-pronoun-recovery/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2022](https://md.research.elamur.ai/free/papers/2022/page/2/) / GuoFeng: A Benchmark for Zero Pronoun Recovery and Translation

# GuoFeng: A Benchmark for Zero Pronoun Recovery and Translation

**Authors:** Mingzhou Xu, [Longyue Wang](https://md.research.elamur.ai/free/authors/longyue-wang/), [Derek F. Wong](https://md.research.elamur.ai/free/authors/derek-f-wong/), Hongye Liu, [Linfeng Song](https://md.research.elamur.ai/free/authors/linfeng-song/), [Lidia S. Chao](https://md.research.elamur.ai/free/authors/lidia-s-chao/), [Shuming Shi](https://md.research.elamur.ai/free/authors/shuming-shi/), [Zhaopeng Tu](https://md.research.elamur.ai/free/authors/zhaopeng-tu/) · **Year:** 2022 · **Venue:** Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2022.emnlp-main.774/) · [PDF](https://aclanthology.org/2022.emnlp-main.774.pdf) · [DOI 10.18653/v1/2022.emnlp-main.774](https://doi.org/10.18653/v1/2022.emnlp-main.774) · [OpenAlex](https://openalex.org/W4385574203)

**Citations:** 5 citations (openalex-snapshot · 2026-10-14) · [13](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Pro-drop languages such as Chinese often leave pronouns unstated, and machine translation into English then produces output that is missing a subject or refers to the wrong entity. Earlier work judged such systems mainly by BLEU, which barely reflects these errors. In addition, recovery and translation of dropped pronouns had been studied on separate corpora, one of them only automatically labeled. The authors address this with mZPRT, a human-annotated Chinese-English test set. It marks zero pronouns on the source side and pairs them with reference translations across five genres. They score systems with BLEU and with AZPT, a pronoun-focused accuracy measure adapted from APT, and compare eight models. Larger Transformers raise BLEU but leave pronoun accuracy almost unchanged. Dedicated ZPT and document-level methods help somewhat, but feeding gold pronoun labels yields far larger gains. The benchmark therefore shows that BLEU hides real progress and that much room for improvement remains.

## Key points
- **Dataset scale and genres:** mZPRT contains 8,093 sentences (about 146K Chinese and 190K English words) from five domains: Movie Subtitle (based on TVsub), Q&A Forum (based on BaiduKnows), Government News, Web Fiction and Personal Profile.
- **Annotation quality and cost:** average pairwise kappa is 0.91. Five annotators and two translators worked for two months at a cost of roughly US $10,000.
- **Pronoun types and frequency:** subjects make up about 80% of dropped pronouns, and around 44% of sentences contain at least one. These ZP sentences also form a diagnostic subset.
- **Scaling vs. ZPT methods:**
  - BIG and DEEP models gain +1.2 and +1.9 BLEU over BASE, yet AZPT barely moves.
  - Existing ZPT methods add +2.2 to +6.8 AZPT over BIG.
  - Oracle ZP input adds about +47.5 AZPT and +1.9 BLEU.
- **Document-level models and release:** on subtitles, the CACHE model improves AZPT by 3.8 points (47.4 → 51.2) with no BLEU gain. Data, code, models and guidelines are released at github.com/longyuewangdcu/mZPRT.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/) · [Machine translation](https://md.research.elamur.ai/free/shelves/machine-translation/)

Topics: [Machine translation](https://md.research.elamur.ai/free/topics/machine-translation/)

## Cited by

Cited by

13 papers of our library cite it (of the 140673 whose bibliographies we read); 2 of them have a page here, 11 not yet.

- [Document-Level Machine Translation with Large Language Models](https://md.research.elamur.ai/free/papers/wang-2023-document-level-machine-translation-large/)
- [Context-8: A Data Set for Evaluating Context Sensitivity in Machine Translation](https://md.research.elamur.ai/free/papers/wang-2026-context-8-data-set-evaluating/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{xu2022guofeng,
  title = {{GuoFeng: A Benchmark for Zero Pronoun Recovery and Translation}},
  author = {Xu, Mingzhou and Wang, Longyue and Wong, Derek F. and Liu, Hongye and Song, Linfeng and Chao, Lidia S. and Shi, Shuming and Tu, Zhaopeng},
  booktitle = {Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing},
  year = {2022},
  doi = {10.18653/v1/2022.emnlp-main.774},
  url = {https://doi.org/10.18653/v1/2022.emnlp-main.774}
}
```

- [← previous GRAVL-BERT: Graphical Visual-Linguistic Representations for Multimodal Coreference Resolution](https://md.research.elamur.ai/free/papers/guo-2022-gravl-bert-graphical-visual-linguistic/)
- [next → Handling Stress in Finite-State Morphological Analyzers for Ancient Greek and Ancient Hebrew](https://md.research.elamur.ai/free/papers/aclbulk-2022-swanson-handling-stress-finite-state-morphological/)
- [↑ back to papers of 2022](https://md.research.elamur.ai/free/papers/2022/page/2/)

## References

47 references, 16 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR. [↗](https://doi.org/10.48550/arxiv.1409.0473) [our card](https://md.research.elamur.ai/free/papers/bahdanau-2014-neural-machine-translation-jointly-learning/)
2. Elizabeth Baran, Yaqin Yang, and Nianwen Xue. 2012. Annotating dropped pronouns in chinese newswire text. In LREC 2012. [find](https://scholar.google.com/scholar?q=Elizabeth+Baran%2C+Yaqin+Yang%2C+and+Nianwen+Xue%2E+2012%2E+Annotating+dropped+pronouns+in+chinese+newswire+text%2E+In+LREC+2012%2E)
3. Tagyoung Chung and Daniel Gildea. 2010. Effects of empty categories on machine translation. In EMNLP. [find](https://scholar.google.com/scholar?q=Tagyoung+Chung+and+Daniel+Gildea%2E+2010%2E+Effects+of+empty+categories+on+machine+translation%2E+In+EMNLP%2E)
4. Michael Collins, Philipp Koehn, and Ivona Kučerová. 2005. Clause restructuring for statistical machine translation. In ACL. [find](https://scholar.google.com/scholar?q=Michael+Collins%2C+Philipp+Koehn%2C+and+Ivona+Kuc%CC%8Cerov%C3%A1%2E+2005%2E+Clause+restructuring+for+statistical+machine+translation%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/papers/collins-2005-clause-restructuring-statistical-machine-translation/)
5. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. Bert: Pre-training of deep bidirectional transformers for language understanding. In NAACL. [find](https://scholar.google.com/scholar?q=Jacob+Devlin%2C+Ming%2DWei+Chang%2C+Kenton+Lee%2C+and+Kristina+Toutanova%2E+2019%2E+Bert%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+In+NAACL%2E)
6. Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, and Yann N Dauphin. 2017. Convolutional sequence to sequence learning. In ICML. [↗](https://doi.org/10.48550/arxiv.1705.03122) [our card](https://md.research.elamur.ai/free/papers/gehring-2017-convolutional-sequence-sequence-learning/)
7. Liane Guillou and Christian Hardmeier. 2018. Automatic reference-based evaluation of pronoun translation misses the point. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4797–4802. [find](https://scholar.google.com/scholar?q=Liane+Guillou+and+Christian+Hardmeier%2E+2018%2E+Automatic+reference%2Dbased+evaluation+of+pronoun+translation+misses+the+point%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+in+Natural+Languag)
8. Christian Hardmeier and Marcello Federico. 2010. Modelling pronominal anaphora in statistical machine translation. In IWSLT. [find](https://scholar.google.com/scholar?q=Christian+Hardmeier+and+Marcello+Federico%2E+2010%2E+Modelling+pronominal+anaphora+in+statistical+machine+translation%2E+In+IWSLT%2E) [our card](https://md.research.elamur.ai/free/papers/hardmeier-2010-modelling-pronominal-anaphora-statistical-machine/)
9. Bei Li, Hui Liu, Ziyang Wang, Yufan Jiang, Tong Xiao, Jingbo Zhu, Tongran Liu, and Changliang Li. 2020. Does multi-encoder help? a case study on context-aware neural machine translation. In ACL. [find](https://scholar.google.com/scholar?q=Bei+Li%2C+Hui+Liu%2C+Ziyang+Wang%2C+Yufan+Jiang%2C+Tong+Xiao%2C+Jingbo+Zhu%2C+Tongran+Liu%2C+and+Changliang+Li%2E+2020%2E+Does+multi%2Dencoder+help%3F+a+case+study+on+context%2Daware+neural+machine+translation%2E+In+ACL%2E)
10. Charles N Li and Sandra A Thompson. 1979. Third-person pronouns and zero-anaphora in chinese discourse. In Discourse and syntax. Brill. [↗](https://doi.org/10.1163/9789004368897_014)
11. Shuming Ma, Dongdong Zhang, and Ming Zhou. 2020. A simple and effective unified encoder for document-level machine translation. In ACL. [find](https://scholar.google.com/scholar?q=Shuming+Ma%2C+Dongdong+Zhang%2C+and+Ming+Zhou%2E+2020%2E+A+simple+and+effective+unified+encoder+for+document%2Dlevel+machine+translation%2E+In+ACL%2E)
12. Aya A Mitani, Phoebe E Freer, and Kerrie P Nelson. 2017. Summary measures of agreement and association between many raters’ ordinal classifications. Annals of epidemiology. [↗](https://doi.org/10.1016/j.annepidem.2017.09.001)
13. Ruslan Mitkov. 2014. ledge. Anaphora resolution. [find](https://scholar.google.com/scholar?q=Ruslan+Mitkov%2E+2014%2E+ledge%2E+Anaphora+resolution%2E)
14. Rout-Mathias Müller, Annette Rios, Elena Voita, and Rico Sennrich. 2018. A large-scale test set for the evaluation of context-aware pronoun translation in neural machine translation. In WMT. [find](https://scholar.google.com/scholar?q=Rout%2DMathias+M%C3%BCller%2C+Annette+Rios%2C+Elena+Voita%2C+and+Rico+Sennrich%2E+2018%2E+A+large%2Dscale+test+set+for+the+evaluation+of+context%2Daware+pronoun+translation+in+neural+machine+translation%2E+In+WMT%2E) [our card](https://md.research.elamur.ai/free/papers/muller-2018-large-scale-test-set-evaluation/)
15. Franz Josef Och and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. In CL. [↗](https://doi.org/10.1162/089120103321337421)
16. Myle Ott, Sergey Edunov, David Grangier, and Michael Auli. 2018. Scaling neural machine translation. In ACL. [find](https://scholar.google.com/scholar?q=Myle+Ott%2C+Sergey+Edunov%2C+David+Grangier%2C+and+Michael+Auli%2E+2018%2E+Scaling+neural+machine+translation%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/papers/ott-2018-scaling-neural-machine-translation/)
17. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A Method for Automatic Evaluation of Machine Translation. In ACL. [find](https://scholar.google.com/scholar?q=Kishore+Papineni%2C+Salim+Roukos%2C+Todd+Ward%2C+and+Wei%2DJing+Zhu%2E+2002%2E+BLEU%3A+A+Method+for+Automatic+Evaluation+of+Machine+Translation%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/papers/papineni-2002-bleu-method-automatic-evaluation-machine/)
18. Jesús Peral and Antonio Ferrández. 2003. Translation of pronominal anaphora between english and spanish: Discrepancies and evaluation. In JAIR. [↗](https://doi.org/10.1613/jair.1115)
19. Sameer Pradhan, Alessandro Moschitti, Nianwen Xue, Olga Uryupina, and Yuchen Zhang. 2012. Conll-2012 shared task: Modeling multilingual unrestricted coreference in ontonotes. In CoNLL-WS. [find](https://scholar.google.com/scholar?q=Sameer+Pradhan%2C+Alessandro+Moschitti%2C+Nianwen+Xue%2C+Olga+Uryupina%2C+and+Yuchen+Zhang%2E+2012%2E+Conll%2D2012+shared+task%3A+Modeling+multilingual+unrestricted+coreference+in+ontonotes%2E+In+CoNLL%2DWS%2E) [our card](https://md.research.elamur.ai/free/papers/pradhan-2012-conll-2012-shared-task-modeling/)
20. Sudha Rao, Allyson Ettinger, Hal Daumé III, and Philip Resnik. 2015. Dialogue focus tracking for zero pronoun resolution. In NAACL. [find](https://scholar.google.com/scholar?q=Sudha+Rao%2C+Allyson+Ettinger%2C+Hal+Daum%C3%A9+III%2C+and+Philip+Resnik%2E+2015%2E+Dialogue+focus+tracking+for+zero+pronoun+resolution%2E+In+NAACL%2E)
21. Ricardo Rei, Craig Stewart, Ana C Farinha, and Alon Lavie. 2020. COMET: A neural framework for MT evaluation. In EMNLP. [find](https://scholar.google.com/scholar?q=Ricardo+Rei%2C+Craig+Stewart%2C+Ana+C+Farinha%2C+and+Alon+Lavie%2E+2020%2E+COMET%3A+A+neural+framework+for+MT+evaluation%2E+In+EMNLP%2E) [our card](https://md.research.elamur.ai/free/papers/rei-2020-comet-neural-framework-mt-evaluation/)
22. Ryokan Ri, Toshiaki Nakazawa, and Yoshimasa Tsuruoka. 2021. Zero-pronoun data augmentation for japanese-to-english translation. In WAT. [find](https://scholar.google.com/scholar?q=Ryokan+Ri%2C+Toshiaki+Nakazawa%2C+and+Yoshimasa+Tsuruoka%2E+2021%2E+Zero%2Dpronoun+data+augmentation+for+japanese%2Dto%2Denglish+translation%2E+In+WAT%2E)
23. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. Neural Machine Translation of Rare Words with Subword Units. In ACL. [find](https://scholar.google.com/scholar?q=Rico+Sennrich%2C+Barry+Haddow%2C+and+Alexandra+Birch%2E+2016%2E+Neural+Machine+Translation+of+Rare+Words+with+Subword+Units%2E+In+ACL%2E)
24. Linfeng Song, Kun Xu, Yue Zhang, Jianshu Chen, and Dong Yu. 2020. ZPR2: Joint zero pronoun recovery and resolution using multi-task learning and BERT. In ACL. [find](https://scholar.google.com/scholar?q=Linfeng+Song%2C+Kun+Xu%2C+Yue+Zhang%2C+Jianshu+Chen%2C+and+Dong+Yu%2E+2020%2E+ZPR2%3A+Joint+zero+pronoun+recovery+and+resolution+using+multi%2Dtask+learning+and+BERT%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/papers/song-2020-zpr2-joint-zero-pronoun-recovery/)
25. Hui Su, Xiaoyu Shen, Rongzhi Zhang, Fei Sun, Pengwei Hu, Cheng Niu, and Jie Zhou. 2019. Improving Multi-turn Dialogue Modelling with Utterance ReWriter. In ACL. [find](https://scholar.google.com/scholar?q=Hui+Su%2C+Xiaoyu+Shen%2C+Rongzhi+Zhang%2C+Fei+Sun%2C+Pengwei+Hu%2C+Cheng+Niu%2C+and+Jie+Zhou%2E+2019%2E+Improving+Multi%2Dturn+Dialogue+Modelling+with+Utterance+ReWriter%2E+In+ACL%2E)
26. Xin Tan, Longyin Zhang, and Guodong Zhou. 2021. Coupling context modeling with zero pronoun recovering for document-level natural language generation. In EMNLP. [find](https://scholar.google.com/scholar?q=Xin+Tan%2C+Longyin+Zhang%2C+and+Guodong+Zhou%2E+2021%2E+Coupling+context+modeling+with+zero+pronoun+recovering+for+document%2Dlevel+natural+language+generation%2E+In+EMNLP%2E)
27. Zhaopeng Tu, Yang Liu, Lifeng Shang, Xiaohua Liu, and Hang Li. 2017. Neural machine translation with reconstruction. In AAAI. [find](https://scholar.google.com/scholar?q=Zhaopeng+Tu%2C+Yang+Liu%2C+Lifeng+Shang%2C+Xiaohua+Liu%2C+and+Hang+Li%2E+2017%2E+Neural+machine+translation+with+reconstruction%2E+In+AAAI%2E)
28. Zhaopeng Tu, Yang Liu, Shuming Shi, and Tong Zhang. 2018. Learning to remember translation history with a continuous cache. In TACL. [↗](https://doi.org/10.1162/tacl_a_00029)
29. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017a. Attention is all you need. In NeurIPS. [find](https://scholar.google.com/scholar?q=Ashish+Vaswani%2C+Noam+Shazeer%2C+Niki+Parmar%2C+Jakob+Uszkoreit%2C+Llion+Jones%2C+Aidan+N+Gomez%2C+%C5%81ukasz+Kaiser%2C+and+Illia+Polosukhin%2E+2017a%2E+Attention+is+all+you+need%2E+In+NeurIPS%2E)
30. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017b. Attention is all you need. In NIPS. [find](https://scholar.google.com/scholar?q=Ashish+Vaswani%2C+Noam+Shazeer%2C+Niki+Parmar%2C+Jakob+Uszkoreit%2C+Llion+Jones%2C+Aidan+N+Gomez%2C+%C5%81ukasz+Kaiser%2C+and+Illia+Polosukhin%2E+2017b%2E+Attention+is+all+you+need%2E+In+NIPS%2E)
31. Elena Voita, Rico Sennrich, and Ivan Titov. 2019. When a good translation is wrong in context: Context-aware machine translation improves on deixis, ellipsis, and lexical cohesion. In ACL. [find](https://scholar.google.com/scholar?q=Elena+Voita%2C+Rico+Sennrich%2C+and+Ivan+Titov%2E+2019%2E+When+a+good+translation+is+wrong+in+context%3A+Context%2Daware+machine+translation+improves+on+deixis%2C+ellipsis%2C+and+lexical+cohesion%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/papers/voita-2019-when-good-translation-is-wrong/)
32. Jiacheng Zhang, Huanbo Luan, Maosong Sun, Feifei Zhai, Jingfang Xu, Min Zhang, and Yang Liu. 2018. Improving the transformer translation model with document-level context. In EMNLP. [find](https://scholar.google.com/scholar?q=Jiacheng+Zhang%2C+Huanbo+Luan%2C+Maosong+Sun%2C+Feifei+Zhai%2C+Jingfang+Xu%2C+Min+Zhang%2C+and+Yang+Liu%2E+2018%2E+Improving+the+transformer+translation+model+with+document%2Dlevel+context%2E+In+EMNLP%2E) [our card](https://md.research.elamur.ai/free/papers/zhang-2018-improving-transformer-translation-model-document/)
33. Elena Voita, Pavel Serdyukov, Rico Sennrich, and Ivan Titov. 2018. Context-aware neural machine translation learns anaphora resolution. In ACL. [find](https://scholar.google.com/scholar?q=Elena+Voita%2C+Pavel+Serdyukov%2C+Rico+Sennrich%2C+and+Ivan+Titov%2E+2018%2E+Context%2Daware+neural+machine+translation+learns+anaphora+resolution%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/papers/voita-2018-context-aware-neural-machine-translation/)
34. Weinan Zhang, Ting Liu, Qingyu Yin, and Yu Zhang. 2019. Neural recovery machine for Chinese dropped pronoun. In Frontiers of Computer Science. [↗](https://doi.org/10.1007/s11704-018-7136-7)
35. Yu Wan, Dayiheng Liu, Baosong Yang, Haibo Zhang, Boxing Chen, Derek Wong, and Lidia Chao. 2022. UniTE: Unified translation evaluation. In ACL. [find](https://scholar.google.com/scholar?q=Yu+Wan%2C+Dayiheng+Liu%2C+Baosong+Yang%2C+Haibo+Zhang%2C+Boxing+Chen%2C+Derek+Wong%2C+and+Lidia+Chao%2E+2022%2E+UniTE%3A+Unified+translation+evaluation%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/papers/wan-2022-unite-unified-translation-evaluation/)
36. Longyue Wang, Zhaopeng Tu, Shuming Shi, Tong Zhang, Yvette Graham, and Qun Liu. 2018a. Translating pro-drop languages with reconstruction models. In AAAI. [find](https://scholar.google.com/scholar?q=Longyue+Wang%2C+Zhaopeng+Tu%2C+Shuming+Shi%2C+Tong+Zhang%2C+Yvette+Graham%2C+and+Qun+Liu%2E+2018a%2E+Translating+pro%2Ddrop+languages+with+reconstruction+models%2E+In+AAAI%2E)
37. Longyue Wang, Zhaopeng Tu, Xing Wang, and Shuming Shi. 2019. One model to learn both: Zero pronoun prediction and translation. In EMNLP-IJCNLP. [↗](https://doi.org/10.48550/arxiv.1909.00369) [our card](https://md.research.elamur.ai/free/papers/wang-2019-one-model-learn-both-zero/)
38. Longyue Wang, Zhaopeng Tu, Andy Way, and Qun Liu. 2017a. Exploiting cross-sentence context for neural machine translation. In EMNLP. [find](https://scholar.google.com/scholar?q=Longyue+Wang%2C+Zhaopeng+Tu%2C+Andy+Way%2C+and+Qun+Liu%2E+2017a%2E+Exploiting+cross%2Dsentence+context+for+neural+machine+translation%2E+In+EMNLP%2E)
39. Longyue Wang, Zhaopeng Tu, Andy Way, and Qun Liu. 2018b. Learning to jointly translate and predict dropped pronouns with a shared reconstruction mechanism. In EMNLP. [find](https://scholar.google.com/scholar?q=Longyue+Wang%2C+Zhaopeng+Tu%2C+Andy+Way%2C+and+Qun+Liu%2E+2018b%2E+Learning+to+jointly+translate+and+predict+dropped+pronouns+with+a+shared+reconstruction+mechanism%2E+In+EMNLP%2E)
40. Longyue Wang, Zhaopeng Tu, Xiaojun Zhang, Hang Li, Andy Way, and Qun Liu. 2016. A novel approach to dropped pronoun translation. In NAACL. [↗](https://doi.org/10.48550/arxiv.1604.06285)
41. Longyue Wang, Zhaopeng Tu, Xiaojun Zhang, Siyou Liu, Hang Li, Andy Way, and Qun Liu. 2017b. A novel and robust approach for pro-drop language translation. Machine Translation, 31(1):65–87. [↗](https://doi.org/10.1007/s10590-016-9184-9)
42. Lesly Miculicich Werlen and Andrei Popescu-Belis. 2017. Validation of an automatic metric for the accuracy of pronoun translation (apt). In DiscoMT. [find](https://scholar.google.com/scholar?q=Lesly+Miculicich+Werlen+and+Andrei+Popescu%2DBelis%2E+2017%2E+Validation+of+an+automatic+metric+for+the+accuracy+of+pronoun+translation+%28apt%29%2E+In+DiscoMT%2E) [our card](https://md.research.elamur.ai/free/papers/werlen-2017-validation-automatic-metric-accuracy-pronoun/)
43. Mingzhou Xu, Liangyou Li, Derek F. Wong, Qun Liu, and Lidia S. Chao. 2021. Document graph for neural machine translation. In EMNLP. [↗](https://doi.org/10.48550/arxiv.2012.03477)
44. Jingxuan Yang, Jianzhuo Tong, Si Li, Sheng Gao, Jun Guo, and Nianwen Xue. 2019. Recovering dropped pronouns in Chinese conversations via modeling their referents. In NAACL. [↗](https://doi.org/10.48550/arxiv.1906.02128)
45. Yaqin Yang, Yalin Liu, and Nianwen Xue. 2015. Recovering dropped pronouns from chinese text messages. In ACL-IJCNLP. [find](https://scholar.google.com/scholar?q=Yaqin+Yang%2C+Yalin+Liu%2C+and+Nianwen+Xue%2E+2015%2E+Recovering+dropped+pronouns+from+chinese+text+messages%2E+In+ACL%2DIJCNLP%2E)
46. Yaqin Yang and Nianwen Xue. 2010. Chasing the ghost: recovering empty categories in the chinese treebank. In COLING. [find](https://scholar.google.com/scholar?q=Yaqin+Yang+and+Nianwen+Xue%2E+2010%2E+Chasing+the+ghost%3A+recovering+empty+categories+in+the+chinese+treebank%2E+In+COLING%2E)
47. Lei Yu, Laurent Sartran, Wojciech Stokowiec, Wang Ling, Lingpeng Kong, Phil Blunsom, and Chris Dyer. 2020. Better document-level machine translation with bayes’ rule. In TACL. [↗](https://doi.org/10.1162/tacl_a_00319)