---
title: "Generating and Exploiting Large-scale Pseudo — Liu 2017"
description: "Zero pronoun (ZP) resolution in Chinese means finding the antecedent of an omitted pronoun."
authors: ["Ting Liu", "Yiming Cui", "Qingyu Yin", "Wei-Nan Zhang", "Shijin Wang", "Guoping Hu"]
year: 2017
venue: "Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/P17-1010/"
doi: "10.18653/v1/p17-1010"
arxiv: "1606.01603"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/liu-2017-generating-exploiting-large-scale-pseudo/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/liu-2017-generating-exploiting-large-scale-pseudo/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2017](https://md.research.elamur.ai/free/en/papers/2017/page/2/) / Generating and Exploiting Large-scale Pseudo Training Data for Zero Pronoun Resolution

# Generating and Exploiting Large-scale Pseudo Training Data for Zero Pronoun Resolution

**Authors:** [Ting Liu](https://md.research.elamur.ai/free/en/authors/ting-liu/), [Yiming Cui](https://md.research.elamur.ai/free/en/authors/yiming-cui/), [Qingyu Yin](https://md.research.elamur.ai/free/en/authors/qingyu-yin/), [Wei-Nan Zhang](https://md.research.elamur.ai/free/en/authors/wei-nan-zhang/), [Shijin Wang](https://md.research.elamur.ai/free/en/authors/shijin-wang/), [Guoping Hu](https://md.research.elamur.ai/free/en/authors/guoping-hu/) · **Year:** 2017 · **Venue:** Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/P17-1010/) · [PDF](https://aclanthology.org/P17-1010.pdf) · [DOI 10.18653/v1/p17-1010](https://doi.org/10.18653/v1/p17-1010) · [arXiv 1606.01603](https://arxiv.org/abs/1606.01603) · [OpenAlex](https://openalex.org/W2418403507)

**Citations:** 16 citations (openalex-snapshot · 2026-10-14) · [21](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Zero pronoun (ZP) resolution in Chinese means finding the antecedent of an omitted pronoun. Progress has been held back by reliance on small, hand-annotated corpora from shared tasks, which are expensive to extend or adapt to new domains. The authors treat the task as a form of cloze-style reading comprehension. From large unlabeled news collections they automatically build pseudo examples. A noun or pronoun that appears at least twice in a document is masked in one sentence, which becomes the query, and the model must recover the hidden word from the document. An attention-based network similar to the Attentive Reader learns to fill these gaps. Training happens in two stages: pre-training on the pseudo data, then adaptation on real OntoNotes 5.0 ZP data to bridge the difference in query style. Each single-word prediction is linked to a noun-phrase antecedent through head-word matching. The system improves on the previous state of the art by 3.1 F-score points (absolute). This suggests cheaply generated data can reduce the need for costly annotation.

## Key points
- Pseudo samples are triples ⟨D, Q, A⟩ (document, query with a blank, answer). Candidate answers are nouns or pronouns, identified with the LTP Toolkit, that occur two or more times in the document. The generation recipe is adapted from Hermann et al. (2015) but needs no document summaries.
- The model uses a shared embedding matrix, separate bidirectional GRU encoders, an averaged query representation, and soft attention over document tokens. A softmax over the vocabulary predicts the answer word.
- The two-step "pre-training-then-adaptation" scheme first selects the best model on pseudo data by validation accuracy. It then continues training on task-specific OntoNotes 5.0 data, and this outperforms using either data source alone.
- Unknown words are mapped to numbered tokens (unk1…unkN) by order of appearance within each sample, so they act as positional cues rather than a single shared UNK.
- NP candidates are extracted following Chen and Ng (2015) and scanned from nearest to farthest. The first NP whose head word matches the predicted word is chosen as the antecedent. Evaluation on OntoNotes 5.0 shows an absolute F-score gain of 3.1%.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

Topics: [Coreference resolution](https://md.research.elamur.ai/free/en/topics/coreference-resolution/)

## Cited by

Cited by

21 papers of our library cite it (of the 140673 whose bibliographies we read); 10 of them have a page here, 11 not yet.

- [Anaphoric Zero Pronoun Identification: A Multilingual Approach](https://md.research.elamur.ai/free/en/papers/aloraini-2020-anaphoric-zero-pronoun-identification-multilingual/)
- [Cross-lingual Zero Pronoun Resolution](https://md.research.elamur.ai/free/en/papers/aloraini-2020-cross-lingual-zero-pronoun-resolution/)
- [Joint Coreference Resolution for Zeros and non-Zeros in Arabic](https://md.research.elamur.ai/free/en/papers/aloraini-2022-joint-coreference-resolution-zeros-non/)
- [Tackling Zero Pronoun Resolution and Non-Zero Coreference Resolution Jointly](https://md.research.elamur.ai/free/en/papers/chen-2021-tackling-zero-pronoun-resolution-non/)
- [A Span-Extraction Dataset for Chinese Machine Reading Comprehension](https://md.research.elamur.ai/free/en/papers/cui-2018-span-extraction-dataset-chinese/)
- [Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Network](https://md.research.elamur.ai/free/en/papers/hou-2020-few-shot-slot-tagging-collapsed/)
- [An Empirical Study of Contextual Data Augmentation for Japanese Zero Anaphora Resolution](https://md.research.elamur.ai/free/en/papers/konno-2020-empirical-study-contextual-data-augmentation/)
- [Pseudo Zero Pronoun Resolution Improves Zero Anaphora Resolution](https://md.research.elamur.ai/free/en/papers/konno-2021-pseudo-zero-pronoun-resolution-improves/)
- [ZPR2: Joint Zero Pronoun Recovery and Resolution using Multi-Task Learning and BERT](https://md.research.elamur.ai/free/en/papers/song-2020-zpr2-joint-zero-pronoun-recovery/)
- [Zero Pronoun Resolution with Attention-based Neural Network](https://md.research.elamur.ai/free/en/papers/yin-2018-zero-pronoun-resolution-attention-based/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{liu2017generating,
  title = {{Generating and Exploiting Large-scale Pseudo Training Data for Zero Pronoun Resolution}},
  author = {Liu, Ting and Cui, Yiming and Yin, Qingyu and Zhang, Wei-Nan and Wang, Shijin and Hu, Guoping},
  booktitle = {Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2017},
  doi = {10.18653/v1/p17-1010},
  eprint = {1606.01603},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.18653/v1/p17-1010}
}
```

- [← previous Gender exponence and apparent polarity in a class of Omani Mehri plurals](https://md.research.elamur.ai/free/en/papers/lingbulk-2017-fathi-gender-exponence-apparent-polarity-class/)
- [next → Generating Sentences by Editing Prototypes](https://md.research.elamur.ai/free/en/papers/guu-2017-generating-sentences-editing-prototypes/)
- [↑ back to papers of 2017](https://md.research.elamur.ai/free/en/papers/2017/page/2/)

## References

25 references, 14 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 . [find](https://scholar.google.com/scholar?q=Dzmitry+Bahdanau%2C+Kyunghyun+Cho%2C+and+Yoshua+Bengio%2E+2014%2E+Neural+machine+translation+by+jointly+learning+to+align+and+translate%2E+arXiv+preprint+arXiv%3A1409%2E0473+%2E) [our card](https://md.research.elamur.ai/free/en/papers/bahdanau-2014-neural-machine-translation-jointly-learning/)
2. Jerry R Hobbs. 1978. Resolving pronoun references. Lingua 44(4):311–338. [find](https://scholar.google.com/scholar?q=Jerry+R+Hobbs%2E+1978%2E+Resolving+pronoun+references%2E+Lingua+44%284%29%3A311%E2%80%93338%2E) [our card](https://md.research.elamur.ai/free/en/papers/hobbs-1978-resolving-pronoun-references/)
3. Ryu Iida, Kentaro Inui, and Yuji Matsumoto. 2006. Exploiting syntactic patterns as clues in zero-anaphora resolution. In Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics. Association for Computa… [find](https://scholar.google.com/scholar?q=Ryu+Iida%2C+Kentaro+Inui%2C+and+Yuji+Matsumoto%2E+2006%2E+Exploiting+syntactic+patterns+as+clues+in+zero%2Danaphora+resolution%2E+In+Proceedings+of+the+21st+International+Conference+on+Computational+Linguistics+a) [our card](https://md.research.elamur.ai/free/en/papers/iida-2006-exploiting-syntactic-patterns-as-clues/)
4. Wanxiang Che, Zhenghua Li, and Ting Liu. 2010. Ltp: A chinese language technology platform. In Proceedings of the 23rd International Conference on Computational Linguistics: Demonstrations. Association for Computational Linguistics, pages 13–16. [find](https://scholar.google.com/scholar?q=Wanxiang+Che%2C+Zhenghua+Li%2C+and+Ting+Liu%2E+2010%2E+Ltp%3A+A+chinese+language+technology+platform%2E+In+Proceedings+of+the+23rd+International+Conference+on+Computational+Linguistics%3A+Demonstrations%2E+Associatio)
5. Chen Chen and Vincent Ng. 2013. Chinese zero pronoun resolution: Some recent advances. In EMNLP. pages 1360–1365. [find](https://scholar.google.com/scholar?q=Chen+Chen+and+Vincent+Ng%2E+2013%2E+Chinese+zero+pronoun+resolution%3A+Some+recent+advances%2E+In+EMNLP%2E+pages+1360%E2%80%931365%2E) [our card](https://md.research.elamur.ai/free/en/papers/chen-2013-chinese-zero-pronoun-resolution-some/)
6. Ryu Iida, Kentaro Inui, and Yuji Matsumoto. 2007. Zero-anaphora resolution by learning rich syntactic pattern features. ACM Transactions on Asian Language Information Processing (TALIP) 6(4):1. [find](https://scholar.google.com/scholar?q=Ryu+Iida%2C+Kentaro+Inui%2C+and+Yuji+Matsumoto%2E+2007%2E+Zero%2Danaphora+resolution+by+learning+rich+syntactic+pattern+features%2E+ACM+Transactions+on+Asian+Language+Information+Processing+%28TALIP%29+6%284%29%3A1%2E)
7. Chen Chen and Vincent Ng. 2014. Chinese zero pronoun resolution: An unsupervised approach combining ranking and integer linear programming. In Twenty-Eighth AAAI Conference on Artificial Intelligence. [find](https://scholar.google.com/scholar?q=Chen+Chen+and+Vincent+Ng%2E+2014%2E+Chinese+zero+pronoun+resolution%3A+An+unsupervised+approach+combining+ranking+and+integer+linear+programming%2E+In+Twenty%2DEighth+AAAI+Conference+on+Artificial+Intelligence%2E)
8. Ryu Iida and Massimo Poesio. 2011. A cross-lingual ilp solution to zero anaphora resolution. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1. Association for Computational Linguistics, pages 804–813. [find](https://scholar.google.com/scholar?q=Ryu+Iida+and+Massimo+Poesio%2E+2011%2E+A+cross%2Dlingual+ilp+solution+to+zero+anaphora+resolution%2E+In+Proceedings+of+the+49th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%3A+Human+Language+) [our card](https://md.research.elamur.ai/free/en/papers/iida-2011-cross-lingual-ilp-solution-zero/)
9. Chen Chen and Vincent Ng. 2015. Chinese zero pronoun resolution: A joint unsupervised discourse-aware model rivaling state-of-the-art resolvers. In Proceedings of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers). pa… [find](https://scholar.google.com/scholar?q=Chen+Chen+and+Vincent+Ng%2E+2015%2E+Chinese+zero+pronoun+resolution%3A+A+joint+unsupervised+discourse%2Daware+model+rivaling+state%2Dof%2Dthe%2Dart+resolvers%2E+In+Proceedings+of+the+53rd+Annual+Meeting+of+the+ACL+an) [our card](https://md.research.elamur.ai/free/en/papers/chen-2015-chinese-zero-pronoun-resolution-joint/)
10. Hideki Isozaki and Tsutomu Hirao. 2003. Japanese zero pronoun resolution based on ranking rules and machine learning. In Proceedings of the 2003 conference on Empirical methods in natural language processing. Association for Computational Linguistics, pages 184–191. [find](https://scholar.google.com/scholar?q=Hideki+Isozaki+and+Tsutomu+Hirao%2E+2003%2E+Japanese+zero+pronoun+resolution+based+on+ranking+rules+and+machine+learning%2E+In+Proceedings+of+the+2003+conference+on+Empirical+methods+in+natural+language+pro) [our card](https://md.research.elamur.ai/free/en/papers/isozaki-2003-japanese-zero-pronoun-resolution-based/)
11. Chen Chen and Vincent Ng. 2016. Chinese zero pronoun resolution with deep neural networks. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, pages 778–788. [http://aclweb.org/anthology/P16-107…](http://aclweb.org/anthology/P16-107…) [↗](http://aclweb.org/anthology/P16-107…) [our card](https://md.research.elamur.ai/free/en/papers/chen-2016-chinese-zero-pronoun-resolution-deep/)
12. Diederik Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 . [find](https://scholar.google.com/scholar?q=Diederik+Kingma+and+Jimmy+Ba%2E+2014%2E+Adam%3A+A+method+for+stochastic+optimization%2E+arXiv+preprint+arXiv%3A1412%2E6980+%2E)
13. Fang Kong and Guodong Zhou. 2010. A tree kernel-based unified framework for chinese zero anaphora resolution. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, pages 882–891. [find](https://scholar.google.com/scholar?q=Fang+Kong+and+Guodong+Zhou%2E+2010%2E+A+tree+kernel%2Dbased+unified+framework+for+chinese+zero+anaphora+resolution%2E+In+Proceedings+of+the+2010+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2E) [our card](https://md.research.elamur.ai/free/en/papers/kong-2010-tree-kernel-based-unified-framework/)
14. Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 . [find](https://scholar.google.com/scholar?q=Kyunghyun+Cho%2C+Bart+Van+Merrie%CC%88nboer%2C+Caglar+Gulcehre%2C+Dzmitry+Bahdanau%2C+Fethi+Bougares%2C+Holger+Schwenk%2C+and+Yoshua+Bengio%2E+2014%2E+Learning+phrase+representations+using+rnn+encoder%2Ddecoder+for+statisti)
15. Lluis Marquez Emili Sapena M Antonia Marti Mariona Taule Veronique Hoste Massimo Poesio Yannick Versley Marta Recasens. 2010. Semeval-2010 task 1: Coreference resolution in multiple languages . [find](https://scholar.google.com/scholar?q=Lluis+Marquez+Emili+Sapena+M+Antonia+Marti+Mariona+Taule+Veronique+Hoste+Massimo+Poesio+Yannick+Versley+Marta+Recasens%2E+2010%2E+Semeval%2D2010+task+1%3A+Coreference+resolution+in+multiple+languages+%2E) [our card](https://md.research.elamur.ai/free/en/papers/recasens-2009-semeval-2010-task-1-coreference/)
16. François Chollet. 2015. Keras. [https://github.com/fchollet/keras](https://github.com/fchollet/keras). [↗](https://github.com/fchollet/keras)
17. Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, pages 1532–1543. [http://aclweb.org/anthology…](http://aclweb.org/anthology…) [↗](http://aclweb.org/anthology…)
18. Susan P Converse. 2006. Pronominal anaphora resolution in chinese . [find](https://scholar.google.com/scholar?q=Susan+P+Converse%2E+2006%2E+Pronominal+anaphora+resolution+in+chinese+%2E)
19. Antonio Ferrández and Jesús Peral. 2000. A computational approach to zero-pronouns in spanish. In Proceedings of the 38th Annual Meeting on Association for Computational Linguistics. Association for Computational Linguistics, pages 166–172. [find](https://scholar.google.com/scholar?q=Antonio+Ferra%CC%81ndez+and+Jesu%CC%81s+Peral%2E+2000%2E+A+computational+approach+to+zero%2Dpronouns+in+spanish%2E+In+Proceedings+of+the+38th+Annual+Meeting+on+Association+for+Computational+Linguistics%2E+Association+for)
20. Alessandro Moschitti Nianwen Xue Olga Uryupina Yuchen Zhang Sameer Pradhan. 2012. Conll-2012 shared task: Modeling multilingual unrestricted coreference in ontonotes . [find](https://scholar.google.com/scholar?q=Alessandro+Moschitti+Nianwen+Xue+Olga+Uryupina+Yuchen+Zhang+Sameer+Pradhan%2E+2012%2E+Conll%2D2012+shared+task%3A+Modeling+multilingual+unrestricted+coreference+in+ontonotes+%2E) [our card](https://md.research.elamur.ai/free/en/papers/pradhan-2012-conll-2012-shared-task-modeling/)
21. Na-Rae Han. 2006. Korean zero pronouns: analysis and resolution. Ph.D. thesis, Citeseer. [find](https://scholar.google.com/scholar?q=Na%2DRae+Han%2E+2006%2E+Korean+zero+pronouns%3A+analysis+and+resolution%2E+Ph%2ED%2E+thesis%2C+Citeseer%2E)
22. Ryohei Sasano and Sadao Kurohashi. 2011. A discriminative approach to japanese zero anaphora resolution with large-scale lexicalized case frames. In IJCNLP. pages 758–766. [find](https://scholar.google.com/scholar?q=Ryohei+Sasano+and+Sadao+Kurohashi%2E+2011%2E+A+discriminative+approach+to+japanese+zero+anaphora+resolution+with+large%2Dscale+lexicalized+case+frames%2E+In+IJCNLP%2E+pages+758%E2%80%93766%2E) [our card](https://md.research.elamur.ai/free/en/papers/sasano-2011-discriminative-approach-japanese-zero-anaphora/)
23. Andrew M Saxe, James L McClelland, and Surya Ganguli. 2013. Exact solutions to the nonlinear dynamics of learning in deep linear neural networks. arXiv preprint arXiv:1312.6120 . [find](https://scholar.google.com/scholar?q=Andrew+M+Saxe%2C+James+L+McClelland%2C+and+Surya+Ganguli%2E+2013%2E+Exact+solutions+to+the+nonlinear+dynamics+of+learning+in+deep+linear+neural+networks%2E+arXiv+preprint+arXiv%3A1312%2E6120+%2E)
24. Theano Development Team. 2016. Theano: A Python framework for fast computation of mathematical expressions. arXiv e-prints abs/1605.02688. http://arxiv.org/abs/1605.02688. [↗](http://arxiv.org/abs/1605.02688) [our card](https://md.research.elamur.ai/free/en/papers/the-2016-theano-development-team-theano-python-framework-fast-computation/)
25. Shanheng Zhao and Hwee Tou Ng. 2007. Identification and resolution of chinese zero pronouns: A machine learning approach. In EMNLP-CoNLL. volume 2007, pages 541–550. [find](https://scholar.google.com/scholar?q=Shanheng+Zhao+and+Hwee+Tou+Ng%2E+2007%2E+Identification+and+resolution+of+chinese+zero+pronouns%3A+A+machine+learning+approach%2E+In+EMNLP%2DCoNLL%2E+volume+2007%2C+pages+541%E2%80%93550%2E) [our card](https://md.research.elamur.ai/free/en/papers/zhao-2007-identification-resolution-chinese-zero-pronouns/)