--- title: "Incorporating Context and External Knowledge — Zhang 2019" description: "Pronouns have little semantic content, so finding their antecedents often requires both an understanding of the surrounding text and world knowledge that…" authors: ["Hongming Zhang", "Yan Song", "Yangqiu Song"] year: 2019 venue: "Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)" source: "https://aclanthology.org/N19-1093/" doi: "10.18653/v1/n19-1093" arxiv: "1905.10238" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/papers/zhang-2019-incorporating-context-external-knowledge-pronoun/" --- [Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/zhang-2019-incorporating-context-external-knowledge-pronoun/) [home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2019](https://md.research.elamur.ai/free/papers/2019/page/2/) / Incorporating Context and External Knowledge for Pronoun Coreference Resolution # Incorporating Context and External Knowledge for Pronoun Coreference Resolution **Authors:** [Hongming Zhang](https://md.research.elamur.ai/free/authors/hongming-zhang/), [Yan Song](https://md.research.elamur.ai/free/authors/yan-song/), [Yangqiu Song](https://md.research.elamur.ai/free/authors/yangqiu-song/) · **Year:** 2019 · **Venue:** Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/N19-1093/) · [PDF](https://aclanthology.org/N19-1093.pdf) · [DOI 10.18653/v1/n19-1093](https://doi.org/10.18653/v1/n19-1093) · [arXiv 1905.10238](https://arxiv.org/abs/1905.10238) · [OpenAlex](https://openalex.org/W2946581011) **Citations:** 34 citations (openalex-snapshot · 2026-10-14) · [20](#cited-by) in our library, of the 140673 papers whose bibliographies we read ## Summary Pronouns have little semantic content, so finding their antecedents often requires both an understanding of the surrounding text and world knowledge that is hard to learn from annotated corpora. Examples include number agreement, gender and animacy, and which arguments a verb typically takes. The authors propose a two-layer neural architecture that combines these signals. The first layer builds span representations for the pronoun and candidate noun phrases using a biLSTM with inner-span attention, following the End2end model of Lee et al. (2017), and produces a context-based score. A softmax pruning step keeps only high-confidence candidates. The second layer compares the remaining candidates pair by pair using features from several external knowledge sources. A knowledge attention module, conditioned on context, decides how much each source should count. This makes the model robust to noisy, automatically built resources and lets it adapt knowledge use to each case. On a widely used benchmark, the model beats state-of-the-art baselines by a large margin. Its attention weights also show which knowledge type drove each decision, which makes the model interpretable. ## Key points - The final score is the sum of a context score (F_c) and a knowledge score (F_k). Candidates are all non-pronominal noun phrases from the three most recent sentences before the pronoun. - There are three knowledge types: Plurality, animacy/gender (AG), and selectional preference (SP) drawn from a parsed SP knowledge base. - Pairwise comparison costs O(|N|²), so softmax pruning between the layers keeps computation manageable. - In case studies against End2end, SP resolves cases where Plurality and AG cannot separate the candidates. For example, "son" appears 100 times as an argument of "child" in the SP base, and "accident" appears 26 times with "fault." End2end either overpredicts in these cases or returns no antecedent. - Code and data are released at github.com/HKUST-KnowComp/Pronoun-Coref. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/) Topics: [Coreference resolution](https://md.research.elamur.ai/free/topics/coreference-resolution/) ## Cited by Cited by 20 papers of our library cite it (of the 140673 whose bibliographies we read); 3 of them have a page here, 17 not yet. - [Rewarding Coreference Resolvers for Being Consistent with World Knowledge](https://md.research.elamur.ai/free/papers/aralikatte-2019-rewarding-coreference-resolvers-being-consistent/) - [What You See is What You Get: Visual Pronoun Coreference Resolution in Dialogues](https://md.research.elamur.ai/free/papers/yu-2019-what-you-see-is-what/) - [PCR4ALL: A Comprehensive Evaluation Benchmark for Pronoun Coreference Resolution in English](https://md.research.elamur.ai/free/papers/zhao-2022-pcr4all-comprehensive-evaluation-benchmark-pronoun/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{zhang2019incorporating, title = {{Incorporating Context and External Knowledge for Pronoun Coreference Resolution}}, author = {Zhang, Hongming and Song, Yan and Song, Yangqiu}, booktitle = {Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)}, year = {2019}, doi = {10.18653/v1/n19-1093}, eprint = {1905.10238}, archivePrefix = {arXiv}, url = {https://doi.org/10.18653/v1/n19-1093} } ``` - [← previous Improving Surface-syntactic Universal Dependencies (SUD): MWEs and deep syntactic features](https://md.research.elamur.ai/free/papers/gerdes-2019-improving-surface-syntactic-universal-dependencies/) - [next → Inherent Disagreements in Human Textual Inferences](https://md.research.elamur.ai/free/papers/pavlick-2019-inherent-disagreements-human-textual-inferences/) - [↑ back to papers of 2019](https://md.research.elamur.ai/free/papers/2019/page/2/) ## References 5 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of ICLR 2015. [find](https://scholar.google.com/scholar?q=Dzmitry+Bahdanau%2C+Kyunghyun+Cho%2C+and+Yoshua+Bengio%2E+2015%2E+Neural+machine+translation+by+jointly+learning+to+align+and+translate%2E+In+Proceedings+of+ICLR+2015%2E) [our card](https://md.research.elamur.ai/free/papers/bahdanau-2014-neural-machine-translation-jointly-learning/) 2. Eugene Charniak and Micha Elsner. 2009. Em works for pronoun anaphora resolution. In Proceedings of EACL 2009, pages 148–156. [find](https://scholar.google.com/scholar?q=Eugene+Charniak+and+Micha+Elsner%2E+2009%2E+Em+works+for+pronoun+anaphora+resolution%2E+In+Proceedings+of+EACL+2009%2C+pages+148%E2%80%93156%2E) [our card](https://md.research.elamur.ai/free/papers/charniak-2009-em-works-pronoun-anaphora-resolution/) 3. Kevin Clark and Christopher D Manning. 2015. Entity-centric coreference resolution with model stacking. In Proceedings of ACL-IJCNLP 2015, volume 1, pages 1405–1415. [find](https://scholar.google.com/scholar?q=Kevin+Clark+and+Christopher+D+Manning%2E+2015%2E+Entity%2Dcentric+coreference+resolution+with+model+stacking%2E+In+Proceedings+of+ACL%2DIJCNLP+2015%2C+volume+1%2C+pages+1405%E2%80%931415%2E) [our card](https://md.research.elamur.ai/free/papers/clark-2015-entity-centric-coreference-resolution-model/) 4. Kevin Clark and Christopher D. Manning. 2016. Deep reinforcement learning for mention-ranking coreference models. In Proceedings of EMNLP 2016, pages 2256–2262. [find](https://scholar.google.com/scholar?q=Kevin+Clark+and+Christopher+D%2E+Manning%2E+2016%2E+Deep+reinforcement+learning+for+mention%2Dranking+coreference+models%2E+In+Proceedings+of+EMNLP+2016%2C+pages+2256%E2%80%932262%2E) [our card](https://md.research.elamur.ai/free/papers/clark-2016-deep-reinforcement-learning-mention-ranking/) 5. Richard J Edens, Helen L Gaylard, Gareth JF Jones, and Adenike M Lam-Adesina. 2003. An investigation of broad coverage automatic pronoun resolution for information retrieval. In Proceedings of SIGIR 2003, pages 381–382. ACM. \#\# Conclusion [find](https://scholar.google.com/scholar?q=Richard+J+Edens%2C+Helen+L+Gaylard%2C+Gareth+JF+Jones%2C+and+Adenike+M+Lam%2DAdesina%2E+2003%2E+An+investigation+of+broad+coverage+automatic+pronoun+resolution+for+information+retrieval%2E+In+Proceedings+of+SIGIR+2)