---
title: "Active Learning for Anaphora Resolution — Gasperin 2009"
description: "This work asks whether active learning can lower the cost of building training data for anaphora resolution."
authors: ["Caroline Gasperin"]
year: 2009
venue: "Proceedings of the NAACL HLT 2009 Workshop on Active Learning for Natural Language Processing"
source: "https://aclanthology.org/W09-1901/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/gasperin-2009-active-learning-anaphora-resolution/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/gasperin-2009-active-learning-anaphora-resolution/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2009](https://md.research.elamur.ai/free/papers/2009/) / Active Learning for Anaphora Resolution

# Active Learning for Anaphora Resolution

**Authors:** [Caroline Gasperin](https://md.research.elamur.ai/free/authors/caroline-gasperin/) · **Year:** 2009 · **Venue:** Proceedings of the NAACL HLT 2009 Workshop on Active Learning for Natural Language Processing · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/W09-1901/) · [PDF](https://aclanthology.org/W09-1901.pdf) · [OpenAlex](https://openalex.org/W1966198555)

**Citations:** 16 citations (openalex-snapshot · 2026-10-14) · [8](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
This work asks whether active learning can lower the cost of building training data for anaphora resolution. Annotating anaphoric links by hand is notoriously slow, and the author reports no earlier attempt to apply active learning to this task. The base learner is the author's probabilistic resolver for non-pronominal anaphora in biomedical text (Gasperin and Briscoe, 2008). It labels each anaphor–candidate pair as coreferent, biotype, set-member, or no relation, and it can also detect discourse-new mentions. Active learning was simulated on an annotated corpus of full-text Drosophila papers. Part of the data served for initial training, and the rest acted as an unlabelled pool. Three entropy-based uncertainty measures picked new training instances over 10 iterations, and each was compared against random selection of the same size. None of the measures beat random sampling consistently. The author attributes this mainly to the difficulty of merging the probabilities of many antecedent candidates into a single uncertainty score. The negative result is useful because it shows that methods that work well for tasks such as NER or parse selection do not carry over directly to anaphora resolution.

## Key points
- **Corpus:** five full-length Drosophila biomedical articles (about 33,300 words), released through the FlySlip project.
  - Preprocessing used a gene name recogniser, the RASP parser, and biotypes derived from the Sequence Ontology (SO).
  - It contains 3,048 positive cases: 1,678 coreferent, 274 biotype, 543 set-member, and 436 discourse-new.
- **Negative instances:** there were 873,731 negatives. They were cut to 85,314 by grouping identical feature vectors and keeping one-tenth of each group, which also discarded groups with fewer than 10 members.
- **Model:** the resolver uses 11 features and a Bayes-based decomposition inspired by Ge et al. (1998). It can be seen as a naive-Bayes variant that allows some dependence between features.
- **Selection measures:** LE(A, a) works on pairs and selected 1,500 pairs per iteration. GE1(A) and GE2(A) work per anaphor and selected the 50 most uncertain anaphors per iteration.
- **Results:**
  - LE(A, a) chose mostly negatives and lowered overall performance, although precision rose for coreferent and set-member cases.
  - GE1(A) tended to improve precision and drew about 70% proper names.
  - GE2(A) tended to improve recall at the cost of precision.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/)

Topics: [Coreference resolution](https://md.research.elamur.ai/free/topics/coreference-resolution/)

## Cited by

Cited by

8 papers of our library cite it (of the 140673 whose bibliographies we read); 5 of them have a page here, 3 not yet.

- [Active Learning for Coreference Resolution](https://md.research.elamur.ai/free/papers/laws-2012-active-learning-coreference-resolution/)
- [Active Learning for Coreference Resolution using Discrete Annotation](https://md.research.elamur.ai/free/papers/li-2020-active-learning-coreference-resolution-discrete/)
- [Active Learning Literature Survey](https://md.research.elamur.ai/free/papers/settles-2009-active-learning-literature-survey/)
- [Adapting Coreference Resolution Models through Active Learning](https://md.research.elamur.ai/free/papers/yuan-2022-adapting-coreference-resolution-models-through/)
- [Domain Adaptation with Active Learning for Coreference Resolution](https://md.research.elamur.ai/free/papers/zhao-2014-domain-adaptation-active-learning-coreference/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{gasperin2009active,
  title = {{Active Learning for Anaphora Resolution}},
  author = {Gasperin, Caroline},
  booktitle = {Proceedings of the NAACL HLT 2009 Workshop on Active Learning for Natural Language Processing},
  year = {2009},
  doi = {10.3115/1564131.1564133},
  url = {https://doi.org/10.3115/1564131.1564133}
}
```

- [← previous Abstraction and Generalisation in Semantic Role Labels: PropBank, VerbNet or both?](https://md.research.elamur.ai/free/papers/merlo-2009-abstraction-generalisation-semantic-role-labels/)
- [next → Active Learning Literature Survey](https://md.research.elamur.ai/free/papers/settles-2009-active-learning-literature-survey/)
- [↑ back to papers of 2009](https://md.research.elamur.ai/free/papers/2009/)

## References

14 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Jason Baldridge and Miles Osborne. 2003. Active learning for hpsg parse selection. In Walter Daelemans and Miles Osborne, editors, Proceedings of CoNLL-2003, pages 17–24. Edmonton, Canada. [find](https://scholar.google.com/scholar?q=Jason+Baldridge+and+Miles+Osborne%2E+2003%2E+Active+learning+for+hpsg+parse+selection%2E+In+Walter+Daelemans+and+Miles+Osborne%2C+editors%2C+Proceedings+of+CoNLL%2D2003%2C+pages+17%E2%80%9324%2E+Edmonton%2C+Canada%2E)
2. Edward J. Briscoe, John Carroll, and Rebecca Watson. 2006. The second release of the RASP system. In Proceedings of ACL-COLING 06, Sydney, Australia. [find](https://scholar.google.com/scholar?q=Edward+J%2E+Briscoe%2C+John+Carroll%2C+and+Rebecca+Watson%2E+2006%2E+The+second+release+of+the+RASP+system%2E+In+Proceedings+of+ACL%2DCOLING+06%2C+Sydney%2C+Australia%2E)
3. K. Bretonnel Cohen, Lynne Fox, Philip Ogren, and Lawrence Hunter. 2005. Corpus design for biomedical natural language processsing. In Proceedings of the ACL-ISMB Workshop on Linking Biological Literature, Ontologies and Databases, Detroit. [find](https://scholar.google.com/scholar?q=K%2E+Bretonnel+Cohen%2C+Lynne+Fox%2C+Philip+Ogren%2C+and+Lawrence+Hunter%2E+2005%2E+Corpus+design+for+biomedical+natural+language+processsing%2E+In+Proceedings+of+the+ACL%2DISMB+Workshop+on+Linking+Biological+Literat)
4. Karen Eilbeck and Suzanna E. Lewis. 2004. Sequence ontology annotation guide. Comparative and Functional Genomics, 5:642–647. [find](https://scholar.google.com/scholar?q=Karen+Eilbeck+and+Suzanna+E%2E+Lewis%2E+2004%2E+Sequence+ontology+annotation+guide%2E+Comparative+and+Functional+Genomics%2C+5%3A642%E2%80%93647%2E)
5. Caroline Gasperin and Ted Briscoe. 2008. Statistical anaphora resolution in biomedical texts. In Proceedings of COLING 2008, Manchester, UK. [find](https://scholar.google.com/scholar?q=Caroline+Gasperin+and+Ted+Briscoe%2E+2008%2E+Statistical+anaphora+resolution+in+biomedical+texts%2E+In+Proceedings+of+COLING+2008%2C+Manchester%2C+UK%2E) [our card](https://md.research.elamur.ai/free/papers/gasperin-2008-statistical-anaphora-resolution-biomedical-texts/)
6. Caroline Gasperin, Nikiforos Karamanis, and Ruth Seal. 2007. Annotation of anaphoric relations in biomedical full-text articles using a domain-relevant scheme. In Proceedings of DAARC 2007, pages 19–24, Lagos, Portugal. [find](https://scholar.google.com/scholar?q=Caroline+Gasperin%2C+Nikiforos+Karamanis%2C+and+Ruth+Seal%2E+2007%2E+Annotation+of+anaphoric+relations+in+biomedical+full%2Dtext+articles+using+a+domain%2Drelevant+scheme%2E+In+Proceedings+of+DAARC+2007%2C+pages+19%E2%80%932)
7. Niyu Ge, John Hale, and Eugene Charniak. 1998. A statistical approach to anaphora resolution. In Proceedings of the Sixth Workshop on Very Large Corpora - COLING-ACL’98, Montreal, Canada. [find](https://scholar.google.com/scholar?q=Niyu+Ge%2C+John+Hale%2C+and+Eugene+Charniak%2E+1998%2E+A+statistical+approach+to+anaphora+resolution%2E+In+Proceedings+of+the+Sixth+Workshop+on+Very+Large+Corpora+%2D+COLING%2DACL%E2%80%9998%2C+Montreal%2C+Canada%2E) [our card](https://md.research.elamur.ai/free/papers/ge-1998-statistical-approach-anaphora-resolution/)
8. Vincent Ng and Claire Cardie. 2002. Improving machine learning approaches to coreference resolution. In Proceedings of ACL 2002, Philadelphia. [find](https://scholar.google.com/scholar?q=Vincent+Ng+and+Claire+Cardie%2E+2002%2E+Improving+machine+learning+approaches+to+coreference+resolution%2E+In+Proceedings+of+ACL+2002%2C+Philadelphia%2E) [our card](https://md.research.elamur.ai/free/papers/ng-2002-improving-machine-learning-approaches-coreference/)
9. Massimo Poesio and Renata Vieira. 1998. A corpus-based investigation of definite description use. Computational Linguistics, 24(2):183–216. [find](https://scholar.google.com/scholar?q=Massimo+Poesio+and+Renata+Vieira%2E+1998%2E+A+corpus%2Dbased+investigation+of+definite+description+use%2E+Computational+Linguistics%2C+24%282%29%3A183%E2%80%93216%2E)
10. Dan Shen, Jie Zhang, Jian Su, Guodong Zhou, and Chew-Lim Tan. 2004. Multi-criteria-based active learning for named entity recognition. In Proceedings of ACL 2004, Barcelona. [find](https://scholar.google.com/scholar?q=Dan+Shen%2C+Jie+Zhang%2C+Jian+Su%2C+Guodong+Zhou%2C+and+Chew%2DLim+Tan%2E+2004%2E+Multi%2Dcriteria%2Dbased+active+learning+for+named+entity+recognition%2E+In+Proceedings+of+ACL+2004%2C+Barcelona%2E)
11. Wee Meng Soon, Hwee Tou Ng, and Daniel Chung Yong Lim. 2001. A machine learning approach to coreference resolution of noun phrases. Computational Linguistics, 27(4):521–544. [find](https://scholar.google.com/scholar?q=Wee+Meng+Soon%2C+Hwee+Tou+Ng%2C+and+Daniel+Chung+Yong+Lim%2E+2001%2E+A+machine+learning+approach+to+coreference+resolution+of+noun+phrases%2E+Computational+Linguistics%2C+27%284%29%3A521%E2%80%93544%2E) [our card](https://md.research.elamur.ai/free/papers/soon-2001-machine-learning-approach-coreference-resolution/)
12. Michael Strube, Stefan Rapp, and Christoph Mller. 2002. The influence of minimum edit distance on reference resolution. In Proceedings of the EMNLP 2002, Philadelphia. [find](https://scholar.google.com/scholar?q=Michael+Strube%2C+Stefan+Rapp%2C+and+Christoph+Mller%2E+2002%2E+The+influence+of+minimum+edit+distance+on+reference+resolution%2E+In+Proceedings+of+the+EMNLP+2002%2C+Philadelphia%2E)
13. Min Tang, Xiaoqiang Luo, and Salim Roukos. 2002. Active learning for statistical natural language parsing. In Proceedings of ACL 2002, pages 120–127, Philadelphia, Pennsylvania. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Min+Tang%2C+Xiaoqiang+Luo%2C+and+Salim+Roukos%2E+2002%2E+Active+learning+for+statistical+natural+language+parsing%2E+In+Proceedings+of+ACL+2002%2C+pages+120%E2%80%93127%2C+Philadelphia%2C+Pennsylvania%2E+Association+for+Comput)
14. Andreas Vlachos and Caroline Gasperin. 2006. Bootstrapping and evaluating named entity recognition in the biomedical domain. In Proceedings of BioNLP at HLT-NAACL 2006, pages 138–145, New York. [find](https://scholar.google.com/scholar?q=Andreas+Vlachos+and+Caroline+Gasperin%2E+2006%2E+Bootstrapping+and+evaluating+named+entity+recognition+in+the+biomedical+domain%2E+In+Proceedings+of+BioNLP+at+HLT%2DNAACL+2006%2C+pages+138%E2%80%93145%2C+New+York%2E)
