---
title: "Using a unified taxonomy to annotate discourse — Crible 2015"
description: "Descriptions of discourse markers (DMs) are usually built for either speech or writing, even though many markers such as so or because occur in both."
authors: ["Ludivine Crible", "Sandrine Zufferey"]
year: 2015
venue: "Proceedings of the 11th Joint ACL-ISO Workshop on Interoperable Semantic Annotation (ISA-11)"
source: "https://aclanthology.org/W15-0202/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/crible-2015-unified-taxonomy-annotate-discourse-markers/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/crible-2015-unified-taxonomy-annotate-discourse-markers/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2015](https://md.research.elamur.ai/free/papers/2015/page/2/) / Using a unified taxonomy to annotate discourse markers in speech and writing

# Using a unified taxonomy to annotate discourse markers in speech and writing

**Authors:** [Ludivine Crible](https://md.research.elamur.ai/free/authors/ludivine-crible/), [Sandrine Zufferey](https://md.research.elamur.ai/free/authors/sandrine-zufferey/) · **Year:** 2015 · **Venue:** Proceedings of the 11th Joint ACL-ISO Workshop on Interoperable Semantic Annotation (ISA-11) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/W15-0202/) · [PDF](https://aclanthology.org/W15-0202.pdf) · [OpenAlex](https://openalex.org/W1733983371)

**Citations:** 12 citations (openalex-snapshot · 2026-10-14) · [5](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Descriptions of discourse markers (DMs) are usually built for either speech or writing, even though many markers such as *so* or *because* occur in both. Crible and Zufferey test whether one sense taxonomy can serve both modes. The taxonomy (Crible, 2014) was first developed on spoken French and English. It has 29 values grouped into four domains: ideational, rhetorical, sequential and interpersonal. Annotators may assign two tags to a single token.

Two expert coders worked on short English and French texts:
- **Spoken data:** interviews from the Backbone corpus.
- **Written data:** newspaper articles from the COMTIS project.

The coders first identified candidate DMs and then annotated their senses. Agreement on spoken data was not lower than on written data, contrary to what was expected. The two modes differed mainly in the kinds of disagreement they produced. Each coder's background in speech or writing also biased their choices.

The paper's main value is methodological. It shows that coder training, explicit criteria and paraphrases for each tag make sense annotation more reliable. It also moves toward a single multimodal scheme instead of many incompatible frameworks.

## Key points
- **Data:** four texts of about 1000 words each, covering spoken and written English and French. Spoken texts come from Backbone (Kurt, 2012) and written texts from COMTIS newspaper articles.
- **Identification agreement:** relative agreement on DM selection was 82.25% for spoken English and 87.34% for spoken French. It was 79.16% for written English and 66.67% for written French.
- **Coder bias:** the coder specialised in writing selected more DMs in the written texts (28 vs. 20 in English, 26 vs. 19 in French). The same coder was also more willing to label written uses as rhetorical or "pragmatic".
- **Comparison with PDTB:** unlike the Penn Discourse Treebank's hierarchical sense levels, the scheme separates domain-specific pairs at the first level, for example ideational cause vs. rhetorical motivation.
- **Learning effect:** sense-annotation agreement rose from the first to the second annotation within a language, but the gain did not carry over across languages. The authors take this as a sign that DM usage is partly language-specific.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/)

Topics: [Discourse analysis](https://md.research.elamur.ai/free/topics/discourse-analysis/)

## Cited by

Cited by

5 papers of our library cite it (of the 140673 whose bibliographies we read); 1 of them have a page here, 4 not yet.

- [Discourse Markers in Speech: Distinctive Features and Corpus Annotation](https://md.research.elamur.ai/free/papers/crible-2017-discourse-markers-speech-distinctive-features/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{crible2015using,
  title = {{Using a unified taxonomy to annotate discourse markers in speech and writing}},
  author = {Crible, Ludivine and Zufferey, Sandrine},
  booktitle = {Proceedings of the 11th Joint ACL-ISO Workshop on Interoperable Semantic Annotation (ISA-11)},
  year = {2015},
  url = {https://aclanthology.org/W15-0202/}
}
```

- [← previous Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks](https://md.research.elamur.ai/free/papers/radford-2015-unsupervised-representation-learning-deep-convolutional/)
- [next → Using Word Semantics To Assist English as a Second Language Learners](https://md.research.elamur.ai/free/papers/azab-2015-word-semantics-assist-english-as/)
- [↑ back to papers of 2015](https://md.research.elamur.ai/free/papers/2015/page/2/)

## References

28 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Asher, N. and A. Lascarides (2003). Logics of Conversation. Cambridge : CUP. [find](https://scholar.google.com/scholar?q=Asher%2C+N%2E+and+A%2E+Lascarides+%282003%29%2E+Logics+of+Conversation%2E+Cambridge+%3A+CUP%2E)
2. Blakemore, D. (2002). Relevance and linguistic meaning. The semantics and pragmatics of discourse markers. Cambridge : CUP. [↗](https://doi.org/10.1017/cbo9780511486456)
3. Bolly, C. and L. Crible (2015). From context to functions and back again: Disambiguating pragmatic uses of discourse markers. In International Pragmatics Association (IPrA) Conference, July 26-31, Antwerp, Belgium. [find](https://scholar.google.com/scholar?q=Bolly%2C+C%2E+and+L%2E+Crible+%282015%29%2E+From+context+to+functions+and+back+again%3A+Disambiguating+pragmatic+uses+of+discourse+markers%2E+In+International+Pragmatics+Association+%28IPrA%29+Conference%2C+July+26%2D31%2C+Ant)
4. Brinton, L. (2008). The comment clause in English : syntactic origins and pragmatic development. Cambridge : CUP. [↗](https://doi.org/10.1017/cbo9780511551789)
5. Bunt, H., R. Prasad, and A. Joshi (2012). First steps towards an iso standard for annotating discourse relations. In Proceedings of the Joint ISA-7, SRSL-3, and I2MRT LREC 2012 Workshop on Semantic Annotation and the Integration and Interoperability of Multimodal Resources and Tools, Istanbul, Turkey. [find](https://scholar.google.com/scholar?q=Bunt%2C+H%2E%2C+R%2E+Prasad%2C+and+A%2E+Joshi+%282012%29%2E+First+steps+towards+an+iso+standard+for+annotating+discourse+relations%2E+In+Proceedings+of+the+Joint+ISA%2D7%2C+SRSL%2D3%2C+and+I2MRT+LREC+2012+Workshop+on+Semantic+An)
6. Crible, L. (2014). Selection and functional description of discourse markers in french and english: towards crosslinguistic and operational categories for contrastive annotation. In International Workshop - Pragmatic Markers, Discourse Markers and Modal Particles: What do we know and where do we go from here? October 16-17, Como, Italia. [find](https://scholar.google.com/scholar?q=Crible%2C+L%2E+%282014%29%2E+Selection+and+functional+description+of+discourse+markers+in+french+and+english%3A+towards+crosslinguistic+and+operational+categories+for+contrastive+annotation%2E+In+International+Work)
7. Crible, L. and L. Degand (2015). Functions and syntax of discourse connectives across languages and genres: Towards a multilingual annotation scheme. In International Pragmatics Association (IPrA) Conference, July 26-31, Antwerp, Belgium. [find](https://scholar.google.com/scholar?q=Crible%2C+L%2E+and+L%2E+Degand+%282015%29%2E+Functions+and+syntax+of+discourse+connectives+across+languages+and+genres%3A+Towards+a+multilingual+annotation+scheme%2E+In+International+Pragmatics+Association+%28IPrA%29+Con)
8. Cuenca, M. J. (2013). The fuzzy boundaries between discourse marking and modal marking. In L. Degand, B. Cornillie, and P. Pietrandrea (Eds.), Discourse markers and modal particles. Categorization and description, pp. 191–216. Amsterdam : John Benjamins. [↗](https://doi.org/10.1075/pbns.234.08cue)
9. Degand, L. (2004). Contrastive analyses, translation, and speaker involvement: the case of puisque and angezien. In M. Achard and S. Kemmer (Eds.), Language, Culture and Mind, pp. 1–20. Stanford: CSLI Publications. [find](https://scholar.google.com/scholar?q=Degand%2C+L%2E+%282004%29%2E+Contrastive+analyses%2C+translation%2C+and+speaker+involvement%3A+the+case+of+puisque+and+angezien%2E+In+M%2E+Achard+and+S%2E+Kemmer+%28Eds%2E%29%2C+Language%2C+Culture+and+Mind%2C+pp%2E+1%E2%80%9320%2E+Stanford%3A+CSLI)
10. Demirsahin, I. and D. Zeyrek (2014). Annotating discourse connectives in spoken turkish. In LAW VIII - The 8th Linguistic Annotation Workshop, pp. 105–109. [find](https://scholar.google.com/scholar?q=Demirsahin%2C+I%2E+and+D%2E+Zeyrek+%282014%29%2E+Annotating+discourse+connectives+in+spoken+turkish%2E+In+LAW+VIII+%2D+The+8th+Linguistic+Annotation+Workshop%2C+pp%2E+105%E2%80%93109%2E) [our card](https://md.research.elamur.ai/free/papers/ahin-2014-annotating-discourse-connectives-spoken-turkish/)
11. Gonzalez, M. (2005). Pragmatic markers and discourse coherence relations in english and catalan oral narrative. Discourse studies 77(1)(1), 53–86. [↗](https://doi.org/10.1177/1461445605048767)
12. Halliday, M. A. K. and R. Hasan (1976). Cohesion in English. London : Longman. [find](https://scholar.google.com/scholar?q=Halliday%2C+M%2E+A%2E+K%2E+and+R%2E+Hasan+%281976%29%2E+Cohesion+in+English%2E+London+%3A+Longman%2E)
13. Hansen, M.-B. M. (2006). A dynamic polysemy approach to the lexical semantics of discourse markers (with an exemplary analysis of french toujours). In K. Fischer (Ed.), Approaches to discourse particles, pp. 21–41. Amsterdam : Elsevier. [↗](https://doi.org/10.1163/9780080461588_003)
14. Haselow, A. (2011). Discourse marker and modal particle : the functions of utterance-final then in spoken english. Journal of Pragmatics 43(14), 3603–3623. [↗](https://doi.org/10.1016/j.pragma.2011.09.002)
15. Kurt, K. (2012). Pedagogic corpora for content and language integrated learning. insights from the backbone project. The Eurocall Review 20(2), 3–22. [find](https://scholar.google.com/scholar?q=Kurt%2C+K%2E+%282012%29%2E+Pedagogic+corpora+for+content+and+language+integrated+learning%2E+insights+from+the+backbone+project%2E+The+Eurocall+Review+20%282%29%2C+3%E2%80%9322%2E)
16. Miltsakaki, E., L. Lee, and A. Joshi (2008). Sense annotation in the penn discourse treebank. Lecture Notes in Computer Science 4919, 275–286. [find](https://scholar.google.com/scholar?q=Miltsakaki%2C+E%2E%2C+L%2E+Lee%2C+and+A%2E+Joshi+%282008%29%2E+Sense+annotation+in+the+penn+discourse+treebank%2E+Lecture+Notes+in+Computer+Science+4919%2C+275%E2%80%93286%2E) [our card](https://md.research.elamur.ai/free/papers/miltsakaki-2004-penn-discourse-treebank/)
17. Petukhova, V. and H. Bunt (2009). Towards a multidimensional semantics of discourse markers in spoken dialogue. In Proceedings of the 8th International Conference on Computational Semantics, pp. 157–168. [find](https://scholar.google.com/scholar?q=Petukhova%2C+V%2E+and+H%2E+Bunt+%282009%29%2E+Towards+a+multidimensional+semantics+of+discourse+markers+in+spoken+dialogue%2E+In+Proceedings+of+the+8th+International+Conference+on+Computational+Semantics%2C+pp%2E+157%E2%80%931) [our card](https://md.research.elamur.ai/free/papers/petukhova-2009-multidimensional-semantics-discourse-markers-spoken/)
18. Pit, M. (2007). Cross-linguistic analyses of backward causal connectives in dutch, german and french. Languages in Contrast 7(1), 53–82. [↗](https://doi.org/10.1075/lic.7.1.04pit)
19. Prasad, R., E. Miltsakaki, N. Dinesh, A. Lee, and A. Joshi (2007). The penn discourse treebank 2.0 annotation manual. Technical report, Institute for Research in Cognitive Science. [find](https://scholar.google.com/scholar?q=Prasad%2C+R%2E%2C+E%2E+Miltsakaki%2C+N%2E+Dinesh%2C+A%2E+Lee%2C+and+A%2E+Joshi+%282007%29%2E+The+penn+discourse+treebank+2%2E0+annotation+manual%2E+Technical+report%2C+Institute+for+Research+in+Cognitive+Science%2E) [our card](https://md.research.elamur.ai/free/papers/miltsakaki-2004-penn-discourse-treebank/)
20. Redeker, G. (1990). Ideational and pragmatic markers of discourse structure. Journal of Pragmatics 14(3), 367–381. [↗](https://doi.org/10.1016/0378-2166(90)90095-u)
21. Schourup, L. (1999). Discourse markers. Lingua (107), 227–265. [find](https://scholar.google.com/scholar?q=Schourup%2C+L%2E+%281999%29%2E+Discourse+markers%2E+Lingua+%28107%29%2C+227%E2%80%93265%2E)
22. Sperber, D. and D. Wilson (1993). Linguistic form and relevance. Lingua 90, 1–25. [↗](https://doi.org/10.1016/0024-3841(93)90058-5)
23. Sweetser, E. (1990). From etymology to pragmatics. Cambridge : CUP. [↗](https://doi.org/10.1017/cbo9780511620904)
24. Taboada, M. (2006). Discourse markers as signals (or not) of rhetorical relations. Journal of Pragmatics 38, 567–592. [↗](https://doi.org/10.1016/j.pragma.2005.09.010)
25. Tonelli, S., G. Riccardi, R. Prasad, and A. Joshi (2010, may). Annotation of discourse relations for coconversation spoken dialogs. In N. C. C. Chair), K. Choukri, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis, M. Rosner, and D. Tapias (Eds.), Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC’10), Valletta, Malta, pp. 2084–2090. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Tonelli%2C+S%2E%2C+G%2E+Riccardi%2C+R%2E+Prasad%2C+and+A%2E+Joshi+%282010%2C+may%29%2E+Annotation+of+discourse+relations+for+coconversation+spoken+dialogs%2E+In+N%2E+C%2E+C%2E+Chair%29%2C+K%2E+Choukri%2C+B%2E+Maegaard%2C+J%2E+Mariani%2C+J%2E+Odijk%2C+S)
26. Zufferey, S. and B. Cartoni (2012). English and french causal connectives in contrast. Languages in contrast 12(2), 232–250. [↗](https://doi.org/10.1075/lic.12.2.06zuf)
27. Zufferey, S. and L. Degand (2014). Representing the meaning of discourse connectives for multilingual purposes. Corpus Linguistics and Linguistic Theory 10. [find](https://scholar.google.com/scholar?q=Zufferey%2C+S%2E+and+L%2E+Degand+%282014%29%2E+Representing+the+meaning+of+discourse+connectives+for+multilingual+purposes%2E+Corpus+Linguistics+and+Linguistic+Theory+10%2E)
28. Zufferey, S. and A. Popescu-Belis (2004). Towards automatic identification of discourse markers in dialogues: the case of like. In 5th SIGdial Workshop on Discourse and Dialogue, Cambridge (MA), pp. 63–71. [find](https://scholar.google.com/scholar?q=Zufferey%2C+S%2E+and+A%2E+Popescu%2DBelis+%282004%29%2E+Towards+automatic+identification+of+discourse+markers+in+dialogues%3A+the+case+of+like%2E+In+5th+SIGdial+Workshop+on+Discourse+and+Dialogue%2C+Cambridge+%28MA%29%2C+pp%2E+6)