---
title: "Automatic Prediction of Discourse Connectives — Malmi 2018"
description: "The paper treats choosing a sentence-initial discourse connective (e.g., however , by then ) as a standalone task."
authors: ["Eric Malmi", "Daniele Pighin", "Sebastian Krause", "Mikhail Kozhevnikov"]
year: 2018
venue: "Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)"
source: "https://aclanthology.org/L18-1260/"
arxiv: "1702.00992"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/malmi-2018-automatic-prediction-discourse-connectives/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/malmi-2018-automatic-prediction-discourse-connectives/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2018](https://md.research.elamur.ai/free/papers/2018/) / Automatic Prediction of Discourse Connectives

# Automatic Prediction of Discourse Connectives

**Authors:** [Eric Malmi](https://md.research.elamur.ai/free/authors/eric-malmi/), [Daniele Pighin](https://md.research.elamur.ai/free/authors/daniele-pighin/), [Sebastian Krause](https://md.research.elamur.ai/free/authors/sebastian-krause/), Mikhail Kozhevnikov · **Year:** 2018 · **Venue:** Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/L18-1260/) · [PDF](https://aclanthology.org/L18-1260.pdf) · [arXiv 1702.00992](https://arxiv.org/abs/1702.00992) · [OpenAlex](https://openalex.org/W2964175741)

**Citations:** 20 citations (openalex-snapshot · 2026-10-14) · [18](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
The paper treats choosing a sentence-initial discourse connective (e.g., *however*, *by then*) as a standalone task. Earlier work mostly predicted connectives only as a step toward implicit discourse relation classification. The authors argue the task is useful in its own right for summarization, question answering and writing assistance, wherever separate sentences must be joined fluently.

They mined the English Wikipedia for adjacent sentence pairs in which the second sentence opens with one of 79 PDTB-derived connectives. They added pairs without any connective, giving about 2.9M examples. From these they built balanced splits over 19 frequent, semantically distinct connectives plus a [No connective] class.

They adapted the decomposable attention (DA) model, originally built for natural language inference, and compared it against a WORD-PAIRS baseline and human raters. DA clearly beat the baseline and slightly exceeded human F1 overall. Humans still did better on cases where most raters agreed on an explicit connective, which leaves room for improvement. The public dataset is far larger than PDTB, which makes it suitable for training neural models.

## Key points
- **Data:** The corpus comes from an English Wikipedia snapshot of 5 Sept 2016.
  - It holds 1.95M pairs separated by a connective and 0.91M [No connective] pairs, about 2.86M in total.
  - It is roughly 70× larger than PDTB, which has 40,600 examples.
  - It is released at github.com/ekQ/discourse-connectives, together with human-filled connectives for 10,000 sentences.
- **Task setup:** There are 20 balanced classes (19 connectives plus [No connective]).
  - The training set has 400k examples, 20k per class, built by over- and under-sampling.
  - The development and test sets have 10k examples each, 500 per class.
  - No Wikipedia article contributes examples to more than one split.
- **Model changes:** The DA variant differs from the original in three ways:
  - it drops self-attention;
  - it uses 100-dimensional word2vec embeddings that are fine-tuned during training;
  - it adds layer normalization to speed up convergence.
- **Results:** DA reaches macro F1 31.80 and accuracy 32.71. WORD-PAIRS reaches 14.81 and 15.60, and random guessing scores 5.00.
  - The abstract reports human raters at roughly 30 F1, against about 32 for DA.
  - The extracted results table, however, lists a lower human score of 23.72. The evaluation details behind this gap fall in the part of the text that was not provided.
- **Analysis:** Raters tend to prefer leaving the connective implicit.
  - DA's attention alignments capture lexical and tense cues, such as contrast words signalling *however* and past perfect signalling *by then*.
  - The model's confusion patterns closely resemble those of human raters.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/)

Topics: [Discourse analysis](https://md.research.elamur.ai/free/topics/discourse-analysis/)

## Cited by

Cited by

18 papers of our library cite it (of the 140673 whose bibliographies we read); 4 of them have a page here, 14 not yet.

- [Weakly-Supervised Modeling of Contextualized Event Embedding for Discourse Relations](https://md.research.elamur.ai/free/papers/lee-2020-weakly-supervised-modeling-contextualized-event/)
- [DisSent: Learning Sentence Representations from Explicit Discourse Relations](https://md.research.elamur.ai/free/papers/nie-2019-dissent-learning-sentence-representations-explicit/)
- [Mining Discourse Markers for Unsupervised Sentence Representation Learning](https://md.research.elamur.ai/free/papers/sileo-2019-mining-discourse-markers-unsupervised-sentence/)
- [Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models](https://md.research.elamur.ai/free/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{malmi2018automatic,
  title = {{Automatic Prediction of Discourse Connectives}},
  author = {Malmi, Eric and Pighin, Daniele and Krause, Sebastian and Kozhevnikov, Mikhail},
  booktitle = {Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)},
  year = {2018},
  doi = {10.63317/3ztvcigon75v},
  eprint = {1702.00992},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.63317/3ztvcigon75v}
}
```

- [← previous Automatic Detection of Fake News](https://md.research.elamur.ai/free/papers/rosas-2018-automatic-detection-fake-news/)
- [next → Automatic Stance Detection Using End-to-End Memory Networks](https://md.research.elamur.ai/free/papers/mohtarami-2018-automatic-stance-detection-end-end/)
- [↑ back to papers of 2018](https://md.research.elamur.ai/free/papers/2018/)

## References

28 references, 17 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2015). Tensorflow: Large-scale machine learning on heterogeneous systems. Software available from tensorflow.org. [find](https://scholar.google.com/scholar?q=Abadi%2C+M%2E%2C+Agarwal%2C+A%2E%2C+Barham%2C+P%2E%2C+Brevdo%2C+E%2E%2C+Chen%2C+Z%2E%2C+Citro%2C+C%2E%2C+Corrado%2C+G%2E+S%2E%2C+Davis%2C+A%2E%2C+Dean%2C+J%2E%2C+Devin%2C+M%2E%2C+et+al%2E+%282015%29%2E+Tensorflow%3A+Large%2Dscale+machine+learning+on+heterogeneous+systems%2E+S)
2. Ba, J. L., Kiros, J. R., and Hinton, G. E. (2016). Layer normalization. arXiv preprint arXiv:1607.06450. [find](https://scholar.google.com/scholar?q=Ba%2C+J%2E+L%2E%2C+Kiros%2C+J%2E+R%2E%2C+and+Hinton%2C+G%2E+E%2E+%282016%29%2E+Layer+normalization%2E+arXiv+preprint+arXiv%3A1607%2E06450%2E) [our card](https://md.research.elamur.ai/free/papers/ba-2016-layer-normalization/)
3. Biran, O. and McKeown, K. (2013). Aggregated word pair features for implicit discourse relation disambiguation. In Proc. [find](https://scholar.google.com/scholar?q=Biran%2C+O%2E+and+McKeown%2C+K%2E+%282013%29%2E+Aggregated+word+pair+features+for+implicit+discourse+relation+disambiguation%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/biran-2013-aggregated-word-pair-features-implicit/)
4. ACL. Braud, C. and Denis, P. (2016). Learning connective-based word representations for implicit discourse relation identification. In Proc. [find](https://scholar.google.com/scholar?q=ACL%2E+Braud%2C+C%2E+and+Denis%2C+P%2E+%282016%29%2E+Learning+connective%2Dbased+word+representations+for+implicit+discourse+relation+identification%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/braud-2016-learning-connective-based-word-representations/)
5. EMNLP. Di Eugenio, B., Moore, J. D., and Paolucci, M. (1997). Learning features that predict cue usage. In Proc. [find](https://scholar.google.com/scholar?q=EMNLP%2E+Di+Eugenio%2C+B%2E%2C+Moore%2C+J%2E+D%2E%2C+and+Paolucci%2C+M%2E+%281997%29%2E+Learning+features+that+predict+cue+usage%2E+In+Proc%2E)
6. EACL. Elhadad, M. and McKeown, K. R. (1990). Generating connectives. In Proc. the 13th Conference on Computational Linguistics. [find](https://scholar.google.com/scholar?q=EACL%2E+Elhadad%2C+M%2E+and+McKeown%2C+K%2E+R%2E+%281990%29%2E+Generating+connectives%2E+In+Proc%2E+the+13th+Conference+on+Computational+Linguistics%2E)
7. Grote, B., Stede, M., et al. (1998). Discourse marker choice in sentence planning. In Proc. Ninth International Workshop on Natural Language Generation. [find](https://scholar.google.com/scholar?q=Grote%2C+B%2E%2C+Stede%2C+M%2E%2C+et+al%2E+%281998%29%2E+Discourse+marker+choice+in+sentence+planning%2E+In+Proc%2E+Ninth+International+Workshop+on+Natural+Language+Generation%2E)
8. Li, J. J. and Nenkova, A. (2014). Reducing sparsity improves the recognition of implicit discourse relations. In Proc. [find](https://scholar.google.com/scholar?q=Li%2C+J%2E+J%2E+and+Nenkova%2C+A%2E+%282014%29%2E+Reducing+sparsity+improves+the+recognition+of+implicit+discourse+relations%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/li-2014-reducing-sparsity-improves-recognition-implicit/)
9. SIGDIAL. Liu, Y. and Li, S. (2016). Recognizing implicit discourse relations via repeated reading: Neural networks with multi-level attention. In Proc. [find](https://scholar.google.com/scholar?q=SIGDIAL%2E+Liu%2C+Y%2E+and+Li%2C+S%2E+%282016%29%2E+Recognizing+implicit+discourse+relations+via+repeated+reading%3A+Neural+networks+with+multi%2Dlevel+attention%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/liu-2016-recognizing-implicit-discourse-relations-repeated/)
10. EMNLP. Liu, Y., Li, S., Zhang, X., and Sui, Z. (2016). Implicit discourse relation classification via multi-task neural networks. In Proc. [find](https://scholar.google.com/scholar?q=EMNLP%2E+Liu%2C+Y%2E%2C+Li%2C+S%2E%2C+Zhang%2C+X%2E%2C+and+Sui%2C+Z%2E+%282016%29%2E+Implicit+discourse+relation+classification+via+multi%2Dtask+neural+networks%2E+In+Proc%2E)
11. AAAI. Marcu, D. and Echihabi, A. (2002). An unsupervised approach to recognizing discourse relations. In Proc. [find](https://scholar.google.com/scholar?q=AAAI%2E+Marcu%2C+D%2E+and+Echihabi%2C+A%2E+%282002%29%2E+An+unsupervised+approach+to+recognizing+discourse+relations%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/marcu-2002-unsupervised-approach-recognizing-discourse-relations/)
12. ACL. Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., and Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In Proc. NIPS. Parikh, A. P., Täckström, O., Das, D., and Uszkoreit, J. (2016). A decomposable attention model for natural language inference… [find](https://scholar.google.com/scholar?q=ACL%2E+Mikolov%2C+T%2E%2C+Sutskever%2C+I%2E%2C+Chen%2C+K%2E%2C+Corrado%2C+G%2E+S%2E%2C+and+Dean%2C+J%2E+%282013%29%2E+Distributed+representations+of+words+and+phrases+and+their+compositionality%2E+In+Proc%2E+NIPS%2E+Parikh%2C+A%2E+P%2E%2C+Ta%CC%88ckstro%CC%88m%2C+)
13. EMNLP. Patterson, G. and Kehler, A. (2013). Predicting the presence of discourse connectives. In Proc. [find](https://scholar.google.com/scholar?q=EMNLP%2E+Patterson%2C+G%2E+and+Kehler%2C+A%2E+%282013%29%2E+Predicting+the+presence+of+discourse+connectives%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/patterson-2013-predicting-presence-discourse-connectives/)
14. EMNLP. Pitler, E., Raghupathy, M., Mehta, H., Nenkova, A., Lee, A., and Joshi, A. K. (2008). Easily identifiable discourse relations. In Proc. [find](https://scholar.google.com/scholar?q=EMNLP%2E+Pitler%2C+E%2E%2C+Raghupathy%2C+M%2E%2C+Mehta%2C+H%2E%2C+Nenkova%2C+A%2E%2C+Lee%2C+A%2E%2C+and+Joshi%2C+A%2E+K%2E+%282008%29%2E+Easily+identifiable+discourse+relations%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/pitler-2008-easily-identifiable-discourse-relations/)
15. Coling 2008: Companion volume: Posters and Demonstrations. [find](https://scholar.google.com/scholar?q=Coling+2008%3A+Companion+volume%3A+Posters+and+Demonstrations%2E)
16. Pitler, E., Louis, A., and Nenkova, A. (2009). Automatic sense prediction for implicit discourse relations in text. In Proc. [find](https://scholar.google.com/scholar?q=Pitler%2C+E%2E%2C+Louis%2C+A%2E%2C+and+Nenkova%2C+A%2E+%282009%29%2E+Automatic+sense+prediction+for+implicit+discourse+relations+in+text%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/disc-2009-pitler-automatic-sense-prediction-implicit-discourse/)
17. ACL-IJCNLP. Prasad, R., Dinesh, N., Lee, A., Miltsakaki, E., Robaldo, L., Joshi, A. K., and Webber, B. L. (2008). The penn discourse treebank 2.0. In Proc. [find](https://scholar.google.com/scholar?q=ACL%2DIJCNLP%2E+Prasad%2C+R%2E%2C+Dinesh%2C+N%2E%2C+Lee%2C+A%2E%2C+Miltsakaki%2C+E%2E%2C+Robaldo%2C+L%2E%2C+Joshi%2C+A%2E+K%2E%2C+and+Webber%2C+B%2E+L%2E+%282008%29%2E+The+penn+discourse+treebank+2%2E0%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/disc-2008-prasad-penn-discourse-treebank-2-0/)
18. LREC. Qin, L., Zhang, Z., and Zhao, H. (2016). A stacking gated neural architecture for implicit discourse relation classification. In Proc. [find](https://scholar.google.com/scholar?q=LREC%2E+Qin%2C+L%2E%2C+Zhang%2C+Z%2E%2C+and+Zhao%2C+H%2E+%282016%29%2E+A+stacking+gated+neural+architecture+for+implicit+discourse+relation+classification%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/qin-2016-stacking-gated-neural-architecture-implicit/)
19. EMNLP. Qin, L., Zhang, Z., Zhao, H., Hu, Z., and Xing, E. P. (2017). Adversarial connective-exploiting networks for implicit discourse relation classification. [find](https://scholar.google.com/scholar?q=EMNLP%2E+Qin%2C+L%2E%2C+Zhang%2C+Z%2E%2C+Zhao%2C+H%2E%2C+Hu%2C+Z%2E%2C+and+Xing%2C+E%2E+P%2E+%282017%29%2E+Adversarial+connective%2Dexploiting+networks+for+implicit+discourse+relation+classification%2E) [our card](https://md.research.elamur.ai/free/papers/qin-2017-adversarial-connective-exploiting-networks-implicit/)
20. Rohde, H., Dickinson, A., Clark, C., Louis, A., and Webber, B. (2015). Recovering discourse relations: Varying influence of discourse adverbials. In Proc. [find](https://scholar.google.com/scholar?q=Rohde%2C+H%2E%2C+Dickinson%2C+A%2E%2C+Clark%2C+C%2E%2C+Louis%2C+A%2E%2C+and+Webber%2C+B%2E+%282015%29%2E+Recovering+discourse+relations%3A+Varying+influence+of+discourse+adverbials%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/rohde-2015-recovering-discourse-relations-varying-influence/)
21. LSDSem Workshop. Rohde, H., Dickinson, A., Schneider, N., Clark, C. N., Louis, A., and Webber, B. (2016). Filling in the blanks in understanding discourse adverbials: Consistency, conflict, and context-dependence in a crowdsourced elicitation task. In Proc. [find](https://scholar.google.com/scholar?q=LSDSem+Workshop%2E+Rohde%2C+H%2E%2C+Dickinson%2C+A%2E%2C+Schneider%2C+N%2E%2C+Clark%2C+C%2E+N%2E%2C+Louis%2C+A%2E%2C+and+Webber%2C+B%2E+%282016%29%2E+Filling+in+the+blanks+in+understanding+discourse+adverbials%3A+Consistency%2C+conflict%2C+and+contex)
22. LAW X Workshop. Rutherford, A. and Xue, N. (2014). Discovering implicit discourse relations through brown cluster pair representation and coreference patterns. In Proc. [find](https://scholar.google.com/scholar?q=LAW+X+Workshop%2E+Rutherford%2C+A%2E+and+Xue%2C+N%2E+%282014%29%2E+Discovering+implicit+discourse+relations+through+brown+cluster+pair+representation+and+coreference+patterns%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/rutherford-2014-discovering-implicit-discourse-relations-through/)
23. EACL. Rutherford, A. and Xue, N. (2015). Improving the inference of implicit discourse relations via classifying explicit discourse connectives. In Proc. [find](https://scholar.google.com/scholar?q=EACL%2E+Rutherford%2C+A%2E+and+Xue%2C+N%2E+%282015%29%2E+Improving+the+inference+of+implicit+discourse+relations+via+classifying+explicit+discourse+connectives%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/rutherford-2015-improving-inference-implicit-discourse-relations/)
24. NAACL-HLT. Wu, C., Shi, X., Chen, Y., Huang, Y., and Su, J. (2017). Leveraging bilingually-constrained synthetic data via multi-task neural networks for implicit discourse relation recognition. Neurocomputing, 243:69–79. [find](https://scholar.google.com/scholar?q=NAACL%2DHLT%2E+Wu%2C+C%2E%2C+Shi%2C+X%2E%2C+Chen%2C+Y%2E%2C+Huang%2C+Y%2E%2C+and+Su%2C+J%2E+%282017%29%2E+Leveraging+bilingually%2Dconstrained+synthetic+data+via+multi%2Dtask+neural+networks+for+implicit+discourse+relation+recognition%2E+Neuroc)
25. Xu, Y., Lan, M., Lu, Y., Niu, Z. Y., and Tan, C. L. (2012). Connective prediction using machine learning for implicit discourse relation classification. In Proc. [find](https://scholar.google.com/scholar?q=Xu%2C+Y%2E%2C+Lan%2C+M%2E%2C+Lu%2C+Y%2E%2C+Niu%2C+Z%2E+Y%2E%2C+and+Tan%2C+C%2E+L%2E+%282012%29%2E+Connective+prediction+using+machine+learning+for+implicit+discourse+relation+classification%2E+In+Proc%2E)
26. IJCNN. Yung, F., Duh, K., Komura, T., and Matsumoto, Y. (2017). A psycholinguistic model for the marking of discourse relations. Dialogue & Discourse, 8(1):106–131. [find](https://scholar.google.com/scholar?q=IJCNN%2E+Yung%2C+F%2E%2C+Duh%2C+K%2E%2C+Komura%2C+T%2E%2C+and+Matsumoto%2C+Y%2E+%282017%29%2E+A+psycholinguistic+model+for+the+marking+of+discourse+relations%2E+Dialogue+%26+Discourse%2C+8%281%29%3A106%E2%80%93131%2E)
27. Zhang, B., Xiong, D., Su, J., Liu, Q., Ji, R., Duan, H., and Zhang, M. (2016). Variational neural discourse relation recognizer. In Proc. [find](https://scholar.google.com/scholar?q=Zhang%2C+B%2E%2C+Xiong%2C+D%2E%2C+Su%2C+J%2E%2C+Liu%2C+Q%2E%2C+Ji%2C+R%2E%2C+Duan%2C+H%2E%2C+and+Zhang%2C+M%2E+%282016%29%2E+Variational+neural+discourse+relation+recognizer%2E+In+Proc%2E) [our card](https://md.research.elamur.ai/free/papers/zhang-2016-variational-neural-discourse-relation-recognizer/)
28. EMNLP. Zhou, Z. M., Lan, M., Niu, Z. Y., Xu, Y., and Su, J. (2010). The effects of discourse connectives prediction on implicit discourse relation recognition. In Proc. SIGDIAL. [find](https://scholar.google.com/scholar?q=EMNLP%2E+Zhou%2C+Z%2E+M%2E%2C+Lan%2C+M%2E%2C+Niu%2C+Z%2E+Y%2E%2C+Xu%2C+Y%2E%2C+and+Su%2C+J%2E+%282010%29%2E+The+effects+of+discourse+connectives+prediction+on+implicit+discourse+relation+recognition%2E+In+Proc%2E+SIGDIAL%2E) [our card](https://md.research.elamur.ai/free/papers/zhou-2010-effects-discourse-connectives-prediction-implicit/)