---
title: "Breaking Through the 80% Glass Ceiling — Bevilacqua 2020"
description: "The authors propose EWISER, which extends EWISE. 2.8 points on Italian. 35 references, cited by 86 papers here."
authors: ["Michele Bevilacqua", "Roberto Navigli"]
year: 2020
venue: "Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics"
source: "https://aclanthology.org/2020.acl-main.255/"
doi: "10.18653/v1/2020.acl-main.255"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/bevilacqua-2020-breaking-through-80-glass-ceiling/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/bevilacqua-2020-breaking-through-80-glass-ceiling/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/page/3/) / Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information

# Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information

**Authors:** [Michele Bevilacqua](https://md.research.elamur.ai/free/en/authors/michele-bevilacqua/) and [Roberto Navigli](https://md.research.elamur.ai/free/en/authors/roberto-navigli/) · **Year:** 2020 · **Venue:** Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2020.acl-main.255/) · [PDF](https://aclanthology.org/2020.acl-main.255.pdf) · [DOI 10.18653/v1/2020.acl-main.255](https://doi.org/10.18653/v1/2020.acl-main.255) · [OpenAlex](https://openalex.org/W3034782826)

**Citations:** 146 citations (OpenAlex, 2026-10-14) · [86](https://md.research.elamur.ai/free/en/papers/bevilacqua-2020-breaking-through-80-glass-ceiling/cited-by/) in our library, of the 140,884 papers whose bibliographies we read

## Summary
Neural supervised systems lead Word Sense Disambiguation (WSD), but they make little use of the relations (hypernymy, similarity, derivation, etc.) stored in lexical knowledge bases such as WordNet. They also struggle with senses that are rare or absent in the training data. The authors propose EWISER, which extends EWISE. A frozen BERT Large (cased) encoder supplies contextual vectors, built by summing its top four layers, to a small two-layer feedforward classifier with swish activation. Two kinds of prior knowledge are added. First, the output matrix starts from off-the-shelf pretrained synset embeddings and is then trained further. Second, a "structured logits" step spreads scores along WordNet edges by multiplying the logits with a sparse, normalized adjacency matrix before the softmax. The two additions are complementary and let the model pick synsets never seen in training. EWISER sets a new state of the art on nearly every English all-words setting and is the first system to exceed 80 F1 on the combined benchmark. Trained only on English data, it also leads multilingual WSD. This shows graph knowledge can be cheaply integrated into neural models.

## Key points
- Structured logits are computed as Q = ZAᵀ + Z. In the matrix A, each incoming WordNet edge gets weight 1/N, where N is the target synset's number of incoming links. This prevents bias toward highly connected synsets.
- The base graph uses similarity, verb group and derivationally related edges. Variants add hypernymy, hyponymy, both, or their transitive closures. The best overall model is EWISER hyper, trained on SemCor plus tagged WordNet glosses and examples.
- EWISER is the first system to pass 80 F1 on the concatenation of the standard English all-words benchmarks. The authors describe this level as matching the estimated inter-annotator upper bound.
- In cross-lingual evaluation on datasets updated for BabelNet 4.0.1, it beats SensEmBERT on all four SemEval-2013 datasets, by nearly 8 points on Italian. On SemEval-2015 it beats SyntagRank by 6.1 points on Spanish and 2.8 points on Italian.
- The model can still miss senses that never appear in SemCor, such as the dental sense of "root". Code and pretrained models are available at github.com/SapienzaNLP/ewiser.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [AI & machine learning](https://md.research.elamur.ai/free/en/shelves/ai/)

Topics: [🔀 Word sense disambiguation](https://md.research.elamur.ai/free/en/topics/word-sense-disambiguation/) · [🕸️ Knowledge graphs & ontologies](https://md.research.elamur.ai/free/en/topics/knowledge-graphs/)

## Institutions

- [Sapienza University of Rome](https://md.research.elamur.ai/free/en/universities/sapienza-university-of-rome/) — University, Rome, Italy · 29 works · 6,807 citations

## Cite

Cite as: Michele Bevilacqua and Roberto Navigli. 2020. Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{bevilacqua2020breaking,
  title = {{Breaking Through the 80\% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information}},
  author = {Michele Bevilacqua and Roberto Navigli},
  booktitle = {Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics},
  year = {2020},
  doi = {10.18653/v1/2020.acl-main.255},
  url = {https://doi.org/10.18653/v1/2020.acl-main.255}
}
```

- [← previous Politeness Transfer: A Tag and Generate Approach](https://md.research.elamur.ai/free/en/papers/madaan-2020-politeness-transfer-tag-generate-approach/)
- [next → Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encoders](https://md.research.elamur.ai/free/en/papers/blevins-2020-moving-down-long-tail-word/)
- [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/page/3/)

## References

35 references, 8 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Eneko Agirre and Aitor Soroa. 2009. Personalizing PageRank for word sense disambiguation. In Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009), pages 33–41, Athens, Greece. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Eneko+Agirre+and+Aitor+Soroa%2E+2009%2E+Personalizing+PageRank+for+word+sense+disambiguation%2E+In+Proceedings+of+the+12th+Conference+of+the+European+Chapter+of+the+ACL+%28EACL+2009%29%2C+pages+33%E2%80%9341%2C+Athens%2C+Gre)
2. Michele Bevilacqua and Roberto Navigli. 2019. Quasi Bidirectional Encoder Representations from Transformers for word sense disambiguation. In Proceedings of the International Conference Recent Advances in Natural Language Processing, pages 122– 131, Varna, Bulgaria. INCOMA Ltd. [find](https://scholar.google.com/scholar?q=Michele+Bevilacqua+and+Roberto+Navigli%2E+2019%2E+Quasi+Bidirectional+Encoder+Representations+from+Transformers+for+word+sense+disambiguation%2E+In+Proceedings+of+the+International+Conference+Recent+Advance)
3. Kong, China. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Kong%2C+China%2E+Association+for+Computational+Linguistics%2E)
4. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015. [find](https://scholar.google.com/scholar?q=Diederik+P%2E+Kingma+and+Jimmy+Ba%2E+2015%2E+Adam%3A+A+method+for+stochastic+optimization%2E+In+Proceedings+of+the+3rd+International+Conference+on+Learning+Representations%2C+ICLR+2015%2C+San+Diego%2C+CA%2C+USA%2C+May+7%2D)
5. Sawan Kumar, Sharmistha Jat, Karan Saxena, and Partha Talukdar. 2019. Zero-shot word sense disambiguation using sense definition embeddings. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5670–5681, Florence, Italy. Association for Computational Lin… [find](https://scholar.google.com/scholar?q=Sawan+Kumar%2C+Sharmistha+Jat%2C+Karan+Saxena%2C+and+Partha+Talukdar%2E+2019%2E+Zero%2Dshot+word+sense+disambiguation+using+sense+definition+embeddings%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Associatio)
6. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional Transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… [our card](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)
7. Robert Logan, Nelson F. Liu, Matthew E. Peters, Matt Gardner, and Sameer Singh. 2019. Barack’s wife Hillary: Using knowledge graphs for fact-aware language modeling. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5962–5971, Florence, Italy. Associat… [find](https://scholar.google.com/scholar?q=Robert+Logan%2C+Nelson+F%2E+Liu%2C+Matthew+E%2E+Peters%2C+Matt+Gardner%2C+and+Sameer+Singh%2E+2019%2E+Barack%E2%80%99s+wife+Hillary%3A+Using+knowledge+graphs+for+fact%2Daware+language+modeling%2E+In+Proceedings+of+the+57th+Annual+)
8. Philip Edmonds and Scott Cotton. 2001. SENSEVAL-2: Overview. In Proceedings of SENSEVAL-2 Second International Workshop on Evaluating Word Sense Disambiguation Systems, pages 1–5, Toulouse, France. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Philip+Edmonds+and+Scott+Cotton%2E+2001%2E+SENSEVAL%2D2%3A+Overview%2E+In+Proceedings+of+SENSEVAL%2D2+Second+International+Workshop+on+Evaluating+Word+Sense+Disambiguation+Systems%2C+pages+1%E2%80%935%2C+Toulouse%2C+France%2E+As)
9. Daniel Loureiro and Alı́pio Jorge. 2019. Language modelling makes sense: Propagating representations through WordNet for full-coverage word sense disambiguation. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 5682–5691, Florence, Italy. Association… [our card](https://md.research.elamur.ai/free/en/papers/loureiro-2019-language-modelling-makes-sense-propagating/)
10. Steffen Eger, Paul Youssef, and Iryna Gurevych. 2018. Is it time to swish? Comparing deep learning activation functions across NLP tasks. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4415–4424, Brussels, Belgium. Association for Computational Lingu… [find](https://scholar.google.com/scholar?q=Steffen+Eger%2C+Paul+Youssef%2C+and+Iryna+Gurevych%2E+2018%2E+Is+it+time+to+swish%3F+Comparing+deep+learning+activation+functions+across+NLP+tasks%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+in+)
11. Fuli Luo, Tianyu Liu, Qiaolin Xia, Baobao Chang, and Zhifang Sui. 2018. Incorporating glosses into neural word sense disambiguation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2473–2482, Melbourne, Australia. Association… [find](https://scholar.google.com/scholar?q=Fuli+Luo%2C+Tianyu+Liu%2C+Qiaolin+Xia%2C+Baobao+Chang%2C+and+Zhifang+Sui%2E+2018%2E+Incorporating+glosses+into+neural+word+sense+disambiguation%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Co)
12. Christian Hadiwinoto, Hwee Tou Ng, and Wee Chung Gan. 2019. Improved word sense disambiguation using pre-trained contextualized word representations. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Langua… [find](https://scholar.google.com/scholar?q=Christian+Hadiwinoto%2C+Hwee+Tou+Ng%2C+and+Wee+Chung+Gan%2E+2019%2E+Improved+word+sense+disambiguation+using+pre%2Dtrained+contextualized+word+representations%2E+In+Proceedings+of+the+2019+Conference+on+Empirical)
13. Marco Maru, Federico Scozzafava, Federico Martelli, and Roberto Navigli. 2019. SyntagNet: Challenging supervised word sense disambiguation with lexical-semantic combinations. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Con… [find](https://scholar.google.com/scholar?q=Marco+Maru%2C+Federico+Scozzafava%2C+Federico+Martelli%2C+and+Roberto+Navigli%2E+2019%2E+SyntagNet%3A+Challenging+supervised+word+sense+disambiguation+with+lexical%2Dsemantic+combinations%2E+In+Proceedings+of+the+201)
14. Jeremy Howard and Sebastian Ruder. 2018. Universal language model fine-tuning for text classification. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 328–339, Melbourne, Australia. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jeremy+Howard+and+Sebastian+Ruder%2E+2018%2E+Universal+language+model+fine%2Dtuning+for+text+classification%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volum)
15. George A. Miller. 1995. WordNet: A lexical database for english. Commun. ACM, 38(11):39–41. [our card](https://md.research.elamur.ai/free/en/papers/miller-1994-wordnet/)
16. Luyao Huang, Chi Sun, Xipeng Qiu, and Xuanjing Huang. 2019. GlossBERT: BERT for word sense disambiguation with gloss knowledge. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-I… [our card](https://md.research.elamur.ai/free/en/papers/huang-2019-glossbert-bert-word-sense-disambiguation/)
17. Andrea Moro and Roberto Navigli. 2015. SemEval-2015 task 13: Multilingual all-words sense disambiguation and entity linking. In Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), pages 288–297, Denver, Colorado. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Andrea+Moro+and+Roberto+Navigli%2E+2015%2E+SemEval%2D2015+task+13%3A+Multilingual+all%2Dwords+sense+disambiguation+and+entity+linking%2E+In+Proceedings+of+the+9th+International+Workshop+on+Semantic+Evaluation+%28Se)
18. Andrea Moro, Alessandro Raganato, and Roberto Navigli. 2014. Entity linking meets word sense disambiguation: a unified approach. Transactions of the Association for Computational Linguistics, 2:231– 244. [our card](https://md.research.elamur.ai/free/en/papers/moro-2014-entity-linking-meets-word-sense/)
19. Roberto Navigli. 2009. Word sense disambiguation: A survey. ACM Comput. Surv., 41(2):10:1–10:69. [find](https://scholar.google.com/scholar?q=Roberto+Navigli%2E+2009%2E+Word+sense+disambiguation%3A+A+survey%2E+ACM+Comput%2E+Surv%2E%2C+41%282%29%3A10%3A1%E2%80%9310%3A69%2E)
20. Roberto Navigli. 2018. Natural Language Understanding: Instructions for (Present and Future) Use. In Proc. of the 27th International Joint Conference on Artificial Intelligence (IJCAI-18), pages 5697–5702, Stockholm, Sweden. [find](https://scholar.google.com/scholar?q=Roberto+Navigli%2E+2018%2E+Natural+Language+Understanding%3A+Instructions+for+%28Present+and+Future%29+Use%2E+In+Proc%2E+of+the+27th+International+Joint+Conference+on+Artificial+Intelligence+%28IJCAI%2D18%29%2C+pages+5697%E2%80%93)
21. Roberto Navigli, David Jurgens, and Daniele Vannella. 2013. SemEval-2013 task 12: Multilingual word sense disambiguation. In Proceedings of the Second Joint Conference on Lexical and Computational Semantics (*SEM), Volume 2: Seventh International Workshop on Semantic Evaluation (SemEval 2013), pages… [find](https://scholar.google.com/scholar?q=Roberto+Navigli%2C+David+Jurgens%2C+and+Daniele+Vannella%2E+2013%2E+SemEval%2D2013+task+12%3A+Multilingual+word+sense+disambiguation%2E+In+Proceedings+of+the+Second+Joint+Conference+on+Lexical+and+Computational+Sem)
22. Roberto Navigli and Simone Paolo Ponzetto. 2012. BabelNet: The automatic construction, evaluation and application of a wide-coverage multilingual semantic network. Artificial Intelligence, 193:217–250. [find](https://scholar.google.com/scholar?q=Roberto+Navigli+and+Simone+Paolo+Ponzetto%2E+2012%2E+BabelNet%3A+The+automatic+construction%2C+evaluation+and+application+of+a+wide%2Dcoverage+multilingual+semantic+network%2E+Artificial+Intelligence%2C+193%3A217%E2%80%93250)
23. Tommaso Pasini. 2020. The knowledge acquisition bottleneck problem in multilingual word sense disambiguation. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI 2020. ijcai.org. [find](https://scholar.google.com/scholar?q=Tommaso+Pasini%2E+2020%2E+The+knowledge+acquisition+bottleneck+problem+in+multilingual+word+sense+disambiguation%2E+In+Proceedings+of+the+Twenty%2DEighth+International+Joint+Conference+on+Artificial+Intellige)
24. Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolog… [our card](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/)
25. Matthew E. Peters, Mark Neumann, Robert Logan, Roy Schwartz, Vidur Joshi, Sameer Singh, and Noah A. Smith. 2019. Knowledge enhanced contextual word representations. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on… [find](https://scholar.google.com/scholar?q=Matthew+E%2E+Peters%2C+Mark+Neumann%2C+Robert+Logan%2C+Roy+Schwartz%2C+Vidur+Joshi%2C+Sameer+Singh%2C+and+Noah+A%2E+Smith%2E+2019%2E+Knowledge+enhanced+contextual+word+representations%2E+In+Proceedings+of+the+2019+Conferen)
26. Mohammad Taher Pilehvar and Nigel Collier. 2016. De-conflated semantic representations. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1680–1690, Austin, Texas. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Mohammad+Taher+Pilehvar+and+Nigel+Collier%2E+2016%2E+De%2Dconflated+semantic+representations%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+1680%E2%80%931690%2C+Aust)
27. Sameer Pradhan, Edward Loper, Dmitriy Dligach, and Martha Palmer. 2007. SemEval-2007 task-17: English lexical sample, SRL and all words. In Proceedings of the Fourth International Workshop on Semantic Evaluations (SemEval-2007), pages 87–92, Prague, Czech Republic. Association for Computational Ling… [our card](https://md.research.elamur.ai/free/en/papers/pradhan-2007-semeval-2007-task-17-english/)
28. Alessandro Raganato, Claudio Delli Bovi, and Roberto Navigli. 2017. Neural sequence learning models for word sense disambiguation. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 1156–1167, Copenhagen, Denmark. Association for Computational Linguistic… [find](https://scholar.google.com/scholar?q=Alessandro+Raganato%2C+Claudio+Delli+Bovi%2C+and+Roberto+Navigli%2E+2017%2E+Neural+sequence+learning+models+for+word+sense+disambiguation%2E+In+Proceedings+of+the+2017+Conference+on+Empirical+Methods+in+Natural)
29. Prajit Ramachandran, Barret Zoph, and Quoc V. Le. 2018. Searching for activation functions. In Proceedings of the 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Workshop Track. [find](https://scholar.google.com/scholar?q=Prajit+Ramachandran%2C+Barret+Zoph%2C+and+Quoc+V%2E+Le%2E+2018%2E+Searching+for+activation+functions%2E+In+Proceedings+of+the+6th+International+Conference+on+Learning+Representations%2C+ICLR+2018%2C+Vancouver%2C+BC%2C+Ca)
30. Bianca Scarlini, Tommaso Pasini, and Roberto Navigli. 2020. SensEmBERT: Context-enhanced sense embeddings for multilingual word sense disambiguation. In Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020. [find](https://scholar.google.com/scholar?q=Bianca+Scarlini%2C+Tommaso+Pasini%2C+and+Roberto+Navigli%2E+2020%2E+SensEmBERT%3A+Context%2Denhanced+sense+embeddings+for+multilingual+word+sense+disambiguation%2E+In+Proceedings+of+the+Thirty%2DFourth+AAAI+Conferenc)
31. Federico Scozzafava, Marco Maru, Fabrizio Brignone, Giovanni Torrisi, and Roberto Navigli. 2020. Personalized PageRank with syntagmatic information for multilingual word sense disambiguation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for… [find](https://scholar.google.com/scholar?q=Federico+Scozzafava%2C+Marco+Maru%2C+Fabrizio+Brignone%2C+Giovanni+Torrisi%2C+and+Roberto+Navigli%2E+2020%2E+Personalized+PageRank+with+syntagmatic+information+for+multilingual+word+sense+disambiguation%2E+In+Proce)
32. Benjamin Snyder and Martha Palmer. 2004. The English all-words task. In Proceedings of SENSEVAL-3, the Third International Workshop on the Evaluation of Systems for the Semantic Analysis of Text, pages 41–43, Barcelona, Spain. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Benjamin+Snyder+and+Martha+Palmer%2E+2004%2E+The+English+all%2Dwords+task%2E+In+Proceedings+of+SENSEVAL%2D3%2C+the+Third+International+Workshop+on+the+Evaluation+of+Systems+for+the+Semantic+Analysis+of+Text%2C+page)
33. Tolga Uslu, Alexander Mehler, Daniel Baumartz, and Wahed Hemati. 2018. FastSense: An efficient word sense disambiguation classifier. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan. European Language Resources Association (ELR… [find](https://scholar.google.com/scholar?q=Tolga+Uslu%2C+Alexander+Mehler%2C+Daniel+Baumartz%2C+and+Wahed+Hemati%2E+2018%2E+FastSense%3A+An+efficient+word+sense+disambiguation+classifier%2E+In+Proceedings+of+the+Eleventh+International+Conference+on+Language)
34. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the Annual Conference on Neural Information Processing Systems 2017, 4-9 December 2017, Long Beach, CA, USA, pages 5998–600… [our card](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/)
35. Loı̈c Vial, Benjamin Lecouteux, and Didier Schwab. 2019. Sense vocabulary compression through the semantic knowledge of WordNet for neural word sense disambiguation. In Proceedings of the Global Word-Net Conference, pages 108–117. [find](https://scholar.google.com/scholar?q=Lo%C4%B1%CC%88c+Vial%2C+Benjamin+Lecouteux%2C+and+Didier+Schwab%2E+2019%2E+Sense+vocabulary+compression+through+the+semantic+knowledge+of+WordNet+for+neural+word+sense+disambiguation%2E+In+Proceedings+of+the+Global+Word%2D)