---
title: "Learning Distributed Representations of Texts and Entities from"
description: "The paper presents Neural Text-Entity Encoder (NTEE), a model that places sentences or… 46 references, cited by 28 papers here."
authors: ["Ikuya Yamada", "Hiroyuki Shindo", "Hideaki Takeda", "Yoshiyasu Takefuji"]
year: 2017
venue: "Transactions of the Association for Computational Linguistics"
source: "https://aclanthology.org/Q17-1028/"
doi: "10.1162/tacl_a_00069"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/yamada-2017-learning-distributed-representations-texts-entities/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/yamada-2017-learning-distributed-representations-texts-entities/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2017](https://md.research.elamur.ai/free/en/papers/2017/page/3/) / Learning Distributed Representations of Texts and Entities from Knowledge Base

# Learning Distributed Representations of Texts and Entities from Knowledge Base

**Authors:** [Ikuya Yamada](https://md.research.elamur.ai/free/en/authors/ikuya-yamada/), [Hiroyuki Shindo](https://md.research.elamur.ai/free/en/authors/hiroyuki-shindo/), [Hideaki Takeda](https://md.research.elamur.ai/free/en/authors/hideaki-takeda/) and [Yoshiyasu Takefuji](https://md.research.elamur.ai/free/en/authors/yoshiyasu-takefuji/) · **Year:** 2017 · **Venue:** [Transactions of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/tacl/) ([Transactions of the Association for Computational Linguistics (TACL) 2017](https://md.research.elamur.ai/free/en/venues/tacl/2017/)) · **Publisher:** [The MIT Press](https://md.research.elamur.ai/free/en/publishers/the-mit-press/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/Q17-1028/) · [PDF](https://aclanthology.org/Q17-1028.pdf) · [DOI 10.1162/tacl\_a\_00069](https://doi.org/10.1162/tacl_a_00069) · [OpenAlex](https://openalex.org/W2613223139)

**Citations:** 97 citations (OpenAlex, 2026-10-14) · [28](https://md.research.elamur.ai/free/en/papers/yamada-2017-learning-distributed-representations-texts-entities/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary

The paper presents Neural Text-Entity Encoder (NTEE), a model that places sentences or paragraphs and knowledge base entities in one shared vector space. The authors start from the observation that a text's meaning can be captured by a few related entities, as in ESA. They treat the hyperlinks that Wikipedia editors add by hand as supervision: for each text, NTEE learns to predict the entities linked inside it. A text vector is built by summing its word vectors, applying L2 normalization and passing the result through one fully connected layer. Training uses a softmax over entities, approximated with uniform negative sampling. Word and entity embeddings are initialized from a skip-gram model trained on Wikipedia.

The learned representations were tested in three ways:
- unsupervised semantic textual similarity;
- entity linking, with a simple MLP classifier on top;
- quiz-bowl factoid QA, also with an MLP classifier.

NTEE reached state-of-the-art results on all three tasks. This suggests that joint text-entity embeddings can serve as general-purpose features, and the code and trained models are publicly released.

## Key points

- **Training data:** the English DBpedia abstract corpus, built from the introductory sections of 4.4 million Wikipedia articles. Only editor-created annotations were used, plus a pseudo-annotation linking each text to its source page's entity. The vocabulary covered 705,168 words and 957,207 entities, from about 382M word tokens and 28M entity annotations.
- **Training setup:** 300 dimensions, 30 negative samples, mini-batch size 100 and a single epoch. The model was trained with SGD and RMSprop in Theano, taking about six days on an NVIDIA K80.
- **Initialization:** skip-gram vectors from Gensim, trained on a July 2016 Wikipedia dump with entity mentions replaced by entity IDs (window size 10, 5 negative samples).
- **Evaluation datasets:**
  - STS 2014 (3,750 pairs) and SICK (10,000 pairs) for similarity;
  - CoNLL 2003 and TAC 2010 for entity linking;
  - a quiz bowl dataset for factoid QA.
- **Release:** code and models are available at github.com/studio-ousia/ntee. Qualitative neighbor lists show that NTEE's word and entity neighborhoods differ noticeably from those of plain skip-gram.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Nara Institute of Science and Technology](https://md.research.elamur.ai/free/en/universities/nara-institute-of-science-and-technology/) — University, Ikoma, Japan · 46 works · 4,565 citations
- [National Institute of Informatics](https://md.research.elamur.ai/free/en/labs/national-institute-of-informatics/) — Research institute, Tokyo, Japan · 37 works · 3,247 citations
- [Keio University](https://md.research.elamur.ai/free/en/universities/keio-university/) — University, Tokyo, Japan · 7 works · 882 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works

🧭 Topics (1): [🕸️ Knowledge graphs & ontologies](https://md.research.elamur.ai/free/en/topics/knowledge-graphs/) · 192 works

## Cite

Cite as: Ikuya Yamada, Hiroyuki Shindo, Hideaki Takeda and Yoshiyasu Takefuji. 2017. Learning Distributed Representations of Texts and Entities from Knowledge Base. Transactions of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@article{yamada2017learning,
  title = {{Learning Distributed Representations of Texts and Entities from Knowledge Base}},
  author = {Ikuya Yamada, Hiroyuki Shindo, Hideaki Takeda and Yoshiyasu Takefuji},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2017},
  doi = {10.1162/tacl\_a\_00069},
  url = {https://doi.org/10.1162/tacl_a_00069}
}
```

- [← previous Arabic Language Sentiment Analysis on Health Services](https://md.research.elamur.ai/free/en/papers/alayba-2017-arabic-language-sentiment-analysis-health/)
- [next → How much progress have we made on RST discourse parsing? A replication study of recent results on the RST-DT](https://md.research.elamur.ai/free/en/papers/morey-2017-how-much-progress-have-we/)
- [↑ back to papers of 2017](https://md.research.elamur.ai/free/en/papers/2017/page/3/)

## References

46 references, 17 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Eneko Agirre, Carmen Banea, Claire Cardie, Daniel Cer, Mona Diab, Aitor Gonzalez-Agirre, Weiwei Guo, Rada Mihalcea, German Rigau, and Janyce Wiebe. 2014. [SemEval-2014 Task 10: Multilingual Semantic Textual Similarity](https://md.research.elamur.ai/free/en/papers/agirre-2014-semeval-2014-task-10-multilingual/). In Proceedings of the 8th International Workshop on Semantic Evaluation, pages 81–…
2. Antoine Bordes, Nicolas Usunier, Alberto Garcia-Duran, Jason Weston, and Oksana Yakhnenko. 2013. [find](https://scholar.google.com/scholar?q=Antoine+Bordes%2C+Nicolas+Usunier%2C+Alberto+Garcia%2DDuran%2C+Jason+Weston%2C+and+Oksana+Yakhnenko%2E+2013%2E)
3. Translating Embeddings for Modeling Multi-relational Data. In Advances in Neural Information Processing Systems 26, pages 2787–2795. Martin Brümmer, Milan Dojchinovski, and Sebastian Hellmann. 2016. DBpedia Abstracts: A Large-Scale, Open, Multilingual NLP Training Corpus. In Proceedings of the Tent… [find](https://scholar.google.com/scholar?q=Translating+Embeddings+for+Modeling+Multi%2Drelational+Data%2E+In+Advances+in+Neural+Information+Processing+Systems+26%2C+pages+2787%E2%80%932795%2E+Martin+Bru%CC%88mmer%2C+Milan+Dojchinovski%2C+and+Sebastian+Hellmann%2E+2016%2E+)
4. Andrew Chisholm and Ben Hachey. 2015. [Entity Disambiguation with Web Links](https://md.research.elamur.ai/free/en/papers/chisholm-2015-entity-disambiguation-web-links/). Transactions of the Association for Computational Linguistics, 3:145–156.
5. Silviu Cucerzan. 2007. Large-Scale Named Entity Disambiguation Based on Wikipedia Data. In Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pages 708–716. [find](https://scholar.google.com/scholar?q=Silviu+Cucerzan%2E+2007%2E+Large%2DScale+Named+Entity+Disambiguation+Based+on+Wikipedia+Data%2E+In+Proceedings+of+the+2007+Joint+Conference+on+Empirical+Methods+in+Natural+Language+Processing+and+Computationa)
6. Wei Fang, Jianwen Zhang, Dilin Wang, Zheng Chen, and Ming Li. 2016. Entity Disambiguation by Knowledge and Text Jointly Embedding. In Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning, pages 260–269. [find](https://scholar.google.com/scholar?q=Wei+Fang%2C+Jianwen+Zhang%2C+Dilin+Wang%2C+Zheng+Chen%2C+and+Ming+Li%2E+2016%2E+Entity+Disambiguation+by+Knowledge+and+Text+Jointly+Embedding%2E+In+Proceedings+of+The+20th+SIGNLL+Conference+on+Computational+Natural)
7. Evgeniy Gabrilovich and Shaul Markovitch. 2007. Computing Semantic Relatedness Using Wikipedia-Based Explicit Semantic Analysis. In International Joint Conference on Artificial Intelligence, pages 1606– 1611. [find](https://scholar.google.com/scholar?q=Evgeniy+Gabrilovich+and+Shaul+Markovitch%2E+2007%2E+Computing+Semantic+Relatedness+Using+Wikipedia%2DBased+Explicit+Semantic+Analysis%2E+In+International+Joint+Conference+on+Artificial+Intelligence%2C+pages+160)
8. Juri Ganitkevitch, Benjamin Van Durme, and Chris Callison-Burch. 2013. [PPDB: The Paraphrase Database](https://md.research.elamur.ai/free/en/papers/ganitkevitch-2013-ppdb-paraphrase-database/). In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 758–764.
9. Amir Globerson, Nevena Lazic, Soumen Chakrabarti, Amarnag Subramanya, Michael Ringaard, and Fernando Pereira. 2016. Collective Entity Resolution with Multi-Focal Attention. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 621–6… [find](https://scholar.google.com/scholar?q=Amir+Globerson%2C+Nevena+Lazic%2C+Soumen+Chakrabarti%2C+Amarnag+Subramanya%2C+Michael+Ringaard%2C+and+Fernando+Pereira%2E+2016%2E+Collective+Entity+Resolution+with+Multi%2DFocal+Attention%2E+In+Proceedings+of+the+54th+)
10. Hannaneh Hajishirzi, Leila Zilles, Daniel S Weld, and Luke Zettlemoyer. 2013. [Joint Coreference Resolution and Named-Entity Linking with Multi-Pass Sieves](https://md.research.elamur.ai/free/en/papers/hajishirzi-2013-joint-coreference-resolution-named-entity/). In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 289–299.
11. Zhengyan He, Shujie Liu, Mu Li, Ming Zhou, Longkai Zhang, and Houfeng Wang. 2013. Learning Entity Representation for Entity Disambiguation. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 30–34. [find](https://scholar.google.com/scholar?q=Zhengyan+He%2C+Shujie+Liu%2C+Mu+Li%2C+Ming+Zhou%2C+Longkai+Zhang%2C+and+Houfeng+Wang%2E+2013%2E+Learning+Entity+Representation+for+Entity+Disambiguation%2E+In+Proceedings+of+the+51st+Annual+Meeting+of+the+Association)
12. Felix Hill, Kyunghyun Cho, and Anna Korhonen. 2016a. [Learning Distributed Representations of Sentences from Unlabelled Data](https://md.research.elamur.ai/free/en/papers/hill-2016-learning-distributed-representations-sentences-unlabelled/). In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1367–1377.
13. Felix Hill, Kyunghyun Cho, Anna Korhonen, and Yoshua Bengio. 2016b. [Learning to Understand Phrases by Embedding the Dictionary](https://md.research.elamur.ai/free/en/papers/hill-2016-learning-understand-phrases-embedding-dictionary/). Transactions of the Association for Computational Linguistics, 4:17–30. Johannes Hoffart, Mohamed Amir Yosef, Ilaria Bordino, Hagen Fürstenau, Manfred Pinkal, Marc Spaniol…
14. Zhiting Hu, Poyao Huang, Yuntian Deng, Yingkai Gao, and Eric Xing. 2015. Entity Hierarchy Embedding. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 129… [find](https://scholar.google.com/scholar?q=Zhiting+Hu%2C+Poyao+Huang%2C+Yuntian+Deng%2C+Yingkai+Gao%2C+and+Eric+Xing%2E+2015%2E+Entity+Hierarchy+Embedding%2E+In+Proceedings+of+the+53rd+Annual+Meeting+of+the+Association+for+Computational+Linguistics+and+the+)
15. Mohit Iyyer, Jordan Boyd-Graber, Leonardo Claudino, Richard Socher, and Hal Daumé III. 2014. A Neural Network for Factoid Question Answering over Paragraphs. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pages 633–644. [find](https://scholar.google.com/scholar?q=Mohit+Iyyer%2C+Jordan+Boyd%2DGraber%2C+Leonardo+Claudino%2C+Richard+Socher%2C+and+Hal+Daume%CC%81+III%2E+2014%2E+A+Neural+Network+for+Factoid+Question+Answering+over+Paragraphs%2E+In+Proceedings+of+the+2014+Conference+on+)
16. Mohit Iyyer, Varun Manjunatha, Jordan Boyd-Graber, and Hal Daumé III. 2015. [Deep Unordered Composition Rivals Syntactic Methods for Text Classification](https://md.research.elamur.ai/free/en/papers/iyyer-2015-deep-unordered-composition-rivals-syntactic/). In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural L…
17. Heng Ji, Ralph Grishman, Hoa Trang Dang, Kira Griffitt, and Joe Ellis. 2010. Overview of the TAC 2010 Knowledge Base Population Track. In Proceeding of Text Analytics Conference. [find](https://scholar.google.com/scholar?q=Heng+Ji%2C+Ralph+Grishman%2C+Hoa+Trang+Dang%2C+Kira+Griffitt%2C+and+Joe+Ellis%2E+2010%2E+Overview+of+the+TAC+2010+Knowledge+Base+Population+Track%2E+In+Proceeding+of+Text+Analytics+Conference%2E)
18. Tom Kenter, Alexey Borisov, and Maarten de Rijke. 2016. Siamese CBOW: Optimizing Word Embeddings for Sentence Representations. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 941–951. [find](https://scholar.google.com/scholar?q=Tom+Kenter%2C+Alexey+Borisov%2C+and+Maarten+de+Rijke%2E+2016%2E+Siamese+CBOW%3A+Optimizing+Word+Embeddings+for+Sentence+Representations%2E+In+Proceedings+of+the+54th+Annual+Meeting+of+the+Association+for+Computat)
19. Ryan Kiros, Yukun Zhu, Ruslan R Salakhutdinov, Richard Zemel, Raquel Urtasun, Antonio Torralba, and Sanja Fidler. 2015. Skip-Thought Vectors. In Advances in Neural Information Processing Systems 28, pages 3294–3302. [find](https://scholar.google.com/scholar?q=Ryan+Kiros%2C+Yukun+Zhu%2C+Ruslan+R+Salakhutdinov%2C+Richard+Zemel%2C+Raquel+Urtasun%2C+Antonio+Torralba%2C+and+Sanja+Fidler%2E+2015%2E+Skip%2DThought+Vectors%2E+In+Advances+in+Neural+Information+Processing+Systems+28%2C+p)
20. Quoc V. Le and Tomas Mikolov. 2014. [Distributed Representations of Sentences and Documents](https://md.research.elamur.ai/free/en/papers/le-2014-distributed-representations-sentences-documents/). In Proceedings of the 31st International Conference on Machine Learning (Volume 32), pages 1188–1196.
21. Omer Levy and Yoav Goldberg. 2014. Dependency-Based Word Embeddings. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 302–308. [find](https://scholar.google.com/scholar?q=Omer+Levy+and+Yoav+Goldberg%2E+2014%2E+Dependency%2DBased+Word+Embeddings%2E+In+Proceedings+of+the+52nd+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+2%3A+Short+Papers%29%2C+pages+302%E2%80%93308%2E)
22. Jiwei Li, Thang Luong, and Dan Jurafsky. 2015. A Hierarchical Neural Autoencoder for Paragraphs and Documents. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers),… [find](https://scholar.google.com/scholar?q=Jiwei+Li%2C+Thang+Luong%2C+and+Dan+Jurafsky%2E+2015%2E+A+Hierarchical+Neural+Autoencoder+for+Paragraphs+and+Documents%2E+In+Proceedings+of+the+53rd+Annual+Meeting+of+the+Association+for+Computational+Linguistic)
23. Yuezhang Li, Ronghuo Zheng, Tian Tian, Zhiting Hu, Rahul Iyer, and Katia Sycara. 2016. Joint Embedding of Hierarchical Categories and Entities for Concept Categorization and Dataless Classification. In Proceedings of the 26th International Conference on Computational Linguistics, pages 2678–2688. [find](https://scholar.google.com/scholar?q=Yuezhang+Li%2C+Ronghuo+Zheng%2C+Tian+Tian%2C+Zhiting+Hu%2C+Rahul+Iyer%2C+and+Katia+Sycara%2E+2016%2E+Joint+Embedding+of+Hierarchical+Categories+and+Entities+for+Concept+Categorization+and+Dataless+Classification%2E+I)
24. Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning Entity and Relation Embeddings for Knowledge Graph Completion. In Proceedings of the 29th AAAI Conference on Artificial Intelligence, pages 2181–2187. [find](https://scholar.google.com/scholar?q=Yankai+Lin%2C+Zhiyuan+Liu%2C+Maosong+Sun%2C+Yang+Liu%2C+and+Xuan+Zhu%2E+2015%2E+Learning+Entity+and+Relation+Embeddings+for+Knowledge+Graph+Completion%2E+In+Proceedings+of+the+29th+AAAI+Conference+on+Artificial+Int)
25. Xiao Ling, Sameer Singh, and Daniel S. Weld. 2015. Design Challenges for Entity Linking. Transactions of the Association for Computational Linguistics, 3:315– 328. [find](https://scholar.google.com/scholar?q=Xiao+Ling%2C+Sameer+Singh%2C+and+Daniel+S%2E+Weld%2E+2015%2E+Design+Challenges+for+Entity+Linking%2E+Transactions+of+the+Association+for+Computational+Linguistics%2C+3%3A315%E2%80%93+328%2E)
26. Yi Luan, Yangfeng Ji, Hannaneh Hajishirzi, and Boyang Li. 2016. Multiplicative Representations for Unsupervised Semantic Role Induction. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 118–123. [find](https://scholar.google.com/scholar?q=Yi+Luan%2C+Yangfeng+Ji%2C+Hannaneh+Hajishirzi%2C+and+Boyang+Li%2E+2016%2E+Multiplicative+Representations+for+Unsupervised+Semantic+Role+Induction%2E+In+Proceedings+of+the+54th+Annual+Meeting+of+the+Association+fo)
27. Marco Marelli, Stefano Menini, Marco Baroni, Luisa Bentivogli, Raffaella Bernardi, and Roberto Zamparelli. 2014. [A SICK Cure for the Evaluation of Compositional Distributional Semantic Models](https://md.research.elamur.ai/free/en/papers/marelli-2014-sick-cure-evaluation-compositional-distributional/). In Proceedings of the Ninth International Conference on Language Resources and Evaluation, pages 216–223.
28. Edgar Meij, Wouter Weerkamp, and Maarten de Rijke. 2012. Adding Semantics to Microblog Posts. In Proceedings of the Fifth ACM International Conference on Web Search and Data Mining, pages 563–572. [find](https://scholar.google.com/scholar?q=Edgar+Meij%2C+Wouter+Weerkamp%2C+and+Maarten+de+Rijke%2E+2012%2E+Adding+Semantics+to+Microblog+Posts%2E+In+Proceedings+of+the+Fifth+ACM+International+Conference+on+Web+Search+and+Data+Mining%2C+pages+563%E2%80%93572%2E)
29. Rada Mihalcea and Andras Csomai. 2007. Wikify!: Linking Documents to Encyclopedic Knowledge. In Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, pages 233– 242. [find](https://scholar.google.com/scholar?q=Rada+Mihalcea+and+Andras+Csomai%2E+2007%2E+Wikify%21%3A+Linking+Documents+to+Encyclopedic+Knowledge%2E+In+Proceedings+of+the+Sixteenth+ACM+Conference+on+Information+and+Knowledge+Management%2C+pages+233%E2%80%93+242%2E)
30. Tomas Mikolov, Greg Corrado, Kai Chen, and Jeffrey Dean. 2013a. [Efficient Estimation of Word Representations in Vector Space](https://md.research.elamur.ai/free/en/papers/mikolov-2013-efficient-estimation-word-representations-vector/). In Proceedings of the International Conference on Learning Representations, pages 1–12.
31. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S. Corrado, and Jeff Dean. 2013b. [Distributed Representations of Words and Phrases and their Compositionality](https://md.research.elamur.ai/free/en/papers/mikolov-2013-distributed-representations-words-phrases-their/). In Advances in Neural Information Processing Systems 26, pages 3111–3119.
32. David Milne and Ian H. Witten. 2008. Learning to Link with Wikipedia. In Proceeding of the 17th ACM Conference on Information and Knowledge Management, pages 509–518. [find](https://scholar.google.com/scholar?q=David+Milne+and+Ian+H%2E+Witten%2E+2008%2E+Learning+to+Link+with+Wikipedia%2E+In+Proceeding+of+the+17th+ACM+Conference+on+Information+and+Knowledge+Management%2C+pages+509%E2%80%93518%2E)
33. Jeff Mitchell and Mirella Lapata. 2008. Vector-based Models of Semantic Composition. In Proceedings of ACL-08: HLT, pages 236–244. [find](https://scholar.google.com/scholar?q=Jeff+Mitchell+and+Mirella+Lapata%2E+2008%2E+Vector%2Dbased+Models+of+Semantic+Composition%2E+In+Proceedings+of+ACL%2D08%3A+HLT%2C+pages+236%E2%80%93244%2E)
34. Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. [GloVe: Global Vectors for Word Representation](https://md.research.elamur.ai/free/en/papers/pennington-2014-glove-global-vectors-word-representation/). In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pages 1532–1543.
35. Maria Pershina, Yifan He, and Ralph Grishman. 2015. Personalized Page Rank for Named Entity Disambiguation. In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 238–243. [find](https://scholar.google.com/scholar?q=Maria+Pershina%2C+Yifan+He%2C+and+Ralph+Grishman%2E+2015%2E+Personalized+Page+Rank+for+Named+Entity+Disambiguation%2E+In+Proceedings+of+the+2015+Conference+of+the+North+American+Chapter+of+the+Association+for+C)
36. Lev Ratinov, Dan Roth, Doug Downey, and Mike Anderson. 2011. Local and Global Algorithms for Disambiguation to Wikipedia. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 1375–1384. [find](https://scholar.google.com/scholar?q=Lev+Ratinov%2C+Dan+Roth%2C+Doug+Downey%2C+and+Mike+Anderson%2E+2011%2E+Local+and+Global+Algorithms+for+Disambiguation+to+Wikipedia%2E+In+Proceedings+of+the+49th+Annual+Meeting+of+the+Association+for+Computational)
37. Sebastian Riedel, Limin Yao, Andrew McCallum, and Benjamin M Marlin. 2013. Relation Extraction with Matrix Factorization and Universal Schemas. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 74–… [find](https://scholar.google.com/scholar?q=Sebastian+Riedel%2C+Limin+Yao%2C+Andrew+McCallum%2C+and+Benjamin+M+Marlin%2E+2013%2E+Relation+Extraction+with+Matrix+Factorization+and+Universal+Schemas%2E+In+Proceedings+of+the+2013+Conference+of+the+North+Ameri)
38. Sameer Singh, Amarnag Subramanya, Fernando Pereira, and Andrew McCallum. 2012. Wikilinks: A Large-scale Cross-Document Coreference Corpus Labeled via Links to Wikipedia. Technical Report UM-CS-2012-015. [find](https://scholar.google.com/scholar?q=Sameer+Singh%2C+Amarnag+Subramanya%2C+Fernando+Pereira%2C+and+Andrew+McCallum%2E+2012%2E+Wikilinks%3A+A+Large%2Dscale+Cross%2DDocument+Coreference+Corpus+Labeled+via+Links+to+Wikipedia%2E+Technical+Report+UM%2DCS%2D2012%2D01)
39. Theano Development Team. 2016. [Theano: A Python Framework for Fast Computation of Mathematical Expressions](https://md.research.elamur.ai/free/en/papers/the-theano-development-team-2016-theano-python-framework-fast-computation/). arXiv preprint arXiv:1605.02688v1.
40. Tijmen Tieleman and Geoffrey Hinton. 2012. Lecture 6.5 - RMSProp, COURSERA: Neural Networks for Machine Learning. Technical report. [find](https://scholar.google.com/scholar?q=Tijmen+Tieleman+and+Geoffrey+Hinton%2E+2012%2E+Lecture+6%2E5+%2D+RMSProp%2C+COURSERA%3A+Neural+Networks+for+Machine+Learning%2E+Technical+report%2E)
41. Kristina Toutanova, Danqi Chen, Patrick Pantel, Hoifung Poon, Pallavi Choudhury, and Michael Gamon. 2015. [Representing Text for Joint Embedding of Text and Knowledge Bases](https://md.research.elamur.ai/free/en/papers/toutanova-2015-representing-text-joint-embedding-text/). In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 1499–1509.
42. Patrick Verga, David Belanger, Emma Strubell, Benjamin Roth, and Andrew McCallum. 2016. Multilingual Relation Extraction using Compositional Universal Schema. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolo… [find](https://scholar.google.com/scholar?q=Patrick+Verga%2C+David+Belanger%2C+Emma+Strubell%2C+Benjamin+Roth%2C+and+Andrew+McCallum%2E+2016%2E+Multilingual+Relation+Extraction+using+Compositional+Universal+Schema%2E+In+Proceedings+of+the+2016+Conference+of+)
43. Zhen Wang, Jianwen Zhang, Jianlin Feng, and Zheng Chen. 2014. [Knowledge Graph and Text Jointly Embedding](https://md.research.elamur.ai/free/en/papers/wang-2014-knowledge-graph-text-jointly-embedding/). In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pages 1591–1601.
44. John Wieting, Mohit Bansal, Kevin Gimpel, and Karen Livescu. 2016. [Towards Universal Paraphrastic Sentence Embeddings](https://md.research.elamur.ai/free/en/papers/wieting-2015-towards-universal-paraphrastic-sentence-embeddings/). In Proceedings of the 2016 International Conference on Learning Representations.
45. Dong Xu and Wu-Jun Li. 2016. Full-Time Supervision based Bidirectional RNN for Factoid Question Answering. arXiv preprint arXiv:1606.05854v2. — [arXiv:1606.05854](https://arxiv.org/abs/1606.05854) [find](https://scholar.google.com/scholar?q=Dong+Xu+and+Wu%2DJun+Li%2E+2016%2E+Full%2DTime+Supervision+based+Bidirectional+RNN+for+Factoid+Question+Answering%2E+arXiv+preprint+arXiv%3A1606%2E05854v2%2E+%E2%80%94+%5BarXiv%3A1606%2E05854%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1606%2E05854%29)
46. Ikuya Yamada, Hiroyuki Shindo, Hideaki Takeda, and Yoshiyasu Takefuji. 2016. [Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguation](https://md.research.elamur.ai/free/en/papers/yamada-2016-joint-learning-embedding-words-entities/). In Proceedings of the 20th SIGNLL Conference on Computational Natural Language Learning, pages 250–259.

*Updated 30 October 2026*