---
title: "Compositional Vector Space Models for Knowledge Base Completion — Neelakantan 2015"
description: "The paper addresses knowledge base completion (KB completion), that is, automatically inferring missing triple… 48 references, cited by 51 papers here."
authors: ["Arvind Neelakantan", "Benjamin Roth", "Andrew McCallum"]
year: 2015
venue: "Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)"
source: "https://aclanthology.org/P15-1016/"
doi: "10.3115/v1/p15-1016"
arxiv: "1504.06662"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/neelakantan-2015-compositional-vector-space-models-knowledge/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/neelakantan-2015-compositional-vector-space-models-knowledge/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2015](https://md.research.elamur.ai/free/en/papers/2015/page/2/) / Compositional Vector Space Models for Knowledge Base Completion

# Compositional Vector Space Models for Knowledge Base Completion

**Authors:** [Arvind Neelakantan](https://md.research.elamur.ai/free/en/authors/arvind-neelakantan/), Benjamin Roth and [Andrew McCallum](https://md.research.elamur.ai/free/en/authors/andrew-mccallum/) · **Year:** 2015 · **Venue:** Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/P15-1016/) · [PDF](https://aclanthology.org/P15-1016.pdf) · [DOI 10.3115/v1/p15-1016](https://doi.org/10.3115/v1/p15-1016) · [arXiv 1504.06662](https://arxiv.org/abs/1504.06662)

**Citations:** [51](https://md.research.elamur.ai/free/en/papers/neelakantan-2015-compositional-vector-space-models-knowledge/cited-by/) in our library, of the 140,884 papers whose bibliographies we read

## Summary
The paper addresses knowledge base completion (KB completion), that is, automatically inferring missing triple facts from those already present in the graph. Earlier methods, notably the Path Ranking Algorithm (PRA), treated each multi-step path between two entities as a separate, atomic feature. As a result, the number of features grew sharply, and the model could not generalize to new paths. The authors propose a compositional approach. A recurrent neural network (RNN) combines the vector representations of the relations along a path step by step, and the resulting vector is compared with the vector of the target relation. For each entity pair, the model takes the highest-scoring path. It can therefore handle paths it did not see during training. Moreover, a single shared RNN can predict even entirely new relation types (zero-shot). For evaluation, the authors assembled a large dataset of more than 52 million triples based on Freebase and ClueWeb. Their model outperforms PRA by 11% and Cluster PRA by 7%. Combined with a new strong baseline classifier, the result is even better. The work shows that vector composition makes it possible to scale reasoning over large knowledge graphs.

## Key points
- **Data:** a new open dataset with more than 52 million triples. It was built from Freebase and Google entity linking in ClueWeb. It contains 46 relation types, more than 2 million paths per relation (Gardner had about 1000), and more than 10 thousand entity pairs (Gardner had about 200).
- **Method:** paths between entities are found using PRA. An RNN then recursively computes the path vector from the relation vectors. In the main experiments, a separate composition matrix is trained for each target relation.
- **Results:** the RNN surpasses PRA by 11%, and its margin over Cluster PRA (Gardner et al., 2013) is 7%. The new baseline PRA Classifier-b, which uses path bigram features, performs statistically on par with the RNN. Combining these two methods yields a 15% gain over Cluster PRA.
- **Zero-shot:** the authors took 10 random relations out of the 46 and split them into two halves. A model trained on one half predicts the relations in the other. It is noticeably weaker than the fully supervised RNN but clearly better than a random ranking of facts.
- **Ensemble:** individual RNNs with different random initializations score about 57 (57.09, 57.11 and 56.91). Their ensemble achieves 59.16, and the result stops improving after three models.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [AI & machine learning](https://md.research.elamur.ai/free/en/shelves/ai/)

Topics: [🕸️ Knowledge graphs & ontologies](https://md.research.elamur.ai/free/en/topics/knowledge-graphs/)

## Cite

Cite as: Arvind Neelakantan, Benjamin Roth and Andrew McCallum. 2015. Compositional Vector Space Models for Knowledge Base Completion. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{neelakantan2015compositional,
  title = {{Compositional Vector Space Models for Knowledge Base Completion}},
  author = {Arvind Neelakantan, Benjamin Roth and Andrew McCallum},
  booktitle = {Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)},
  year = {2015},
  doi = {10.3115/v1/p15-1016},
  eprint = {1504.06662},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.3115/v1/p15-1016}
}
```

- [← previous Transition-Based Syntactic Linearization](https://md.research.elamur.ai/free/en/papers/liu-2015-transition-based-syntactic-linearization/)
- [next → Closing the Gap: Domain Adaptation from Explicit to Implicit Discourse Relations](https://md.research.elamur.ai/free/en/papers/ji-2015-closing-gap-domain-adaptation-explicit/)
- [↑ back to papers of 2015](https://md.research.elamur.ai/free/en/papers/2015/page/2/)

## References

48 references, 8 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. In ArXiv. [our card](https://md.research.elamur.ai/free/en/papers/bahdanau-2014-neural-machine-translation-jointly-learning/)
2. Michele Banko, Michael J Cafarella, Stephen Soderland, Matt Broadhead, and Oren Etzioni. 2007. Open information extraction from the web. In International Joint Conference on Artificial Intelligence. [our card](https://md.research.elamur.ai/free/en/papers/banko-2007-open-information-extraction-web/)
3. Marco Baroni and Roberto Zamparelli. 2010. Nouns are vectors, adjectives are matrices: Representing adjective-noun constructions in semantic space. In Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Marco+Baroni+and+Roberto+Zamparelli%2E+2010%2E+Nouns+are+vectors%2C+adjectives+are+matrices%3A+Representing+adjective%2Dnoun+constructions+in+semantic+space%2E+In+Empirical+Methods+in+Natural+Language+Processing%2E)
4. Jonathan Berant, Ido Dagan, and Jacob Goldberger. 2011. Global learning of typed entailment rules. In Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jonathan+Berant%2C+Ido+Dagan%2C+and+Jacob+Goldberger%2E+2011%2E+Global+learning+of+typed+entailment+rules%2E+In+Association+for+Computational+Linguistics%2E)
5. Kurt Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor. 2008. Freebase: a collaboratively created graph database for structuring human knowledge. In Proceedings of the ACM SIG-MOD International Conference on Management of Data. [find](https://scholar.google.com/scholar?q=Kurt+Bollacker%2C+Colin+Evans%2C+Praveen+Paritosh%2C+Tim+Sturge%2C+and+Jamie+Taylor%2E+2008%2E+Freebase%3A+a+collaboratively+created+graph+database+for+structuring+human+knowledge%2E+In+Proceedings+of+the+ACM+SIG%2DMOD)
6. Antoine Bordes, Nicolas Usunier, Alberto Garcı́a-Durán, Jason Weston, and Oksana Yakhnenko. 2013. Translating embeddings for modeling multi-relational data. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Antoine+Bordes%2C+Nicolas+Usunier%2C+Alberto+Garc%C4%B1%CC%81a%2DDura%CC%81n%2C+Jason+Weston%2C+and+Oksana+Yakhnenko%2E+2013%2E+Translating+embeddings+for+modeling+multi%2Drelational+data%2E+In+Advances+in+Neural+Information+Processi)
7. Samuel R. Bowman, Christopher Potts, and Christopher D Manning. 2014. Recursive neural networks for learning logical semantics. In CoRR. [find](https://scholar.google.com/scholar?q=Samuel+R%2E+Bowman%2C+Christopher+Potts%2C+and+Christopher+D+Manning%2E+2014%2E+Recursive+neural+networks+for+learning+logical+semantics%2E+In+CoRR%2E)
8. Andrew Carlson, Justin Betteridge, Bryan Kisiel, Burr Settles, Estevam R. Hruschka, and A. 2010. Toward an architecture for never-ending language learning. In In AAAI. [find](https://scholar.google.com/scholar?q=Andrew+Carlson%2C+Justin+Betteridge%2C+Bryan+Kisiel%2C+Burr+Settles%2C+Estevam+R%2E+Hruschka%2C+and+A%2E+2010%2E+Toward+an+architecture+for+never%2Dending+language+learning%2E+In+In+AAAI%2E)
9. Cheng, Jianpeng Kartsaklis, and Edward Grefenstette. 2014. Investigating the role of prior disambiguation in deep-learning compositional models of meaning. In In Learning Semantics workshop NIPS. [find](https://scholar.google.com/scholar?q=Cheng%2C+Jianpeng+Kartsaklis%2C+and+Edward+Grefenstette%2E+2014%2E+Investigating+the+role+of+prior+disambiguation+in+deep%2Dlearning+compositional+models+of+meaning%2E+In+In+Learning+Semantics+workshop+NIPS%2E)
10. Kyunghyun Cho, Bart van Merrienboer, Dzmitry Bahdanau, and Yoshua Bengio. 2014. On the properties of neural machine translation: Encoder–decoder approaches. In Workshop on Syntax, Semantics and Structure in Statistical Translation. [our card](https://md.research.elamur.ai/free/en/papers/cho-2014-properties-neural-machine-translation-encoder/)
11. John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. In Journal of Machine Learning Research. [find](https://scholar.google.com/scholar?q=John+Duchi%2C+Elad+Hazan%2C+and+Yoram+Singer%2E+2011%2E+Adaptive+subgradient+methods+for+online+learning+and+stochastic+optimization%2E+In+Journal+of+Machine+Learning+Research%2E)
12. Andrea Frome, Gregory S. Corrado, Jonathon Shlens, Samy Bengio, Jeffrey Dean, Marc’Aurelio Ranzato, and Tomas Mikolov. 2013. Devise: A deep visual-semantic embedding model. In Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Andrea+Frome%2C+Gregory+S%2E+Corrado%2C+Jonathon+Shlens%2C+Samy+Bengio%2C+Jeffrey+Dean%2C+Marc%E2%80%99Aurelio+Ranzato%2C+and+Tomas+Mikolov%2E+2013%2E+Devise%3A+A+deep+visual%2Dsemantic+embedding+model%2E+In+Neural+Information+Proce)
13. Matt Gardner, Partha Pratim Talukdar, Bryan Kisiel, and Tom M. Mitchell. 2013. Improving learning and inference in a large knowledge-base using latent syntactic cues. In Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Matt+Gardner%2C+Partha+Pratim+Talukdar%2C+Bryan+Kisiel%2C+and+Tom+M%2E+Mitchell%2E+2013%2E+Improving+learning+and+inference+in+a+large+knowledge%2Dbase+using+latent+syntactic+cues%2E+In+Empirical+Methods+in+Natural+L)
14. Matt Gardner, Partha Talukdar, Jayant Krishnamurthy, and Tom Mitchell. 2014. Incorporating vector space similarity in random walk inference over knowledge bases. In Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Matt+Gardner%2C+Partha+Talukdar%2C+Jayant+Krishnamurthy%2C+and+Tom+Mitchell%2E+2014%2E+Incorporating+vector+space+similarity+in+random+walk+inference+over+knowledge+bases%2E+In+Empirical+Methods+in+Natural+Langua)
15. Christoph Goller and Andreas Küchler. 1996. Learning task-dependent distributed representations by backpropagation through structure. In IEEE Transactions on Neural Networks. [find](https://scholar.google.com/scholar?q=Christoph+Goller+and+Andreas+Ku%CC%88chler%2E+1996%2E+Learning+task%2Ddependent+distributed+representations+by+backpropagation+through+structure%2E+In+IEEE+Transactions+on+Neural+Networks%2E)
16. Alex Graves. 2013. Generating sequences with recurrent neural networks. In ArXiv. [find](https://scholar.google.com/scholar?q=Alex+Graves%2E+2013%2E+Generating+sequences+with+recurrent+neural+networks%2E+In+ArXiv%2E)
17. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. In Neural Computation. [find](https://scholar.google.com/scholar?q=Sepp+Hochreiter+and+Ju%CC%88rgen+Schmidhuber%2E+1997%2E+Long+short%2Dterm+memory%2E+In+Neural+Computation%2E)
18. Ozan Irsoy and Claire Cardie. 2014. Deep recursive neural networks for compositionality in language. In Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Ozan+Irsoy+and+Claire+Cardie%2E+2014%2E+Deep+recursive+neural+networks+for+compositionality+in+language%2E+In+Neural+Information+Processing+Systems%2E)
19. Mohit Iyyer, Jordan Boyd-Graber, Leonardo Claudino, Richard Socher, and Hal Daumé III. 2014. A neural network for factoid question answering over paragraphs. In Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Mohit+Iyyer%2C+Jordan+Boyd%2DGraber%2C+Leonardo+Claudino%2C+Richard+Socher%2C+and+Hal+Daume%CC%81+III%2E+2014%2E+A+neural+network+for+factoid+question+answering+over+paragraphs%2E+In+Empirical+Methods+in+Natural+Language+)
20. Ni Lao, Tom Mitchell, and William W. Cohen. 2011. Random walk inference and learning in a large scale knowledge base. In Conference on Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Ni+Lao%2C+Tom+Mitchell%2C+and+William+W%2E+Cohen%2E+2011%2E+Random+walk+inference+and+learning+in+a+large+scale+knowledge+base%2E+In+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2E)
21. Ni Lao, Amarnag Subramanya, Fernando Pereira, and William W. Cohen. 2012. Reading the web with learned syntactic-semantic inference rules. In Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. [find](https://scholar.google.com/scholar?q=Ni+Lao%2C+Amarnag+Subramanya%2C+Fernando+Pereira%2C+and+William+W%2E+Cohen%2E+2012%2E+Reading+the+web+with+learned+syntactic%2Dsemantic+inference+rules%2E+In+Joint+Conference+on+Empirical+Methods+in+Natural+Language+)
22. Hugo Larochelle, Dumitru Erhan, and Yoshua Bengio. 2008. Zero-data learning of new tasks. In National Conference on Artificial Intelligence. [find](https://scholar.google.com/scholar?q=Hugo+Larochelle%2C+Dumitru+Erhan%2C+and+Yoshua+Bengio%2E+2008%2E+Zero%2Ddata+learning+of+new+tasks%2E+In+National+Conference+on+Artificial+Intelligence%2E)
23. Dekang Lin and Patrick Pantel. 2001. Dirt - discovery of inference rules from text. In International Conference on Knowledge Discovery and Data Mining. [find](https://scholar.google.com/scholar?q=Dekang+Lin+and+Patrick+Pantel%2E+2001%2E+Dirt+%2D+discovery+of+inference+rules+from+text%2E+In+International+Conference+on+Knowledge+Discovery+and+Data+Mining%2E)
24. Tomas Mikolov, Martin Karafiát, Lukas Burget, Jan Cernocký, and Sanjeev Khudanpur. 2010. Recurrent neural network based language model. In Annual Conference of the International Speech Communication Association. [find](https://scholar.google.com/scholar?q=Tomas+Mikolov%2C+Martin+Karafia%CC%81t%2C+Lukas+Burget%2C+Jan+Cernocky%CC%81%2C+and+Sanjeev+Khudanpur%2E+2010%2E+Recurrent+neural+network+based+language+model%2E+In+Annual+Conference+of+the+International+Speech+Communication)
25. Tomas Mikolov, Armand Joulin, Sumit Chopra, Michaël Mathieu, and Marc’Aurelio Ranzato. 2014. Learning longer memory in recurrent neural networks. In CoRR. [find](https://scholar.google.com/scholar?q=Tomas+Mikolov%2C+Armand+Joulin%2C+Sumit+Chopra%2C+Michae%CC%88l+Mathieu%2C+and+Marc%E2%80%99Aurelio+Ranzato%2E+2014%2E+Learning+longer+memory+in+recurrent+neural+networks%2E+In+CoRR%2E)
26. Bonan Min, Ralph Grishman, Li Wan, Chang Wang, and David Gondek. 2013. Distant supervision for relation extraction with an incomplete knowledge base. In HLT-NAACL, pages 777–782. [our card](https://md.research.elamur.ai/free/en/papers/min-2013-distant-supervision-relation-extraction-incomplete/)
27. Mike Mintz, Steven Bills, Rion Snow, and Dan Jurafsky. 2009. Distant supervision for relation extraction without labeled data. In Association for Computational Linguistics and International Joint Conference on Natural Language Processing. [find](https://scholar.google.com/scholar?q=Mike+Mintz%2C+Steven+Bills%2C+Rion+Snow%2C+and+Dan+Jurafsky%2E+2009%2E+Distant+supervision+for+relation+extraction+without+labeled+data%2E+In+Association+for+Computational+Linguistics+and+International+Joint+Conf)
28. Jeff Mitchell and Mirella Lapata. 2008. Vector-based models of semantic composition. In Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jeff+Mitchell+and+Mirella+Lapata%2E+2008%2E+Vector%2Dbased+models+of+semantic+composition%2E+In+Association+for+Computational+Linguistics%2E)
29. Arvind Neelakantan, Jeevan Shankar, Alexandre Passos, and Andrew McCallum. 2014. Efficient non-parametric estimation of multiple embeddings per word in vector space. In Empirical Methods in Natural Language Processing. [our card](https://md.research.elamur.ai/free/en/papers/neelakantan-2014-efficient-non-parametric-estimation-multiple/)
30. Maximilian Nickel, Volker Tresp, and Hans-Peter Kriegel. 2011. A three-way model for collective learning on multi-relational data. In International Conference on Machine Learning. [find](https://scholar.google.com/scholar?q=Maximilian+Nickel%2C+Volker+Tresp%2C+and+Hans%2DPeter+Kriegel%2E+2011%2E+A+three%2Dway+model+for+collective+learning+on+multi%2Drelational+data%2E+In+International+Conference+on+Machine+Learning%2E)
31. Mohammad Norouzi, Tomas Mikolov, Samy Bengio, Yoram Singer, Jonathon Shlens, Andrea Frome, Greg Corrado, and Jeffrey Dean. 2014. Zero-shot learning by convex combination of semantic embeddings. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Mohammad+Norouzi%2C+Tomas+Mikolov%2C+Samy+Bengio%2C+Yoram+Singer%2C+Jonathon+Shlens%2C+Andrea+Frome%2C+Greg+Corrado%2C+and+Jeffrey+Dean%2E+2014%2E+Zero%2Dshot+learning+by+convex+combination+of+semantic+embeddings%2E+In+Int)
32. Dave Orr, Amarnag Subramanya, Evgeniy Gabrilovich, and Michael Ringgaard. 2013. 11 billion clues in 800 million documents: A web research corpus annotated with freebase concepts. [http://googleresearch.blogspot.com/2013/07/11-billion-clues-in-800-million.html](http://googleresearch.blogspot.com/2013/07/11-billion-clues-in-800-million.html). [↗](http://googleresearch.blogspot.com/2013/07/11-billion-clues-in-800-million.html)
33. Mark Palatucci, Dean Pomerleau, Geoffrey Hinton, and Tom Mitchell. 2009. Zero-shot learning with semantic output codes. In Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Mark+Palatucci%2C+Dean+Pomerleau%2C+Geoffrey+Hinton%2C+and+Tom+Mitchell%2E+2009%2E+Zero%2Dshot+learning+with+semantic+output+codes%2E+In+Neural+Information+Processing+Systems%2E)
34. Sebastian Riedel, Limin Yao, Andrew McCallum, and Benjamin M. Marlin. 2013. Relation extraction with matrix factorization and universal schemas. In HLT-NAACL. [find](https://scholar.google.com/scholar?q=Sebastian+Riedel%2C+Limin+Yao%2C+Andrew+McCallum%2C+and+Benjamin+M%2E+Marlin%2E+2013%2E+Relation+extraction+with+matrix+factorization+and+universal+schemas%2E+In+HLT%2DNAACL%2E)
35. Stefan Schoenmackers, Oren Etzioni, Daniel S. Weld, and Jesse Davis. 2010. Learning first-order horn clauses from web text. In Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Stefan+Schoenmackers%2C+Oren+Etzioni%2C+Daniel+S%2E+Weld%2C+and+Jesse+Davis%2E+2010%2E+Learning+first%2Dorder+horn+clauses+from+web+text%2E+In+Empirical+Methods+in+Natural+Language+Processing%2E)
36. Richard Socher, Cliff Chiung-Yu Lin, Christopher D. Manning, and Andrew Y. Ng. 2011. Parsing natural scenes and natural language with recursive neural networks. In Proceedings of the 26th International Conference on Machine Learning (ICML). [find](https://scholar.google.com/scholar?q=Richard+Socher%2C+Cliff+Chiung%2DYu+Lin%2C+Christopher+D%2E+Manning%2C+and+Andrew+Y%2E+Ng%2E+2011%2E+Parsing+natural+scenes+and+natural+language+with+recursive+neural+networks%2E+In+Proceedings+of+the+26th+Internationa)
37. Richard Socher, Brody Huval, Christopher D. Manning, and Andrew Y. Ng. 2012. Semantic compositionality through recursive matrix-vector spaces. In Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. [our card](https://md.research.elamur.ai/free/en/papers/socher-2012-semantic-compositionality-through-recursive-matrix/)
38. Richard Socher, Danqi Chen, Christopher D Manning, and Andrew Ng. 2013a. Reasoning with neural tensor networks for knowledge base completion. In Advances in Neural Information Processing Systems. [our card](https://md.research.elamur.ai/free/en/papers/socher-2013-reasoning-neural-tensor-networks-knowledge/)
39. Richard Socher, Milind Ganjoo, Christopher D Manning, and Andrew Ng. 2013b. Zero-shot learning through cross-modal transfer. In Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Richard+Socher%2C+Milind+Ganjoo%2C+Christopher+D+Manning%2C+and+Andrew+Ng%2E+2013b%2E+Zero%2Dshot+learning+through+cross%2Dmodal+transfer%2E+In+Neural+Information+Processing+Systems%2E)
40. Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng, and Christopher Potts. 2013c. Recursive deep models for semantic compositionality over a sentiment treebank. In Conference on Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Richard+Socher%2C+Alex+Perelygin%2C+Jean+Wu%2C+Jason+Chuang%2C+Christopher+D%2E+Manning%2C+Andrew+Y%2E+Ng%2C+and+Christopher+Potts%2E+2013c%2E+Recursive+deep+models+for+semantic+compositionality+over+a+sentiment+treebank)
41. Fabian M. Suchanek, Gjergji Kasneci, and Gerhard Weikum. 2007. Yago: A core of semantic knowledge. In Proceedings of the 16th International Conference on World Wide Web. [find](https://scholar.google.com/scholar?q=Fabian+M%2E+Suchanek%2C+Gjergji+Kasneci%2C+and+Gerhard+Weikum%2E+2007%2E+Yago%3A+A+core+of+semantic+knowledge%2E+In+Proceedings+of+the+16th+International+Conference+on+World+Wide+Web%2E)
42. Ilya Sutskever, Oriol Vinyals, and Quoc V. V Le. 2014. Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Ilya+Sutskever%2C+Oriol+Vinyals%2C+and+Quoc+V%2E+V+Le%2E+2014%2E+Sequence+to+sequence+learning+with+neural+networks%2E+In+Advances+in+Neural+Information+Processing+Systems%2E)
43. Oriol Vinyals, Lukasz Kaiser, Terry Koo, Slav Petrov, Ilya Sutskever, and Geoffrey Hinton. 2014. Grammar as a foreign language. In CoRR. [find](https://scholar.google.com/scholar?q=Oriol+Vinyals%2C+Lukasz+Kaiser%2C+Terry+Koo%2C+Slav+Petrov%2C+Ilya+Sutskever%2C+and+Geoffrey+Hinton%2E+2014%2E+Grammar+as+a+foreign+language%2E+In+CoRR%2E)
44. Paul Werbos. 1990. Backpropagation through time: what it does and how to do it. In IEEE. [find](https://scholar.google.com/scholar?q=Paul+Werbos%2E+1990%2E+Backpropagation+through+time%3A+what+it+does+and+how+to+do+it%2E+In+IEEE%2E)
45. Jason Weston, Ron Weiss, and Hector Yee. 2013. Nonlinear latent factorization by embedding multiple user interests. In ACM International Conference on Recommender Systems. [find](https://scholar.google.com/scholar?q=Jason+Weston%2C+Ron+Weiss%2C+and+Hector+Yee%2E+2013%2E+Nonlinear+latent+factorization+by+embedding+multiple+user+interests%2E+In+ACM+International+Conference+on+Recommender+Systems%2E)
46. Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2014. Embedding entities and relations for learning and inference in knowledge bases. In CoRR. [our card](https://md.research.elamur.ai/free/en/papers/yang-2014-embedding-entities-relations-learning-inference/)
47. Alexander Yates and Oren Etzioni. 2007. Unsupervised resolution of objects and relations on the web. In North American Chapter of the Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Alexander+Yates+and+Oren+Etzioni%2E+2007%2E+Unsupervised+resolution+of+objects+and+relations+on+the+web%2E+In+North+American+Chapter+of+the+Association+for+Computational+Linguistics%2E)
48. Ainur Yessenalina and Claire Cardie. 2011. Compositional matrix-space models for sentiment analysis. In Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Ainur+Yessenalina+and+Claire+Cardie%2E+2011%2E+Compositional+matrix%2Dspace+models+for+sentiment+analysis%2E+In+Empirical+Methods+in+Natural+Language+Processing%2E)