--- title: "Latent Dirichlet Allocation — Blei 2003" description: "The paper addresses how to obtain compact, statistically meaningful representations of documents and other collections of discrete data." authors: ["David M. Blei", "Andrew Y. Ng", "Michael I. Jordan"] year: 2003 venue: "JMLR 3" source: "https://doi.org/10.5555/944919.944937" licence: "JMLR — open access, read only" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/blei-2003-latent-dirichlet-allocation/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/blei-2003-latent-dirichlet-allocation/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2003](https://md.research.elamur.ai/free/en/papers/2003/) / Latent Dirichlet Allocation # Latent Dirichlet Allocation **Authors:** [David M. Blei](https://md.research.elamur.ai/free/en/authors/david-m-blei/), [Andrew Y. Ng](https://md.research.elamur.ai/free/en/authors/andrew-y-ng/), Michael I. Jordan · **Year:** 2003 · **Venue:** JMLR 3 · **Licence:** JMLR — open access, read only **Links:** [Publisher's page](https://doi.org/10.5555/944919.944937) · [PDF](https://www.jmlr.org/papers/volume3/blei03a/blei03a.pdf) · [OpenAlex](https://openalex.org/W1880262756) **Citations:** 26344 citations (openalex-snapshot · 2026-10-14) · [1948](#cited-by) in our library, of the 140673 papers whose bibliographies we read ## Summary The paper addresses how to obtain compact, statistically meaningful representations of documents and other collections of discrete data. Earlier approaches fall short in different ways. tf-idf and LSI compress data but reveal little probabilistic structure. Hofmann's pLSI has no generative model at the document level, so its parameter count grows with the corpus, it overfits, and it cannot naturally score unseen documents. Starting from de Finetti's theorem on exchangeable variables, the authors propose latent Dirichlet allocation (LDA), a three-level hierarchical Bayesian model. In LDA, each document draws a topic mixture from a Dirichlet prior, and every word is produced by first sampling a topic and then a word from that topic's distribution. Exact inference is intractable, so they derive a variational approximation and an EM procedure for empirical Bayes parameter estimation. Experiments cover document modeling, text classification and collaborative filtering, with mixture of unigrams and pLSI as baselines. In the collaborative filtering experiment, LDA gives the best predictive perplexity, even though both baselines receive overfitting corrections. Because LDA is modular and extensible, it can serve as a building block for richer probabilistic models. ## Key points - Generative process: document length N is drawn from a Poisson distribution, topic proportions θ from Dir(α), and each word comes from a topic-specific multinomial. Word probabilities form a k×V matrix β, with the number of topics k fixed in advance. - Baselines are the mixture of unigrams model and pLSI (the aspect model). A key criticism of pLSI is that its parameters scale linearly with corpus size. - The collaborative filtering setup uses EachMovie, keeping only users with at least 100 positive ratings (4 or more of 5 stars). This yields 3300 training and 390 test users and a vocabulary of 1600 movies, evaluated by predictive perplexity on a held-out movie. - Inference relies on a convexity-based variational method. The authors point to expectation propagation (Minka and Lafferty) and MCMC (Griffiths and Steyvers) as alternative inference approaches. - Proposed extensions include Gaussian or other non-multinomial emissions, mixtures of Dirichlets, time-series topics, and conditioning on paragraph or sentence features. Paired LDA modules have already been used to model images with their captions. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Computing & GPUs](https://md.research.elamur.ai/free/en/shelves/computing/) ## Cited by Cited by 1948 papers of our library cite it (of the 140673 whose bibliographies we read); 82 of them have a page here, 1866 not yet. - [Detecting Suicidality in Arabic Tweets Using Machine Learning and Deep Learning Techniques](https://md.research.elamur.ai/free/en/papers/abdulsalam-2023-detecting-suicidality-arabic-tweets-using/) - [Hebrew Psychological Lexicons](https://md.research.elamur.ai/free/en/papers/aclbulk-2021-shapira-hebrew-psychological-lexicons/) - [Unsupervised Domain Clusters in Pretrained Language Models](https://md.research.elamur.ai/free/en/papers/aharoni-2020-unsupervised-domain-clusters-pretrained-language/) - [Evaluating Topic Coherence Using Distributional Semantics](https://md.research.elamur.ai/free/en/papers/aletras-2013-evaluating-topic-coherence-distributional-semantics/) - [Learning Latent Personas of Film Characters](https://md.research.elamur.ai/free/en/papers/bamman-2013-learning-latent-personas-film-characters/) - [A Bayesian Mixed Effects Model of Literary Character](https://md.research.elamur.ai/free/en/papers/bamman-2014-bayesian-mixed-effects-model-literary/) - [Don't count, predict! A systematic comparison of context-counting vs. context-predicting semantic vectors](https://md.research.elamur.ai/free/en/papers/baroni-2014-don-t-count-predict-systematic/) - [A Linguistic Resource for Discovering Event Structures and Resolving Event Coreference](https://md.research.elamur.ai/free/en/papers/bejan-2008-linguistic-resource-discovering-event-structures/) - [Unsupervised Event Coreference Resolution](https://md.research.elamur.ai/free/en/papers/bejan-2014-unsupervised-event-coreference-resolution/) - [Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic Coherence](https://md.research.elamur.ai/free/en/papers/bianchi-2021-pre-training-is-hot-topic/) - [Experience Grounds Language](https://md.research.elamur.ai/free/en/papers/bisk-2020-experience-grounds-language/) - [Dynamic Topic Models](https://md.research.elamur.ai/free/en/papers/blei-2006-dynamic-topic-models/) - [Domain Adaptation with Structural Correspondence Learning](https://md.research.elamur.ai/free/en/papers/blitzer-2006-domain-adaptation-structural-correspondence-learning/) - [TopicRank: Graph-Based Topic Ranking for Keyphrase Extraction](https://md.research.elamur.ai/free/en/papers/bougouin-2013-topicrank-graph-based-topic-ranking/) - [An Unsupervised Aspect-Sentiment Model for Online Reviews](https://md.research.elamur.ai/free/en/papers/brody-2010-unsupervised-aspect-sentiment-model-online/) - [Reading Tea Leaves: How Humans Interpret Topic Models](https://md.research.elamur.ai/free/en/papers/chang-2009-reading-tea-leaves-humans-interpret-topic/) - [Findings of the WMT 2019 Shared Task on Automatic Post-Editing](https://md.research.elamur.ai/free/en/papers/chatterjee-2019-findings-wmt-2019-shared-task/) - [Fast and Robust Neural Network Joint Models for Statistical Machine Translation](https://md.research.elamur.ai/free/en/papers/devlin-2014-fast-robust-neural-network-joint/) - [BERTopic: Neural topic modeling with a class-based TF-IDF procedure](https://md.research.elamur.ai/free/en/papers/grootendorst-2022-bertopic-neural-topic-modeling-class/) - [Argumentation Mining in User-Generated Web Discourse](https://md.research.elamur.ai/free/en/papers/habernal-2017-argumentation-mining-user-generated-web/) - [Exploring Content Models for Multi-Document Summarization](https://md.research.elamur.ai/free/en/papers/haghighi-2009-exploring-content-models-multi-document/) - [A Retrospective Analysis of the Fake News Challenge Stance-Detection Task](https://md.research.elamur.ai/free/en/papers/hanselowski-2018-retrospective-analysis-fake-news-challenge/) - [Automatic Keyphrase Extraction: A Survey of the State of the Art](https://md.research.elamur.ai/free/en/papers/hasan-2014-automatic-keyphrase-extraction-survey-state/) - [Multilingual Models for Compositional Distributed Semantics](https://md.research.elamur.ai/free/en/papers/hermann-2014-multilingual-models-compositional-distributed-semantics/) - [Automatic Language Identification in Texts: A Survey](https://md.research.elamur.ai/free/en/papers/jauhiainen-2019-automatic-language-identification-texts/) - [Temporal Analysis of Language through Neural Language Models](https://md.research.elamur.ai/free/en/papers/kim-2014-temporal-analysis-language-through-neural/) - [The NarrativeQA Reading Comprehension Challenge](https://md.research.elamur.ai/free/en/papers/kocisky-2018-narrativeqa-reading-comprehension-challenge/) - [Machine Reading Tea Leaves: Automatically Evaluating Topic Coherence and Topic Model Quality](https://md.research.elamur.ai/free/en/papers/lau-2014-machine-reading-tea-leaves-automatically/) - [OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents](https://md.research.elamur.ai/free/en/papers/lauren-2023-ccon-obelics-open-web-scale-filtered/) - [Argument Mining: A Survey](https://md.research.elamur.ai/free/en/papers/lawrence-2019-argument-mining-survey/) - [Neural Net Models of Open-domain Discourse Coherence](https://md.research.elamur.ai/free/en/papers/li-2017-neural-net-models-open-domain/) - [HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models](https://md.research.elamur.ai/free/en/papers/li-2023-halueval-large-scale-hallucination-evaluation/) - [Graph convolutional networks for exploring authorship hypotheses](https://md.research.elamur.ai/free/en/papers/lingbulk-2019-lippincott-graph-convolutional-networks-exploring-authorship/) - [Morphology-rich Alphasyllabary Embeddings](https://md.research.elamur.ai/free/en/papers/lingbulk-2020-mersha-morphology-rich-alphasyllabary-embeddings/) - [Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval](https://md.research.elamur.ai/free/en/papers/liu-2015-representation-learning-multi-task-deep/) - [Ithaca Revisited: Benchmarking a Domain-Specific Model for Epigraphy in the Age of LLMs](https://md.research.elamur.ai/free/en/papers/locaputo-2026-ithaca-revisited-benchmarking-domain-specific/) - [Automatic Detection and Language Identification of Multilingual Documents](https://md.research.elamur.ai/free/en/papers/lui-2014-automatic-detection-language-identification-multilingual/) - [Bilingual Word Representations with Monolingual Quality in Mind](https://md.research.elamur.ai/free/en/papers/luong-2015-bilingual-word-representations-monolingual-quality/) - [Learning Word Vectors for Sentiment Analysis](https://md.research.elamur.ai/free/en/papers/maas-2011-learning-word-vectors-sentiment-analysis/) - [Optimizing Semantic Coherence in Topic Models](https://md.research.elamur.ai/free/en/papers/mimno-2011-optimizing-semantic-coherence-topic-models/) - [Uncovering Conspiratorial Narratives within Arabic Online Content](https://md.research.elamur.ai/free/en/papers/mohdeb-2025-uncovering-conspiratorial-narratives-within-arabic/) - [Automatic Evaluation of Topic Coherence](https://md.research.elamur.ai/free/en/papers/newman-2010-automatic-evaluation-topic-coherence/) - [Evaluating Machine Translation Datasets for Low-Web Data Languages: A Gendered Lens](https://md.research.elamur.ai/free/en/papers/nigatu-2026-evaluating-machine-translation-datasets-low/) - [A review of sentiment analysis research in Arabic language](https://md.research.elamur.ai/free/en/papers/oueslati-2020-review-sentiment-analysis-research-arabic/) - [A Probabilistic Annotation Model for Crowdsourcing Coreference](https://md.research.elamur.ai/free/en/papers/paun-2018-probabilistic-annotation-model-crowdsourcing-coreference/) - [Toxicity Detection: Does Context Really Matter?](https://md.research.elamur.ai/free/en/papers/pavlopoulos-2020-toxicity-detection-does-context-really/) - [Are idioms surprising?](https://md.research.elamur.ai/free/en/papers/philipp-2023-are-idioms-surprising/) - [Semantic Information: A Difference That Makes a Difference](https://md.research.elamur.ai/free/en/papers/philipp-2026-semantic-information-difference-that-makes/) - [When Numbers Tell Half the Story: Human-Metric Alignment in Topic Model Evaluation](https://md.research.elamur.ai/free/en/papers/prouteau-2026-when-numbers-tell-half-story/) - [Learning to Generate Reviews and Discovering Sentiment](https://md.research.elamur.ai/free/en/papers/radford-2017-learning-generate-reviews-discovering-sentiment/) - [Learning Transferable Visual Models From Natural Language Supervision](https://md.research.elamur.ai/free/en/papers/radford-2021-learning-transferable-visual-models-natural/) - [Compressive Transformers for Long-Range Sequence Modelling](https://md.research.elamur.ai/free/en/papers/rae-2019-compressive-transformers-long-range-sequence/) - [Streaming Cross Document Entity Coreference Resolution](https://md.research.elamur.ai/free/en/papers/rao-2010-streaming-cross-document-entity-coreference/) - [Unsupervised Modeling of Twitter Conversations](https://md.research.elamur.ai/free/en/papers/ritter-2010-unsupervised-modeling-twitter-conversations/) - [Named Entity Recognition in Tweets: An Experimental Study](https://md.research.elamur.ai/free/en/papers/ritter-2011-named-entity-recognition-tweets-experimental/) - [Exploring the Space of Topic Coherence Measures](https://md.research.elamur.ai/free/en/papers/roder-2015-exploring-space-topic-coherence-measures/) - [Transfer Learning in Natural Language Processing](https://md.research.elamur.ai/free/en/papers/ruder-2019-transfer-learning-natural-language-processing/) - [Idiom Token Classification using Sentential Distributed Semantics](https://md.research.elamur.ai/free/en/papers/salton-2016-idiom-token-classification-sentential-distributed/) - [A Survey on Hate Speech Detection using Natural Language Processing](https://md.research.elamur.ai/free/en/papers/schmidt-2017-survey-hate-speech-detection-natural/) - [Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Index](https://md.research.elamur.ai/free/en/papers/seo-2019-real-time-open-domain-question/) - [Speaker-change Aware CRF for Dialogue Act Classification](https://md.research.elamur.ai/free/en/papers/shang-2020-speaker-change-aware-crf-dialogue/) - [Expert, Crowdsourced, and Machine Assessment of Suicide Risk via Online Postings](https://md.research.elamur.ai/free/en/papers/shing-2018-expert-crowdsourced-machine-assessment-suicide/) - [Dirt Cheap Web-Scale Parallel Text from the Common Crawl](https://md.research.elamur.ai/free/en/papers/smith-2013-dirt-cheap-web-scale-parallel/) - [Semi-Supervised Recursive Autoencoders for Predicting Sentiment Distributions](https://md.research.elamur.ai/free/en/papers/socher-2011-semi-supervised-recursive-autoencoders-predicting/) - [Machine Learning for Ancient Languages: A Survey](https://md.research.elamur.ai/free/en/papers/sommerschield-2023-machine-learning-ancient-languages-survey/) - [Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification](https://md.research.elamur.ai/free/en/papers/tang-2014-learning-sentiment-specific-word-embedding/) - [A Joint Model of Text and Aspect Ratings for Sentiment Summarization](https://md.research.elamur.ai/free/en/papers/titov-2008-joint-model-text-aspect-ratings/) - [TiC-MuFormer: Time-Aware Caption-Integrated Multimodal Transformers for User-Level Mental Health Modeling](https://md.research.elamur.ai/free/en/papers/tsoumplekas-2026-tic-muformer-time-aware-caption/) - [Word Representations: A Simple and General Method for Semi-Supervised Learning](https://md.research.elamur.ai/free/en/papers/turian-2010-word-representations-simple-general-method/) - [Modeling Changing Scientific Concepts with Complex Networks: A Case Study on the Chemical Revolution](https://md.research.elamur.ai/free/en/papers/valdez-2026-modeling-changing-scientific-concepts-complex/) - [Text Embeddings by Weakly-Supervised Contrastive Pre-training](https://md.research.elamur.ai/free/en/papers/wang-2022-text-embeddings-weakly-supervised-contrastive/) - [A Discriminative Hierarchical Model for Fast Coreference at Large Scale](https://md.research.elamur.ai/free/en/papers/wick-2012-discriminative-hierarchical-model-fast-coreference/) - [A Multi-Task Dataset for Assessing Discourse Coherence in Chinese Essays: Structure, Theme, and Logic Analysis](https://md.research.elamur.ai/free/en/papers/wu-2023-multi-task-dataset-assessing-discourse/) - [An Explanation of In-context Learning as Implicit Bayesian Inference](https://md.research.elamur.ai/free/en/papers/xie-2021-explanation-context-learning-implicit-bayesian/) - [Learning from Bullying Traces in Social Media](https://md.research.elamur.ai/free/en/papers/xu-2012-learning-bullying-traces-social-media/) - [Learning Discriminative Projections for Text Similarity Measures](https://md.research.elamur.ai/free/en/papers/yih-2011-learning-discriminative-projections-text-similarity/) - [Semantic Parsing for Single-Relation Question Answering](https://md.research.elamur.ai/free/en/papers/yih-2014-semantic-parsing-single-relation-question/) - [Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders](https://md.research.elamur.ai/free/en/papers/zhao-2017-learning-discourse-level-diversity-neural/) - [MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization](https://md.research.elamur.ai/free/en/papers/zhu-2021-mediasum-large-scale-media-interview/) - [CLPsych 2019 Shared Task: Predicting the Degree of Suicide Risk in Reddit Posts](https://md.research.elamur.ai/free/en/papers/zirikly-2019-clpsych-2019-shared-task-predicting/) - [Multilingual Stance Detection in Tweets: The Catalonia Independence Corpus](https://md.research.elamur.ai/free/en/papers/zotova-2020-multilingual-stance-detection-tweets-catalonia/) - [From Noise to Signal: When Outliers Seed New Topics](https://md.research.elamur.ai/free/en/papers/zve-2026-noise-signal-when-outliers-seed/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{blei2003latent, title = {{Latent Dirichlet Allocation}}, author = {Blei, David M. and Ng, Andrew Y. and Jordan, Michael I.}, booktitle = {JMLR 3}, year = {2003}, doi = {10.5555/944919.944937}, url = {https://doi.org/10.5555/944919.944937} } ``` - [← previous Japanese Zero Pronoun Resolution based on Ranking Rules and Machine Learning](https://md.research.elamur.ai/free/en/papers/isozaki-2003-japanese-zero-pronoun-resolution-based/) - [next → Learning Extraction Patterns for Subjective Expressions](https://md.research.elamur.ai/free/en/papers/riloff-2003-learning-extraction-patterns-subjective-expressions/) - [↑ back to papers of 2003](https://md.research.elamur.ai/free/en/papers/2003/) ## References 13 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. URL M. Jordan, Z. Ghahramani, T. Jaakkola, and L. Saul. Introduction to variational methods for graphical models. Machine Learning, 37:183–233, 1999. [find](https://scholar.google.com/scholar?q=URL+M%2E+Jordan%2C+Z%2E+Ghahramani%2C+T%2E+Jaakkola%2C+and+L%2E+Saul%2E+Introduction+to+variational+methods+for+graphical+models%2E+Machine+Learning%2C+37%3A183%E2%80%93233%2C+1999%2E) 2. R. Kass and D. Steffey. Approximate Bayesian inference in conditionally independent hierarchical models (parametric empirical Bayes models). Journal of the American Statistical Association, 84 (407):717–726, 1989. [find](https://scholar.google.com/scholar?q=R%2E+Kass+and+D%2E+Steffey%2E+Approximate+Bayesian+inference+in+conditionally+independent+hierarchical+models+%28parametric+empirical+Bayes+models%29%2E+Journal+of+the+American+Statistical+Association%2C+84+%28407%29%3A7) 3. M. Leisink and H. Kappen. General lower bounds based on computer generated higher order expansions. In Uncertainty in Artificial Intelligence, Proceedings of the Eighteenth Conference, 2002. [find](https://scholar.google.com/scholar?q=M%2E+Leisink+and+H%2E+Kappen%2E+General+lower+bounds+based+on+computer+generated+higher+order+expansions%2E+In+Uncertainty+in+Artificial+Intelligence%2C+Proceedings+of+the+Eighteenth+Conference%2C+2002%2E) 4. T. Minka. Estimating a Dirichlet distribution. Technical report, M.I.T., 2000. [find](https://scholar.google.com/scholar?q=T%2E+Minka%2E+Estimating+a+Dirichlet+distribution%2E+Technical+report%2C+M%2EI%2ET%2E%2C+2000%2E) 5. T. P. Minka and J. Lafferty. Expectation-propagation for the generative aspect model. In Uncertainty in Artificial Intelligence (UAI), 2002. [find](https://scholar.google.com/scholar?q=T%2E+P%2E+Minka+and+J%2E+Lafferty%2E+Expectation%2Dpropagation+for+the+generative+aspect+model%2E+In+Uncertainty+in+Artificial+Intelligence+%28UAI%29%2C+2002%2E) 6. C. Morris. Parametric empirical Bayes inference: Theory and applications. Journal of the American Statistical Association, 78(381):47–65, 1983. With discussion. [find](https://scholar.google.com/scholar?q=C%2E+Morris%2E+Parametric+empirical+Bayes+inference%3A+Theory+and+applications%2E+Journal+of+the+American+Statistical+Association%2C+78%28381%29%3A47%E2%80%9365%2C+1983%2E+With+discussion%2E) 7. K. Nigam, J. Lafferty, and A. McCallum. Using maximum entropy for text classification. IJCAI-99 Workshop on Machine Learning for Information Filtering, pages 61–67, 1999. [find](https://scholar.google.com/scholar?q=K%2E+Nigam%2C+J%2E+Lafferty%2C+and+A%2E+McCallum%2E+Using+maximum+entropy+for+text+classification%2E+IJCAI%2D99+Workshop+on+Machine+Learning+for+Information+Filtering%2C+pages+61%E2%80%9367%2C+1999%2E) 8. K. Nigam, A. McCallum, S. Thrun, and T. Mitchell. Text classification from labeled and unlabeled documents using EM. Machine Learning, 39(2/3):103–134, 2000. [find](https://scholar.google.com/scholar?q=K%2E+Nigam%2C+A%2E+McCallum%2C+S%2E+Thrun%2C+and+T%2E+Mitchell%2E+Text+classification+from+labeled+and+unlabeled+documents+using+EM%2E+Machine+Learning%2C+39%282%2F3%29%3A103%E2%80%93134%2C+2000%2E) 9. C. Papadimitriou, H. Tamaki, P. Raghavan, and S. Vempala. Latent semantic indexing: A probabilistic analysis. pages 159–168, 1998. [find](https://scholar.google.com/scholar?q=C%2E+Papadimitriou%2C+H%2E+Tamaki%2C+P%2E+Raghavan%2C+and+S%2E+Vempala%2E+Latent+semantic+indexing%3A+A+probabilistic+analysis%2E+pages+159%E2%80%93168%2C+1998%2E) 10. A. Popescul, L. Ungar, D. Pennock, and S. Lawrence. Probabilistic models for unified collaborative and content-based recommendation in sparse-data environments. In Uncertainty in Artificial Intelligence, Proceedings of the Seventeenth Conference, 2001. [find](https://scholar.google.com/scholar?q=A%2E+Popescul%2C+L%2E+Ungar%2C+D%2E+Pennock%2C+and+S%2E+Lawrence%2E+Probabilistic+models+for+unified+collaborative+and+content%2Dbased+recommendation+in+sparse%2Ddata+environments%2E+In+Uncertainty+in+Artificial+Intelligen) 11. J. Rennie. Improving multi-class text classification with naive Bayes. Technical Report AITR-2001-004, M.I.T., 2001. [find](https://scholar.google.com/scholar?q=J%2E+Rennie%2E+Improving+multi%2Dclass+text+classification+with+naive+Bayes%2E+Technical+Report+AITR%2D2001%2D004%2C+M%2EI%2ET%2E%2C+2001%2E) 12. G. Ronning. Maximum likelihood estimation of Dirichlet distributions. Journal of Statistcal Computation and Simulation, 34(4):215–221, 1989. [find](https://scholar.google.com/scholar?q=G%2E+Ronning%2E+Maximum+likelihood+estimation+of+Dirichlet+distributions%2E+Journal+of+Statistcal+Computation+and+Simulation%2C+34%284%29%3A215%E2%80%93221%2C+1989%2E) 13. G. Salton and M. McGill, editors. Introduction to Modern Information Retrieval. McGraw-Hill, 1983. [find](https://scholar.google.com/scholar?q=G%2E+Salton+and+M%2E+McGill%2C+editors%2E+Introduction+to+Modern+Information+Retrieval%2E+McGraw%2DHill%2C+1983%2E)