---
title: "N-gram-based Machine Translation — Mariño 2006"
description: "Mariño and colleagues present a statistical MT system in which translation is modelled as a language model over a bilingual token stream."
authors: ["José Mariño", "Rafael E. Banchs", "Josep M. Crego", "Adrià de Gispert", "Patrik Lambert", "José A. R. Fonollosa", "Marta R. Costa-jussà"]
year: 2006
venue: "Computational Linguistics"
source: "https://aclanthology.org/J06-4004/"
doi: "10.1162/coli.2006.32.4.527"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/marino-2006-n-gram-based-machine-translation/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/marino-2006-n-gram-based-machine-translation/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2006](https://md.research.elamur.ai/free/en/papers/2006/) / N-gram-based Machine Translation

# N-gram-based Machine Translation

**Authors:** José Mariño, Rafael E. Banchs, Josep M. Crego, [Adrià de Gispert](https://md.research.elamur.ai/free/en/authors/adria-de-gispert/), [Patrik Lambert](https://md.research.elamur.ai/free/en/authors/patrik-lambert/), [José A. R. Fonollosa](https://md.research.elamur.ai/free/en/authors/jose-a-r-fonollosa/), [Marta R. Costa-jussà](https://md.research.elamur.ai/free/en/authors/marta-r-costa-jussa/) · **Year:** 2006 · **Venue:** Computational Linguistics · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/J06-4004/) · [PDF](https://aclanthology.org/J06-4004.pdf) · [DOI 10.1162/coli.2006.32.4.527](https://doi.org/10.1162/coli.2006.32.4.527) · [OpenAlex](https://openalex.org/W2144879357)

**Citations:** 234 citations (openalex-snapshot · 2026-10-14) · [84](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
Mariño and colleagues present a statistical MT system in which translation is modelled as a language model over a bilingual token stream. Each sentence pair is cut into minimal bilingual chunks called tuples, and a back-off n-gram model over these tuples serves as the translation model. Tuples come from many-to-many word alignments, taken as the union of the two IBM alignment directions. The segmentation must be monotonic and unique, and no smaller split may break an alignment link. The tuple model is combined log-linearly with four additional feature functions, including a target language model, a word bonus and IBM-based lexicon features. Decoding uses the MARIE decoder in monotone mode, with no reordering. The system was tested on Spanish↔English European Parliament Plenary Sessions (EPPS) data, on text, verbatim transcripts and ASR output. It matched or beat leading systems in the TC-STAR evaluation and the ACL 2005 shared task. This matters because it showed that a finite-state-inspired bilingual n-gram model can compete with phrase-based SMT for closely related languages.

## Key points
- The translation model approximates the joint probability p(T, S) as a product of tuple n-gram probabilities, so the conditioning context is bilingual.
- Tuples are extracted from the union of source-to-target and target-to-source IBM alignments. The authors found the union worked best and attribute this to its higher recall.
- In the TC-STAR evaluation (EPPS), the n-gram system ranked first on final text editions in both directions (ES→EN 53.3 BLEU, EN→ES 46.2 BLEU). It ranked second or third on verbatim transcripts and ASR output.
- In the ACL 2005 shared task, it placed second for FR→EN (30.20), ES→EN (30.07) and DE→EN (24.26), and third for FI→EN (20.31).
- Spanish→English output was consistently better than English→Spanish. The authors point to morphology as the main issue in the harder direction, and they also flag reordering, null-aligned words and verb forms as recurring error sources.

## Interesting ideas
- **Translation as a language model over a "bilanguage".** Merging source and target into joint units lets standard back-off n-gram tooling handle smoothing and context for free. The same trick could apply to other paired-sequence tasks, such as transliteration or normalisation.
- **Deterministic minimal segmentation.** Defining units as the smallest chunks that respect alignment links and keep monotonic order produces a unique, compact vocabulary with no maximum-length parameter. This is far smaller than an exhaustive phrase table.
- **Patching coverage gaps with one-word fallback units.** Some words only ever appear inside larger tuples ("embedded words"), so the authors add single-word tuples from a bilingual dictionary. This guarantees every seen word has a translation option, a cheap fix for any chunk-based model.
- **Controlled comparison through shared components.** The n-gram system was compared with a phrase-based system that uses the same decoder, language model and features. Isolating the core modelling choice this way is a sound evaluation design worth copying.
- **Knowing when the method fits.** The authors note that tuple length grows with structural divergence between languages, so the approach suits close pairs and suffers from sparsity on distant ones. This is a useful check before applying it to typologically different pairs, such as Ukrainian with a non-Slavic language.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

Topics: [Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/)

## Cited by

Cited by

84 papers of our library cite it (of the 140884 whose bibliographies we read); 1 of them have a page here, 83 not yet.

- [Fast and Robust Neural Network Joint Models for Statistical Machine Translation](https://md.research.elamur.ai/free/en/papers/devlin-2014-fast-robust-neural-network-joint/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@article{marino2006n,
  title = {{N-gram-based Machine Translation}},
  author = {Mariño, José and Banchs, Rafael E. and Crego, Josep M. and Gispert, Adrià de and Lambert, Patrik and Fonollosa, José A. R. and Costa-jussà, Marta R.},
  journal = {Computational Linguistics},
  year = {2006},
  doi = {10.1162/coli.2006.32.4.527},
  url = {https://doi.org/10.1162/coli.2006.32.4.527}
}
```

- [← previous Multilingual Dependency Analysis with a Two-Stage Discriminative Parser](https://md.research.elamur.ai/free/en/papers/mcdonald-2006-multilingual-dependency-analysis-two-stage/)
- [next → NLTK: The Natural Language Toolkit](https://md.research.elamur.ai/free/en/papers/bird-2006-nltk-natural-language-toolkit/)
- [↑ back to papers of 2006](https://md.research.elamur.ai/free/en/papers/2006/)

## References

37 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Banchs, Rachel E., Josep Maria Crego, Adrià de Gispert, Patrik Lambert, and José Bernardo Mariño. 2005. Statistical machine translation of Euparl data by using bilingual n-grams. In ACL Workshop on Data-Driven Machine Translation and Beyond, pages 133–136, Ann Arbor, MI. [find](https://scholar.google.com/scholar?q=Banchs%2C+Rachel+E%2E%2C+Josep+Maria+Crego%2C+Adria%CC%80+de+Gispert%2C+Patrik+Lambert%2C+and+Jose%CC%81+Bernardo+Marin%CC%83o%2E+2005%2E+Statistical+machine+translation+of+Euparl+data+by+using+bilingual+n%2Dgrams%2E+In+ACL+Workshop+on)
2. Bangalore, Srinivas and Giuseppe Riccardi. 2000. Stochastic finite-state models for spoken language machine translation. [find](https://scholar.google.com/scholar?q=Bangalore%2C+Srinivas+and+Giuseppe+Riccardi%2E+2000%2E+Stochastic+finite%2Dstate+models+for+spoken+language+machine+translation%2E)
3. In Proceedings of the Workshop on Embedded Machine Translation Systems, pages 52–59, Seattle, WA. [find](https://scholar.google.com/scholar?q=In+Proceedings+of+the+Workshop+on+Embedded+Machine+Translation+Systems%2C+pages+52%E2%80%9359%2C+Seattle%2C+WA%2E)
4. Berger, Adam, Stephen Della Pietra, and Vincent Della Pietra. 1996. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39–71. [find](https://scholar.google.com/scholar?q=Berger%2C+Adam%2C+Stephen+Della+Pietra%2C+and+Vincent+Della+Pietra%2E+1996%2E+A+maximum+entropy+approach+to+natural+language+processing%2E+Computational+Linguistics%2C+22%281%29%3A39%E2%80%9371%2E) [our card](https://md.research.elamur.ai/free/en/papers/berger-1996-maximum-entropy-approach-natural-language/)
5. Brown, Peter, John Cocke, Stephen Della Pietra, Vincent Della Pietra, Frederick Jelinek, John Lafferty, Robert Mercer, and Paul S. Roossin. 1990. A statistical approach to machine translation. Computational Linguistics, 16(2):79–85. [find](https://scholar.google.com/scholar?q=Brown%2C+Peter%2C+John+Cocke%2C+Stephen+Della+Pietra%2C+Vincent+Della+Pietra%2C+Frederick+Jelinek%2C+John+Lafferty%2C+Robert+Mercer%2C+and+Paul+S%2E+Roossin%2E+1990%2E+A+statistical+approach+to+machine+translation%2E+Computa)
6. Brown, Peter, Stephen Della Pietra, Vincent Della Pietra, and Robert Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263–311. [find](https://scholar.google.com/scholar?q=Brown%2C+Peter%2C+Stephen+Della+Pietra%2C+Vincent+Della+Pietra%2C+and+Robert+Mercer%2E+1993%2E+The+mathematics+of+statistical+machine+translation%3A+Parameter+estimation%2E+Computational+Linguistics%2C+19%282%29%3A263%E2%80%93311%2E)
7. Casacuberta, Francisco. 2001. Finite-state transducers for speech input translation. In Proceedings IEEE ASRU, pages 375–380, Madonna di Campiglio, Italy. [find](https://scholar.google.com/scholar?q=Casacuberta%2C+Francisco%2E+2001%2E+Finite%2Dstate+transducers+for+speech+input+translation%2E+In+Proceedings+IEEE+ASRU%2C+pages+375%E2%80%93380%2C+Madonna+di+Campiglio%2C+Italy%2E)
8. Casacuberta, Francisco and Enrique Vidal. 2004. Machine translation with inferred stochastic finite-state transducers. Computational Linguistics, 30(2):205–225. [find](https://scholar.google.com/scholar?q=Casacuberta%2C+Francisco+and+Enrique+Vidal%2E+2004%2E+Machine+translation+with+inferred+stochastic+finite%2Dstate+transducers%2E+Computational+Linguistics%2C+30%282%29%3A205%E2%80%93225%2E)
9. Costa-jussà, Marta Ruiz, José Adrián Rodriguez Fonollosa, and Enric Monte. 2006. Using reordering in statistical machine translation based on alignment block classification. Internal Report. [http://gps-tsc.upc.es/veu/personal/mruiz/docs/br06.pdf](http://gps-tsc.upc.es/veu/personal/mruiz/docs/br06.pdf). [↗](http://gps-tsc.upc.es/veu/personal/mruiz/docs/br06.pdf)
10. Crego, Josep Maria, José Bernardo Mariño, and Adrià de Gispert. 2004. Finite-state-based and phrase-based statistical machine translation. In Proceedings of the 8th International Conference on Spoken Language Processing, pages 37–40, Jeju, Korea. [find](https://scholar.google.com/scholar?q=Crego%2C+Josep+Maria%2C+Jose%CC%81+Bernardo+Marin%CC%83o%2C+and+Adria%CC%80+de+Gispert%2E+2004%2E+Finite%2Dstate%2Dbased+and+phrase%2Dbased+statistical+machine+translation%2E+In+Proceedings+of+the+8th+International+Conference+on+Spok)
11. Crego, Josep Maria, José Bernardo Mariño, and Adrià de Gispert. 2005a. An Ngram-based statistical machine translation decoder. In INTERSPEECH 2005, pages 3185–3188, Lisbon, Portugal. [find](https://scholar.google.com/scholar?q=Crego%2C+Josep+Maria%2C+Jose%CC%81+Bernardo+Marin%CC%83o%2C+and+Adria%CC%80+de+Gispert%2E+2005a%2E+An+Ngram%2Dbased+statistical+machine+translation+decoder%2E+In+INTERSPEECH+2005%2C+pages+3185%E2%80%933188%2C+Lisbon%2C+Portugal%2E)
12. Crego, Josep Maria, José Bernardo Mariño, and Adrià de Gispert. 2005b. Reordered search and tuple unfolding for Ngram-based SMT. Proceedings of the Tenth Machine Translation Summit, pages 283–289, Phuket, Thailand. [find](https://scholar.google.com/scholar?q=Crego%2C+Josep+Maria%2C+Jose%CC%81+Bernardo+Marin%CC%83o%2C+and+Adria%CC%80+de+Gispert%2E+2005b%2E+Reordered+search+and+tuple+unfolding+for+Ngram%2Dbased+SMT%2E+Proceedings+of+the+Tenth+Machine+Translation+Summit%2C+pages+283%E2%80%93289%2C+)
13. Crego, Josep Maria, Marta Ruiz Costa-jussà, José Bernardo Mariño, and José Adrián Rodriguez Fonollosa. 2005c. Ngram-based versus phrase-based statistical machine translation. In Proceedings of the International Workshop on Spoken Language Translation, pages 177–184, Pittsburgh, PA. [find](https://scholar.google.com/scholar?q=Crego%2C+Josep+Maria%2C+Marta+Ruiz+Costa%2Djussa%CC%80%2C+Jose%CC%81+Bernardo+Marin%CC%83o%2C+and+Jose%CC%81+Adria%CC%81n+Rodriguez+Fonollosa%2E+2005c%2E+Ngram%2Dbased+versus+phrase%2Dbased+statistical+machine+translation%2E+In+Proceedings+of+th)
14. Crego, Josep Maria and José Bernardo Mariño. 2006. Integration of POStag-based source reordering into SMT decoding by an extended search graph. In Proceedings of the 7th Biennial Conference of the Association for Machine Translation in the Americas, Boston, MA. de Gispert, Adrià and José Bernard… [find](https://scholar.google.com/scholar?q=Crego%2C+Josep+Maria+and+Jose%CC%81+Bernardo+Marin%CC%83o%2E+2006%2E+Integration+of+POStag%2Dbased+source+reordering+into+SMT+decoding+by+an+extended+search+graph%2E+In+Proceedings+of+the+7th+Biennial+Conference+of+the+A)
15. Hutchins, John. 1986. Machine Translation: Past, Present and Future. Ellis Horwood, Chichester, England. [find](https://scholar.google.com/scholar?q=Hutchins%2C+John%2E+1986%2E+Machine+Translation%3A+Past%2C+Present+and+Future%2E+Ellis+Horwood%2C+Chichester%2C+England%2E)
16. Kay, Martin, Jean Mark Gawron, and Peter Norvig. 1992. Verbmobil: A Translation System for Face-to-Face Dialog. CSLI. [find](https://scholar.google.com/scholar?q=Kay%2C+Martin%2C+Jean+Mark+Gawron%2C+and+Peter+Norvig%2E+1992%2E+Verbmobil%3A+A+Translation+System+for+Face%2Dto%2DFace+Dialog%2E+CSLI%2E)
17. Kneser, Reinhard and Hermann Ney. 1995. Improved backing-off for m-gram language modeling. In IEEE International Conference on Acoustics, Speech and Signal Processing, pages 49–52, Detroit, MI. [find](https://scholar.google.com/scholar?q=Kneser%2C+Reinhard+and+Hermann+Ney%2E+1995%2E+Improved+backing%2Doff+for+m%2Dgram+language+modeling%2E+In+IEEE+International+Conference+on+Acoustics%2C+Speech+and+Signal+Processing%2C+pages+49%E2%80%9352%2C+Detroit%2C+MI%2E)
18. Knight, Kevin and Yaser Al-Onaizan. 1998. Translation with finite-state devices. In AI Lecture Notes in Artificial Intelligence, volume 1529, Springer-Verlag, pages 421–437. [find](https://scholar.google.com/scholar?q=Knight%2C+Kevin+and+Yaser+Al%2DOnaizan%2E+1998%2E+Translation+with+finite%2Dstate+devices%2E+In+AI+Lecture+Notes+in+Artificial+Intelligence%2C+volume+1529%2C+Springer%2DVerlag%2C+pages+421%E2%80%93437%2E)
19. Koehn, Philippe, Franz Joseph Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proceedings of the 2003 Meeting of the North American chapter of the ACL, pages 48–54, Edmonton, Alberta, Canada. [find](https://scholar.google.com/scholar?q=Koehn%2C+Philippe%2C+Franz+Joseph+Och%2C+and+Daniel+Marcu%2E+2003%2E+Statistical+phrase%2Dbased+translation%2E+In+Proceedings+of+the+2003+Meeting+of+the+North+American+chapter+of+the+ACL%2C+pages+48%E2%80%9354%2C+Edmonton%2C+Alb)
20. Koehn, Philippe. 2002. Europarl: A multilingual corpus for evaluation of machine translation. Available online at: [http://people.csail.mit.edu/people/koehn/publications/europarl/](http://people.csail.mit.edu/people/koehn/publications/europarl/). [↗](http://people.csail.mit.edu/people/koehn/publications/europarl/)
21. Mariño, José Bernardo, Rafael E. Banchs, Josep Maria Crego, Adrià de Gispert, Patrik Lambert, José Adrián Rodriguez Fonollosa, and Marta Ruiz. 2005. Bilingual N-gram statistical machine translation. In Proceedings of the Tenth Machine Translation Summit, pages 275–282, Phuket, Thailand. [find](https://scholar.google.com/scholar?q=Marin%CC%83o%2C+Jose%CC%81+Bernardo%2C+Rafael+E%2E+Banchs%2C+Josep+Maria+Crego%2C+Adria%CC%80+de+Gispert%2C+Patrik+Lambert%2C+Jose%CC%81+Adria%CC%81n+Rodriguez+Fonollosa%2C+and+Marta+Ruiz%2E+2005%2E+Bilingual+N%2Dgram+statistical+machine+translati)
22. Ney, Hermann, Volker Steinbiss, Richard Zens, Evgeny Matusov, Jorge González, Young-suk Lee, Salim Roukos, Marcello Federico, Muntsin Kolss, and Rafael Banchs. 2005. SLT progress report. TC-STAR Deliverable D5, European Community project no. FP6-506738. Available online at: http://www. tc-star.org/… [find](https://scholar.google.com/scholar?q=Ney%2C+Hermann%2C+Volker+Steinbiss%2C+Richard+Zens%2C+Evgeny+Matusov%2C+Jorge+Gonza%CC%81lez%2C+Young%2Dsuk+Lee%2C+Salim+Roukos%2C+Marcello+Federico%2C+Muntsin+Kolss%2C+and+Rafael+Banchs%2E+2005%2E+SLT+progress+report%2E+TC%2DSTAR+Deli)
23. Och, Franz Joseph and Hermann Ney. 2000. Improved statistical alignment models. In Proceedings of the 38th Annual Meeting of the ACL, pages 440–447, Hong Kong, China. [find](https://scholar.google.com/scholar?q=Och%2C+Franz+Joseph+and+Hermann+Ney%2E+2000%2E+Improved+statistical+alignment+models%2E+In+Proceedings+of+the+38th+Annual+Meeting+of+the+ACL%2C+pages+440%E2%80%93447%2C+Hong+Kong%2C+China%2E) [our card](https://md.research.elamur.ai/free/en/papers/och-2000-improved-statistical-alignment-models/)
24. Och, Franz Joseph and Hermann Ney. 2002. Discriminative training and maximum entropy models for statistical machine translation. In Proceedings of the 40th Annual Meeting of the ACL, pages 295–302, Philadelphia, PA. [find](https://scholar.google.com/scholar?q=Och%2C+Franz+Joseph+and+Hermann+Ney%2E+2002%2E+Discriminative+training+and+maximum+entropy+models+for+statistical+machine+translation%2E+In+Proceedings+of+the+40th+Annual+Meeting+of+the+ACL%2C+pages+295%E2%80%93302%2C+Ph) [our card](https://md.research.elamur.ai/free/en/papers/och-2002-discriminative-training-maximum-entropy-models/)
25. Och, Franz Joseph and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19–51. [find](https://scholar.google.com/scholar?q=Och%2C+Franz+Joseph+and+Hermann+Ney%2E+2003%2E+A+systematic+comparison+of+various+statistical+alignment+models%2E+Computational+Linguistics%2C+29%281%29%3A19%E2%80%9351%2E)
26. Och, Franz Joseph, Daniel Gildea, Sanjeev Khudanpur, Anoop Sarkar, Kenji Yamada, Alexander Fraser, Shankar Kumar, Libin Shen, David Smith, Katharine Eng, Viren Jain, Zhen Jin, and Dragomir Radev. 2004. A smorgasbord of features for statistical machine translation. In Proceedings of the Human Languag… [find](https://scholar.google.com/scholar?q=Och%2C+Franz+Joseph%2C+Daniel+Gildea%2C+Sanjeev+Khudanpur%2C+Anoop+Sarkar%2C+Kenji+Yamada%2C+Alexander+Fraser%2C+Shankar+Kumar%2C+Libin+Shen%2C+David+Smith%2C+Katharine+Eng%2C+Viren+Jain%2C+Zhen+Jin%2C+and+Dragomir+Radev%2E+2004) [our card](https://md.research.elamur.ai/free/en/papers/och-2004-smorgasbord-features-statistical-machine-translation/)
27. Papineni, Kishore, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Conference of the ACL, pages 311–318, Philadelphia, PA. [find](https://scholar.google.com/scholar?q=Papineni%2C+Kishore%2C+Salim+Roukos%2C+Todd+Ward%2C+and+Wei%2DJing+Zhu%2E+2002%2E+Bleu%3A+A+method+for+automatic+evaluation+of+machine+translation%2E+In+Proceedings+of+the+40th+Annual+Conference+of+the+ACL%2C+pages+311%E2%80%933) [our card](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/)
28. Press, William H., Saul Teukolsky, William Vetterling, and Brian P. Flannery. 2002. Numerical Recipes in C++: The Art of Scientific Computing, Cambridge University Press. [find](https://scholar.google.com/scholar?q=Press%2C+William+H%2E%2C+Saul+Teukolsky%2C+William+Vetterling%2C+and+Brian+P%2E+Flannery%2E+2002%2E+Numerical+Recipes+in+C%2B%2B%3A+The+Art+of+Scientific+Computing%2C+Cambridge+University+Press%2E)
29. Riccardi, Giuseppe, Roberto Pieraccini, and Enrico Bocchieri. 1996. Stochastic automata for language modeling. Computer Speech and Language, 10(4):265–293. [find](https://scholar.google.com/scholar?q=Riccardi%2C+Giuseppe%2C+Roberto+Pieraccini%2C+and+Enrico+Bocchieri%2E+1996%2E+Stochastic+automata+for+language+modeling%2E+Computer+Speech+and+Language%2C+10%284%29%3A265%E2%80%93293%2E)
30. Shannon, Claude E. 1949. Communication theory of secrecy systems. Bell System Technical Journal, 28:656–715. [find](https://scholar.google.com/scholar?q=Shannon%2C+Claude+E%2E+1949%2E+Communication+theory+of+secrecy+systems%2E+Bell+System+Technical+Journal%2C+28%3A656%E2%80%93715%2E)
31. Shannon, Claude E. 1951. Prediction and entropy of printed English. Bell System Technical Journal, 30:50–64. [find](https://scholar.google.com/scholar?q=Shannon%2C+Claude+E%2E+1951%2E+Prediction+and+entropy+of+printed+English%2E+Bell+System+Technical+Journal%2C+30%3A50%E2%80%9364%2E)
32. Shannon, Claude E. and Warren Weaver. 1949. The Mathematical Theory of Communication, University of Illinois Press, Urbana, IL. [find](https://scholar.google.com/scholar?q=Shannon%2C+Claude+E%2E+and+Warren+Weaver%2E+1949%2E+The+Mathematical+Theory+of+Communication%2C+University+of+Illinois+Press%2C+Urbana%2C+IL%2E)
33. Stolcke, Andreas 2002. SRLIM: An extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing, pages 901–904, Denver, CO. [find](https://scholar.google.com/scholar?q=Stolcke%2C+Andreas+2002%2E+SRLIM%3A+An+extensible+language+modeling+toolkit%2E+In+Proceedings+of+the+International+Conference+on+Spoken+Language+Processing%2C+pages+901%E2%80%93904%2C+Denver%2C+CO%2E)
34. Tillmann, Christoph and Fei Xia. 2003. A phrase-based unigram model for statistical machine translation. In Proceedings of HLT-NAACL - Short Papers, pages 106–108, Edmonton, Alberta, Canada. [find](https://scholar.google.com/scholar?q=Tillmann%2C+Christoph+and+Fei+Xia%2E+2003%2E+A+phrase%2Dbased+unigram+model+for+statistical+machine+translation%2E+In+Proceedings+of+HLT%2DNAACL+%2D+Short+Papers%2C+pages+106%E2%80%93108%2C+Edmonton%2C+Alberta%2C+Canada%2E)
35. Vidal, Enrique. 1997. Finite-state speech-to-speech translation. In Proceedings of 1997 IEEE International Conference on Acoustics, Speech and Signal Processing, pages 111–114, Munich, Germany. [find](https://scholar.google.com/scholar?q=Vidal%2C+Enrique%2E+1997%2E+Finite%2Dstate+speech%2Dto%2Dspeech+translation%2E+In+Proceedings+of+1997+IEEE+International+Conference+on+Acoustics%2C+Speech+and+Signal+Processing%2C+pages+111%E2%80%93114%2C+Munich%2C+Germany%2E)
36. Weaver, Warren. 1955. Translation. In William Locke and A. Donald Booth, editors, Machine Translation of Languages: Fourteen Essays. John Wiley & Sons, New York, pages 15–23. [find](https://scholar.google.com/scholar?q=Weaver%2C+Warren%2E+1955%2E+Translation%2E+In+William+Locke+and+A%2E+Donald+Booth%2C+editors%2C+Machine+Translation+of+Languages%3A+Fourteen+Essays%2E+John+Wiley+%26+Sons%2C+New+York%2C+pages+15%E2%80%9323%2E)
37. Zens, Richard, Franz Joseph Och, and Hermann Ney. 2002. Phrase-based statistical machine translation. In 25th German Conference on Artificial Intelligence, pages 18–32, September. Aachen, Springer Verlag. [find](https://scholar.google.com/scholar?q=Zens%2C+Richard%2C+Franz+Joseph+Och%2C+and+Hermann+Ney%2E+2002%2E+Phrase%2Dbased+statistical+machine+translation%2E+In+25th+German+Conference+on+Artificial+Intelligence%2C+pages+18%E2%80%9332%2C+September%2E+Aachen%2C+Springer+Ver)