---
title: "Application of corpus-based techniques to Amharic texts (2003)"
description: "The authors look for ways to speed up lexicon building for Amharic. 15 references, cited by 3 papers here."
authors: ["Sisay Fissaha", "Johann Haller"]
year: 2003
venue: "Workshop on Machine Translation for Semitic languages: issues and approaches"
source: "https://aclanthology.org/2003.mtsummit-semit.7/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/fissaha-2003-application-corpus-based-techniques-amharic/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/fissaha-2003-application-corpus-based-techniques-amharic/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2003](https://md.research.elamur.ai/free/en/papers/2003/) / Application of corpus-based techniques to Amharic texts

# Application of corpus-based techniques to Amharic texts

**Authors:** Sisay Fissaha and Johann Haller · **Year:** 2003 · **Venue:** [Workshop on Machine Translation for Semitic languages: issues and approaches](https://md.research.elamur.ai/free/en/venues/mtsummit/) ([Machine Translation Summit (MT Summit) 2003](https://md.research.elamur.ai/free/en/venues/mtsummit/2003/)) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/2003.mtsummit-semit.7/) · [PDF](https://aclanthology.org/2003.mtsummit-semit.7.pdf) · [OpenAlex](https://openalex.org/W3211403070)

**Citations:** 5 citations (OpenAlex, 2026-10-14) · [3](https://md.research.elamur.ai/free/en/papers/fissaha-2003-application-corpus-based-techniques-amharic/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
The authors look for ways to speed up lexicon building for Amharic. Amharic is a Semitic language with rich root-and-pattern morphology and very few NLP tools. The work belongs to a project that adds Amharic to the transfer-based CAT2 machine translation system, which needs an English–Amharic transfer lexicon.

Because no robust Amharic parser or morphological analyser existed, they did not adapt the linguistically heavy AUTOTERM term extractor. They chose a mostly statistical approach instead. They took 720,000 words of newspaper text in SERA transliteration and scored contiguous word pairs with the log-likelihood ratio. The strongest pairs were merged into single units, and this was repeated until no significant associations remained. This produced names, compounds, multiword function expressions and non-compositional phrases suitable for the lexicon. Patterns seen in a small hand-collected idiom sample also let them harvest many more idioms. A pilot study grouped words by part of speech from morphological features. Supervised classification beat the majority-class baseline, while k-means clustering did not. Overall, cheap corpus statistics prove useful for a low-resource language, but full morphological analysis remains necessary.

## Key points
- The corpus has 720,000 words of Amharic newspaper text. It is encoded in the SERA Latin transliteration, which, like the native script, does not mark gemination.
- Bigram association was measured with the log-likelihood ratio and applied iteratively to grow tri-grams. Top results include adis abäba ('Addis Ababa'), mkr bet ('Council'), ngd mkr bet ('Chamber of Commerce') and qalä mləls ('interview').
- A small test searched for discontinuous pairs within a 5-word window. It found the month…qän ('day') pattern, which follows from the Amharic date format.
- Three inflected variants of Addis Ababa appear among the top 20 candidates. Stripping common prefixes and suffixes helped only slightly, because much grammatical information is encoded by stem-internal changes.
- The part-of-speech pilot represented words by recurring prefixes, suffixes, CV templates and vowel patterns. Classification under 10-fold cross-validation beat the 54% majority baseline; k-means did not. Adjectives and adverbs were often mislabelled as nouns.

## Interesting ideas
- Strong word pairs are fused into one token and association is recomputed, so longer fixed expressions grow step by step without a parser.
- A handful of manually gathered idioms showed formation patterns, such as repeated word sequences and words that often occur in idioms, which then served as filters to find many more.
- Seeing several inflected forms of one name crowd the top list is a cheap signal of data sparsity. It also measures how much shallow affix stripping actually recovers.
- Every unsupervised or supervised result is reported against the trivial most-frequent-class baseline, which exposed that clustering added nothing.
- Searching for collocations with gaps inside a small window revealed a fixed date template rather than just adjacent pairs.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (tokens): A similar loop over a large English corpus could propose multiword units such as "on the other hand" for the tokenizer and lemma lexicon, each with a logged score as its explanation.
- **I2** (frames): Seed patterns could mark English candidates as possibly non-compositional, so the frame builder does not assign literal roles to idioms.
- **I3** (learn): Checking whether top-ranked items collapse after lemmatization could serve as a diagnostic of whether normalization in a pipeline stage is doing real work.
- **I4** (learn): Requiring a majority-class baseline next to each new tagger or classifier score acts as a simple negative control against illusory gains.
- **I5** (world): Mining gapped co-occurrences could uncover recurring templates for dates, amounts and measures that map directly onto typed values in the world model.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,552 works · [💭 Developmental and Educational Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/developmental-and-educational-psychology/) · 499 works

🧭 Topics (3): [🔁 Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/) · 1,087 works · [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 2,908 works · [🧩 Morphology](https://md.research.elamur.ai/free/en/topics/morphology/) · 405 works

## Cite

Cite as: Sisay Fissaha and Johann Haller. 2003. Application of corpus-based techniques to Amharic texts. Workshop on Machine Translation for Semitic languages: issues and approaches.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{fissaha2003application,
  title = {{Application of corpus-based techniques to Amharic texts}},
  author = {Sisay Fissaha and Johann Haller},
  booktitle = {Workshop on Machine Translation for Semitic languages: issues and approaches},
  year = {2003},
  url = {https://aclanthology.org/2003.mtsummit-semit.7/}
}
```

- [← previous A low-complexity, broad-coverage probabilistic Dependency Parser for English](https://md.research.elamur.ai/free/en/papers/schneider-2003-low-complexity-broad-coverage-probabilistic/)
- [next → Discourse Chunking: A Tool in Dialogue Act Tagging](https://md.research.elamur.ai/free/en/papers/midgley-2003-discourse-chunking-tool-dialogue-act/)
- [↑ back to papers of 2003](https://md.research.elamur.ai/free/en/papers/2003/)

## References

15 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Abiyot Bayou. 2000. Developing automatic word parser for Amharic verbs and their derivation. Master Thesis. Addis Ababa University. [find](https://scholar.google.com/scholar?q=Abiyot+Bayou%2E+2000%2E+Developing+automatic+word+parser+for+Amharic+verbs+and+their+derivation%2E+Master+Thesis%2E+Addis+Ababa+University%2E)
2. Amsalu Aklilu. 1988. Characteristics of Amharic idiomatic expressions: In Proceedings of the eigth international conference of Ethiopian studies. pp. 571-578 [find](https://scholar.google.com/scholar?q=Amsalu+Aklilu%2E+1988%2E+Characteristics+of+Amharic+idiomatic+expressions%3A+In+Proceedings+of+the+eigth+international+conference+of+Ethiopian+studies%2E+pp%2E+571%2D578)
3. Atelach Alemu, Lars Asker and Mesfin Getachew. 2003. Natural Language Processing for Amharic: Overview and Suggestions for a Way Forward. In Traitement Automatique des Langues Naturelles, Batz-sur-Mer, 11-14 juin 2003 [find](https://scholar.google.com/scholar?q=Atelach+Alemu%2C+Lars+Asker+and+Mesfin+Getachew%2E+2003%2E+Natural+Language+Processing+for+Amharic%3A+Overview+and+Suggestions+for+a+Way+Forward%2E+In+Traitement+Automatique+des+Langues+Naturelles%2C+Batz%2Dsur%2DMer)
4. Béatrice Daille. 1994. Combined approach for terminology extraction: lexical statistics and linguistic filtering. Université Paris VII. [find](https://scholar.google.com/scholar?q=B%C3%A9atrice+Daille%2E+1994%2E+Combined+approach+for+terminology+extraction%3A+lexical+statistics+and+linguistic+filtering%2E+Universit%C3%A9+Paris+VII%2E)
5. Church, K. W., Gale, W., Hanks, P. and Hindle, D. 1991. Using Statistics in Lexical Analysis. In Lexical Acquisition: Exploiting On-Line Resources to Build a Lexicon, Zernik U (ed), Lawrence Erlbaum Associates, pp. 115-164. [find](https://scholar.google.com/scholar?q=Church%2C+K%2E+W%2E%2C+Gale%2C+W%2E%2C+Hanks%2C+P%2E+and+Hindle%2C+D%2E+1991%2E+Using+Statistics+in+Lexical+Analysis%2E+In+Lexical+Acquisition%3A+Exploiting+On%2DLine+Resources+to+Build+a+Lexicon%2C+Zernik+U+%28ed%29%2C+Lawrence+Erlbaum+A)
6. Christopher Manning and Hinrich Schütze. 1999. Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, Massachusetts. [find](https://scholar.google.com/scholar?q=Christopher+Manning+and+Hinrich+Sch%C3%BCtze%2E+1999%2E+Foundations+of+Statistical+Natural+Language+Processing%2E+MIT+Press%2C+Cambridge%2C+Massachusetts%2E)
7. Daniel Yacob. 1996. System for Ethiopic Representation in ASCII (SERA). [http://www.abys](http://www.abys) siniacybergateway.net/fidel/ Eugene Charniak. 1996. Tree-bank grammars. In Proceedings of the Thirteenth National Conference on Artificial Intelligence and the Eighth Innovative Applications of Artificial Intelligence Conference, pp. 1031-1036, Menlo Park. AAAI Press/MIT Press. [↗](http://www.abys)
8. Goldsmith, J. A. 2000. Unsupervised learning of the morphology of a natural language. Computational Linguistics 27(2) pp. 153-198, Kenneth Beesley. 1996. [Arabic finite-state morphological analysis and generation](https://md.research.elamur.ai/free/en/papers/beesley-1996-arabic-finite-state-morphological-analysis/). Computational Linguistics, vol 1, pp 89-94. [↗](https://doi.org/10.1162/089120101750300490)
9. Kita, K., Kato, Y., Omoto, T. and Yano, Y. 1994. Automatically Extracting Collocations from Corpora for Language Learning. In Corpora in Language Education and Research: A Selection of Papers from Talc94, UCREL Technical Papers, Lancaster University, pp. 53-64. [find](https://scholar.google.com/scholar?q=Kita%2C+K%2E%2C+Kato%2C+Y%2E%2C+Omoto%2C+T%2E+and+Yano%2C+Y%2E+1994%2E+Automatically+Extracting+Collocations+from+Corpora+for+Language+Learning%2E+In+Corpora+in+Language+Education+and+Research%3A+A+Selection+of+Papers+from+Tal)
10. Melamed, I. Dan. 1998. Empirical Methods for MT Lexicon Development. In Proceedings of the Third Conference for Machine Translation in the Americas, AMTA’98, Langhorne PA, Springer-Verlag, LNAI 1529, pp. 18-30. [find](https://scholar.google.com/scholar?q=Melamed%2C+I%2E+Dan%2E+1998%2E+Empirical+Methods+for+MT+Lexicon+Development%2E+In+Proceedings+of+the+Third+Conference+for+Machine+Translation+in+the+Americas%2C+AMTA%E2%80%9998%2C+Langhorne+PA%2C+Springer%2DVerlag%2C+LNAI+1529%2C+)
11. Mesfin Getachew. 2001. Automatic part of speech tagging for Amharic language: An experiment using stochastic HMM. Masters Thesis. Addis Ababa University. [find](https://scholar.google.com/scholar?q=Mesfin+Getachew%2E+2001%2E+Automatic+part+of+speech+tagging+for+Amharic+language%3A+An+experiment+using+stochastic+HMM%2E+Masters+Thesis%2E+Addis+Ababa+University%2E)
12. Munpyo Hong, Sisay Fissaha and Johann Haller. 2001. Hybrid Filtering for Extraction of Term Candidates from German Technical Texts, In Proceedings of Terminologie et Intelligence Arteficielle, TIA'2001 [find](https://scholar.google.com/scholar?q=Munpyo+Hong%2C+Sisay+Fissaha+and+Johann+Haller%2E+2001%2E+Hybrid+Filtering+for+Extraction+of+Term+Candidates+from+German+Technical+Texts%2C+In+Proceedings+of+Terminologie+et+Intelligence+Arteficielle%2C+TIA%27200)
13. Nega Alemayehu. 1999. Development of stemming algorithm for Amharic text retrieval. PhD Thesis, University of Sheffield. [find](https://scholar.google.com/scholar?q=Nega+Alemayehu%2E+1999%2E+Development+of+stemming+algorithm+for+Amharic+text+retrieval%2E+PhD+Thesis%2C+University+of+Sheffield%2E)
14. Pierre Isabelle and Laurent Bourbeau. 1984. TAUM-AVIATION: its technical features and some experimental results. Computational Linguistics, 11(1), pp. 18—27. [find](https://scholar.google.com/scholar?q=Pierre+Isabelle+and+Laurent+Bourbeau%2E+1984%2E+TAUM%2DAVIATION%3A+its+technical+features+and+some+experimental+results%2E+Computational+Linguistics%2C+11%281%29%2C+pp%2E+18%E2%80%9427%2E)
15. Smadja, F. A. and McKeown, K. R. 1990 Automatically Extracting and Representing Collocations for Language Generation. In Proceedings of the 28th Annual Meeting of the Association for Computational Linguistics, pp.252-259. [find](https://scholar.google.com/scholar?q=Smadja%2C+F%2E+A%2E+and+McKeown%2C+K%2E+R%2E+1990+Automatically+Extracting+and+Representing+Collocations+for+Language+Generation%2E+In+Proceedings+of+the+28th+Annual+Meeting+of+the+Association+for+Computational+Lin)

*Updated 1 November 2026*
