---
title: "Improved Arabic Base Phrase Chunking with a new enriched"
description: "Diab proposes ERTS, an enriched POS tag set. 15 references, cited by 10 papers here. Among them: 37."
authors: ["Mona Diab"]
year: 2007
venue: "Proceedings of the 2007 Workshop on Computational Approaches to Semitic Languages: Common Issues and Resources"
source: "https://aclanthology.org/W07-0812/"
licence: "CC BY-NC-SA 3.0 (ACL Anthology, before 2016)"
licence_url: "https://creativecommons.org/licenses/by-nc-sa/3.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/diab-2007-improved-arabic-base-phrase-chunking/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/diab-2007-improved-arabic-base-phrase-chunking/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2007](https://md.research.elamur.ai/free/en/papers/2007/) / Improved Arabic Base Phrase Chunking with a new enriched POS tag set

# Improved Arabic Base Phrase Chunking with a new enriched POS tag set

**Authors:** [Mona Diab](https://md.research.elamur.ai/free/en/authors/mona-diab/) · **Year:** 2007 · **Venue:** [Proceedings of the 2007 Workshop on Computational Approaches to Semitic Languages: Common Issues and Resources](https://md.research.elamur.ai/free/en/venues/workshop-on-computational-approaches-to-semitic-languages-common-issues-and/) ([Workshop on Computational Approaches to Semitic Languages: Common Issues and Resources 2007](https://md.research.elamur.ai/free/en/venues/workshop-on-computational-approaches-to-semitic-languages-common-issues-and/2007/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY-NC-SA 3.0 (ACL Anthology, before 2016)](https://creativecommons.org/licenses/by-nc-sa/3.0/)

**Links:** [Publisher's page](https://aclanthology.org/W07-0812/) · [PDF](https://aclanthology.org/W07-0812.pdf) · [OpenAlex](https://openalex.org/W2021333089)

**Citations:** 37 citations (OpenAlex, 2026-10-14) · [10](https://md.research.elamur.ai/free/en/papers/diab-2007-improved-arabic-base-phrase-chunking/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper tackles base phrase chunking (BPC) for Modern Standard Arabic. BPC is a shallow, non-recursive alternative to full parsing, which performed poorly for Arabic at the time. Diab proposes ERTS, an enriched POS tag set. It extends the 25-tag LDC reduced set (RTS) by marking definiteness, gender and number on nominals. These are features that unvowelized Arabic usually shows on the surface. Case, mood and person are left out.

Both the POS tagger and the chunker use the same SVM sequence setup (YAMCHA over TinySVM). Training chunks come from the Arabic Treebank via ChunkLink. Its English-oriented output is corrected with Arabic-specific rules.

The ERTS tagger matches RTS tagging accuracy. In chunking, ERTS gives the best overall score, 96.33 F over 10 chunk types. It beats RTS even when RTS is supplied with explicit morphological features. All conditions clearly surpass the earlier published 91.44. The broader lesson is that the design of the POS inventory strongly affects downstream syntactic processing.

## Key points
- Tag set sizes: FULL ATB morphology has over 2000 tags, RTS has 25, and ERTS has 75, of which 57 actually occur in the data.
- POS tagging accuracy is 96.13% with ERTS and 96.15% with RTS. The tagger uses ±4 character n-grams from word edges, a ±2 word window, a degree-2 polynomial kernel and one-vs-all classification.
- The chunker handles ten phrase categories, which yields 21 IOB classes. The nominal and verbal categories are NP, VP and PREDP. The modifier categories are ADJP and ADVP. The function-word categories are PP, CONJP, PRTP and SBARP. INTJP covers interjections.
- Overall F scores:
  - RTS-noFeat: 95.41
  - RTS-allFeat: 95.97
  - FULL-noFeat: 96.29
  - ERTS-noFeat: 96.33, the best result
  - Adding explicit features to ERTS or FULL lowers scores slightly.
- Best per-type scores all come from ERTS conditions: ADJP 73.16, INTJP 64.29 and NP 94.92. PP exceeds 99 in every condition.

## Interesting ideas
- Build a middle-sized tag inventory from only those morphological features that are reliably visible in surface forms, rather than using either a coarse or an exhaustive set.
- Packing features into the tag itself worked better than passing the same features as separate inputs, which seemed to add noise.
- Treebank-to-chunk conversion tools carry the assumptions of their source language, so the converted output was repaired with target-specific rules (possession constructs, agreeing noun-adjective runs, clitic pronouns).
- A coarser tag set slightly beat the full one, plausibly because dropping inconsistently annotated features hides gold-standard noise.
- Evaluation focused separately on the phrase types the change should affect (ADJP, INTJP, NP), not only on the overall score.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (tokens): The English tagger could get optional enriched tags (e.g., number or a definiteness-like determiner cue) chosen by how observable they are, then be tested on whether the parser gains.
- **I2** (tree): When feeding morphology to the perceptron parser or gparse, compare a combined-tag encoding against separate feature slots instead of assuming that separate is better.
- **I3** (tree): The UD dialect conversion could include a small, explainable rule layer that fixes systematic converter artifacts before training.
- **I4** (learn): When silver or gold labels disagree on some attribute, try masking that attribute during training and check whether the error rate falls.
- **I5** (learn): Each change could report metrics on the constructions it targets, alongside unaffected ones as a negative control.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Columbia University](https://md.research.elamur.ai/free/en/universities/columbia-university/) — University, New York, United States · 241 works · 54,053 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (1): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 2,908 works

## Cite

Cite as: Mona Diab. 2007. Improved Arabic Base Phrase Chunking with a new enriched POS tag set. Proceedings of the 2007 Workshop on Computational Approaches to Semitic Languages: Common Issues and Resources.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{diab2007improved,
  title = {{Improved Arabic Base Phrase Chunking with a new enriched POS tag set}},
  author = {Mona Diab},
  booktitle = {Proceedings of the 2007 Workshop on Computational Approaches to Semitic Languages: Common Issues and Resources},
  year = {2007},
  doi = {10.3115/1654576.1654592},
  url = {https://doi.org/10.3115/1654576.1654592}
}
```

- [← previous Introduction to Arabic Speech Recognition Using CMUSphinx System](https://md.research.elamur.ai/free/en/papers/satori-2007-introduction-arabic-speech-recognition-using/)
- [next → TAT: An Author Profiling Tool with Application to Arabic Emails](https://md.research.elamur.ai/free/en/papers/estival-2007-tat-author-profiling-tool-application/)
- [↑ back to papers of 2007](https://md.research.elamur.ai/free/en/papers/2007/)

## References

15 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Erin L. Allwein, Robert E. Schapire, and Yoram Singer. 2000. Reducing multiclass to binary: A unifying approach for margin classifiers. Journal of Machine Learning Research, 1:113-141. [find](https://scholar.google.com/scholar?q=Erin+L%2E+Allwein%2C+Robert+E%2E+Schapire%2C+and+Yoram+Singer%2E+2000%2E+Reducing+multiclass+to+binary%3A+A+unifying+approach+for+margin+classifiers%2E+Journal+of+Machine+Learning+Research%2C+1%3A113%2D141%2E)
2. Daniel Bikel. 2004. Intricacies of Collins Parser. Computational Linguistics. [find](https://scholar.google.com/scholar?q=Daniel+Bikel%2E+2004%2E+Intricacies+of+Collins+Parser%2E+Computational+Linguistics%2E)
3. Tim Buckwalter. 2002. Buckwalter Arabic Morphological Analyzer Version 1.0. Linguistic Data Consortium, University of Pennsylvania, 2002. LDC Catalog No.: LDC2002L49 [↗](https://doi.org/10.35111/7vzm-mb15)
4. David Chiang, Mona Diab, Nizar Habash, Owen Rambow, and Safiullah Shareef. 2006. [Parsing Arabic Dialects](https://md.research.elamur.ai/free/en/papers/chiang-2006-parsing-arabic-dialects/). Proceedings of the European Chapter of ACL (EACL). [↗](https://doi.org/10.7916/d85t3tzg)
5. Michael Collins. 2000. [Discriminative Reranking for Natural Language Parsing](https://md.research.elamur.ai/free/en/papers/collins-2000-discriminative-reranking-natural-language-parsing/). Proceedings of the 17th International Conference on Machine Learning.
6. Mona Diab, Kadri Hacioglu and Daniel Jurafsky. 2004. [Automatic Tagging of Arabic Text: From Raw Text to Base Phrase Chunks](https://md.research.elamur.ai/free/en/papers/diab-2004-automatic-tagging-arabic-text-raw/). Proceedings of North American Association for Computational Linguistics.
7. Mona Diab, Kadri Hacioglu and Daniel Jurafsky. 2007. Automated Methods for Processing Arabic Text: From Tokenization to Base Phrase Chunking. Book Chapter. In Arabic Computational Morphology: Knowledge-based and Empirical Methods. Editors Antal van den Bosch and Abdelhadi Soudi. Kluwer/Springer Publications. [find](https://scholar.google.com/scholar?q=Mona+Diab%2C+Kadri+Hacioglu+and+Daniel+Jurafsky%2E+2007%2E+Automated+Methods+for+Processing+Arabic+Text%3A+From+Tokenization+to+Base+Phrase+Chunking%2E+Book+Chapter%2E+In+Arabic+Computational+Morphology%3A+Knowledg)
8. Nizar Habash and Owen Rambow. 2005. Arabic Tokenization, Morphological Analysis, and Part-of-Speech Tagging in One Fell Swoop. Proceedings of the Conference of American Association for Computational Linguistics (ACL). [find](https://scholar.google.com/scholar?q=Nizar+Habash+and+Owen+Rambow%2E+2005%2E+Arabic+Tokenization%2C+Morphological+Analysis%2C+and+Part%2Dof%2DSpeech+Tagging+in+One+Fell+Swoop%2E+Proceedings+of+the+Conference+of+American+Association+for+Computational+L)
9. Kadri Hacioglu and Wayne Ward. 2003. Target word Detection and semantic role chunking using support vector machines. HLT-NAACL. [find](https://scholar.google.com/scholar?q=Kadri+Hacioglu+and+Wayne+Ward%2E+2003%2E+Target+word+Detection+and+semantic+role+chunking+using+support+vector+machines%2E+HLT%2DNAACL%2E)
10. Thorsten Joachims. 1998. [Text Categorization with Support Vector Machines: Learning with Many Relevant Features](https://md.research.elamur.ai/free/en/papers/joachims-1998-text-categorization-support-vector-machines/). Proc. of ECML-98, 10th European Conf. on Machine Learning. [↗](https://doi.org/10.17877/de290r-5097)
11. Seth Kulick, Ryan Gabbard, and Mitch Marcus. 2006. Parsing the Arabic Treebank: Analysis and Improvements. in Treebanks and Linguistic Theories. [find](https://scholar.google.com/scholar?q=Seth+Kulick%2C+Ryan+Gabbard%2C+and+Mitch+Marcus%2E+2006%2E+Parsing+the+Arabic+Treebank%3A+Analysis+and+Improvements%2E+in+Treebanks+and+Linguistic+Theories%2E)
12. Taku Kudo and Yuji Matsumato. 2000. Use of support vector learning for chunk identification. Proc. of the 4th Conf. on Very Large Corpora, pages 142-144. [find](https://scholar.google.com/scholar?q=Taku+Kudo+and+Yuji+Matsumato%2E+2000%2E+Use+of+support+vector+learning+for+chunk+identification%2E+Proc%2E+of+the+4th+Conf%2E+on+Very+Large+Corpora%2C+pages+142%2D144%2E)
13. Mohamed Maamouri, Ann Bies, Tim Buckwalter, and Wigdan Mekki. 2004. The Penn Arabic Treebank : Building a Large-Scale Annota ted Arabic Corpus. NEMLAR Conference on Arabic Language Resources and Tools. pp. 102-109. [find](https://scholar.google.com/scholar?q=Mohamed+Maamouri%2C+Ann+Bies%2C+Tim+Buckwalter%2C+and+Wigdan+Mekki%2E+2004%2E+The+Penn+Arabic+Treebank+%3A+Building+a+Large%2DScale+Annota+ted+Arabic+Corpus%2E+NEMLAR+Conference+on+Arabic+Language+Resources+and+Tools)
14. Lance A. Ramshaw and Mitchell P. Marcus. 1995. [Text Chunking using transformational based learning](https://md.research.elamur.ai/free/en/papers/sang-2000-introduction-conll-2000-shared-task/). Proc. of the 3rd ACL workshop on Very Large Corpora Erik Tjong, Kim Sang, and Sabine Buchholz. 2000. Introduction to the CoNLL-2000 shared task: Chunking. Proc. of the 4th Conf. on Computational Natural Language Learning (CoNLL), Lisbon, Portugal, 2000, pp. 127-132.
15. Vladamir Vapnik. 1995. The Nature of Statistical Learning Theory. Springer Verlag, New York, USA. [↗](https://doi.org/10.1007/978-1-4757-2440-0)

*Updated 1 November 2026*