---
title: "Tracing Traditions — paper by Muther and Smith (2020)"
description: "The paper addresses automatically finding isnads, the chains of transmitters that classical Arabic authors attach to reports as… 14 references."
authors: ["Ryan Muther", "David Smith"]
year: 2020
venue: "Proceedings of the Fifth Arabic Natural Language Processing Workshop"
source: "https://aclanthology.org/2020.wanlp-1.12/"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/muther-2020-tracing-traditions-automatic-extraction-isnads/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/muther-2020-tracing-traditions-automatic-extraction-isnads/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/page/11/) / Tracing Traditions: Automatic Extraction of Isnads from Classical Arabic Texts

# Tracing Traditions: Automatic Extraction of Isnads from Classical Arabic Texts

**Authors:** Ryan Muther and [David Smith](https://md.research.elamur.ai/free/en/authors/david-smith/) · **Year:** 2020 · **Venue:** [Proceedings of the Fifth Arabic Natural Language Processing Workshop](https://md.research.elamur.ai/free/en/venues/wanlp/) ([WANLP 2020](https://md.research.elamur.ai/free/en/venues/wanlp/2020/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2020.wanlp-1.12/) · [PDF](https://aclanthology.org/2020.wanlp-1.12.pdf) · [OpenAlex](https://openalex.org/W3120418856)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
The paper addresses automatically finding isnads, the chains of transmitters that classical Arabic authors attach to reports as a kind of citation. Isnads are hard to spot because the texts are long, mostly unpunctuated, and the chains blend into the surrounding prose. The authors annotated a training set drawn from the OpenITI corpus. They built it iteratively: a CRF pre-tagged new texts, and experts corrected the output. Two approaches were compared. The first labels every token of a whole document in a single pass. The second, a "retrieve-and-tag" pipeline, first retrieves short chunks likely to contain an isnad start and then runs a sequence tagger only on those chunks. Whole-document neural tagging was limited by memory and by weak modeling of very long inputs. The retrieval-plus-LSTM pipeline beat both a naïve baseline and a token-feature CRF at locating isnad start points, though its absolute scores remain modest. The work is a first step toward mapping, at scale, the social network of scholars who shaped the Arabic written tradition.

## Key points
- Data source is the OpenITI corpus: 4,285 classical Arabic texts, about 1.5 billion words, with the longest single text over 112 million words. Existing punctuation was stripped and orthography was normalized.
- The labeled set covers 50 texts and 163 tagged regions. It contains 907,110 tokens with 3,071 isnads, which average 31.9 tokens each. Sources include hadith, history, tafsir, geography and literature.
- Five expert annotators labeled the same text (2,000 lines) for an inter-annotator agreement study, reaching Krippendorff's α = 0.84. All annotators agreed on span starts 70% of the time but on span ends only 53% of the time. Large outliers came mostly from merging adjacent isnads, and about 3% of isnads start right after another one ends.
- Results for isnad start detection (P/R/F1, micro-averaged over ten document-level splits):

  | Model | Precision | Recall | F1 |
  |---|---|---|---|
  | Naïve baseline | .188 | .378 | .219 |
  | CRF (Tokens) | .475 | .422 | .432 |
  | Retrieval-LSTM | .571 | .442 | .476 |

  Retrieval uses 75-token chunks weighted by TFIDF.
- Planned future work includes a span model for isnad endpoints, transmissive-term gazetteers and NER features, and linking names into a transmitter network with help from biographical dictionaries.

## Interesting ideas
- The annotation loop has a model pre-tag text, and experts correct it; the experts then pick the next texts to annotate specifically where the model fails, such as student lists in biographies that the model mistook for chains. This produces targeted negative examples rather than random extra data.
- When a target span is rare in a huge document, the work can be split into two stages: a cheap first pass narrows the text to candidate windows, and a precise tagger then runs only inside them. This avoids memory blow-ups and the dilution that comes from tagging everything.
- Agreement was measured separately for span starts and span ends, which showed that end boundaries and adjacent-span splits are inherently fuzzy even for experts. This calibrates how strictly a model should be scored on each boundary.
- An isnad is essentially a nested chain of reports, where one person relayed what another said. The authors chose to keep this surrounding structure rather than just tagging names, because later network inference depends on the links between people.
- Train/test splits were made at the document level, so chunks of one tagged section never appear on both sides. This prevents leakage when the data is sliced into small windows.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (learn): Silver-data rounds could choose the next batch by clustering witness-parser disagreements and model errors, adding deliberate near-miss negatives instead of sampling sentences uniformly.
- **I2** (answer): QA over long tales could first pick candidate passages using structural cues already in the world model (entities mentioned, event order), then run full frame-level reasoning only there, with the selection step logged so it stays explainable.
- **I3** (learn): Evaluation of span-like outputs (argument spans, quoted-speech extents) could report left and right boundary accuracy separately and use human agreement as a ceiling, so boundary noise isn't misread as model failure.
- **I4** (frames): Reported-speech handling could model attribution chains explicitly (A said that B said that C did X), with each layer a speech-act frame, so the world stage knows who vouches for which claim.
- **I5** (learn): Any chunked or sentence-level training data drawn from the same story or treebank document should be split by source document so evaluation scores aren't inflated.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [📚 Literature and Literary Theory](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/literature-and-literary-theory/) · 541 works

🧭 Topics (1): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 3,066 works

## Cite

Cite as: Ryan Muther and David Smith. 2020. Tracing Traditions: Automatic Extraction of Isnads from Classical Arabic Texts. Proceedings of the Fifth Arabic Natural Language Processing Workshop.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{muther2020tracing,
  title = {{Tracing Traditions: Automatic Extraction of Isnads from Classical Arabic Texts}},
  author = {Ryan Muther and David Smith},
  booktitle = {Proceedings of the Fifth Arabic Natural Language Processing Workshop},
  year = {2020},
  url = {https://aclanthology.org/2020.wanlp-1.12/}
}
```

- [← previous Toward Givenness Hierarchy Theoretic Natural Language Generation](https://md.research.elamur.ai/free/en/papers/pal-2020-toward-givenness-hierarchy-theoretic-natural/)
- [next → Transitivity and intransitivity in the grammar of Bar Hebraeus](https://md.research.elamur.ai/free/en/papers/bohas-2020-transitivite-et-intransitivite-dans-la/)
- [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/page/11/)

## References

14 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Abū Dāwūd Sulaymān b. Dāwūd al-Ṭayālisī (d. 204AH/819CE), Musnad Abī Dāwūd al-Ṭayālisī, Muḥammad b. ʿAbd al-Muḥasin al-Turkī ed., (Cairo: Dār al-Hijr, 1999), vol. 2, 223-4. [find](https://scholar.google.com/scholar?q=Abu%CC%84+Da%CC%84wu%CC%84d+Sulayma%CC%84n+b%2E+Da%CC%84wu%CC%84d+al%2DT%CC%A3aya%CC%84lisi%CC%84+%28d%2E+204AH%2F819CE%29%2C+Musnad+Abi%CC%84+Da%CC%84wu%CC%84d+al%2DT%CC%A3aya%CC%84lisi%CC%84%2C+Muh%CC%A3ammad+b%2E+%CA%BFAbd+al%2DMuh%CC%A3asin+al%2DTurki%CC%84+ed%2E%2C+%28Cairo%3A+Da%CC%84r+al%2DHijr%2C+1999%29%2C+vol%2E+2%2C+223%2D4%2E)
2. Altammami, Shatha, Atwell, Eric, and Alsalka, Ammar. 2019. Text Segmentation Using N-grams to Annotate Hadith Corpus. In Proceedings of the 3rd Workshop on Arabic Corpus Linguistics, 31-39. ACL. [find](https://scholar.google.com/scholar?q=Altammami%2C+Shatha%2C+Atwell%2C+Eric%2C+and+Alsalka%2C+Ammar%2E+2019%2E+Text+Segmentation+Using+N%2Dgrams+to+Annotate+Hadith+Corpus%2E+In+Proceedings+of+the+3rd+Workshop+on+Arabic+Corpus+Linguistics%2C+31%2D39%2E+ACL%2E)
3. Harrag, Fouzi. 2014. Text mining approach for knowledge extraction in Sahıh al-Bukhari. Computers in Human Behavior, 30:558–566. [find](https://scholar.google.com/scholar?q=Harrag%2C+Fouzi%2E+2014%2E+Text+mining+approach+for+knowledge+extraction+in+Sah%C4%B1h+al%2DBukhari%2E+Computers+in+Human+Behavior%2C+30%3A558%E2%80%93566%2E)
4. Foley, John. 2018. Poetry: Identification, Entity Recognition, and Retrieval. Doctoral dissertation. University of Massachusetts Amherst, Amherst, USA. [find](https://scholar.google.com/scholar?q=Foley%2C+John%2E+2018%2E+Poetry%3A+Identification%2C+Entity+Recognition%2C+and+Retrieval%2E+Doctoral+dissertation%2E+University+of+Massachusetts+Amherst%2C+Amherst%2C+USA%2E)
5. Graves, Alex and Schmidhuber, Jurgen. 2005. “Framewise phoneme classification with bidirectional LSTM networks.” In Proc. IJCNN. [find](https://scholar.google.com/scholar?q=Graves%2C+Alex+and+Schmidhuber%2C+Jurgen%2E+2005%2E+%E2%80%9CFramewise+phoneme+classification+with+bidirectional+LSTM+networks%2E%E2%80%9D+In+Proc%2E+IJCNN%2E)
6. Hochreiter, Sepp and Schmidhuber, Jürgen 1997. "Long short-term memory". Neural Computation. 9 (8): 1735– 1780. doi:10.1162/neco.1997.9.8.1735. [↗](https://doi.org/10.1162/neco.1997.9.8.1735)
7. Lafferty, John, A. McCallum, and F. Pereira. 2001. “Conditional Random Field: Probabilistic Models for Segmenting and Labeling Sequence Data.” In ICML 18. [find](https://scholar.google.com/scholar?q=Lafferty%2C+John%2C+A%2E+McCallum%2C+and+F%2E+Pereira%2E+2001%2E+%E2%80%9CConditional+Random+Field%3A+Probabilistic+Models+for+Segmenting+and+Labeling+Sequence+Data%2E%E2%80%9D+In+ICML+18%2E)
8. Lample, Guillaume, Ballesteros, Miguel, Subramanian, Sandeep, Kawakami, Kazuya, and Dyer, Chris. 2016. “[Neural Architectures for Named Entity Recognition](https://md.research.elamur.ai/free/en/papers/lample-2016-neural-architectures-named-entity-recognition/).” In Proceedings of NAACL 2016.
9. Lorang, Elizabeth, Soh, Leen-Kiat, Datla, Maanas Varma, and Kulwicki, Spencer. 2015. “Developing an Image-Based Classifier for Detecting Poetic Content in Historic Newspaper Collections.” In The Magazine of Digital Library Research 15(7). DOI: 10.1045/july2015-lorang. [↗](https://doi.org/10.1045/july2015-lorang)
10. Maraoui, Hajer, Haddar, Kais, and Romary, Laurent. 2018. “Segmentation tool for hadith corpus to generate TEI encoding.” In International Conference on Advanced Intelligent Systems and Informatics, 252–260. Springer. [find](https://scholar.google.com/scholar?q=Maraoui%2C+Hajer%2C+Haddar%2C+Kais%2C+and+Romary%2C+Laurent%2E+2018%2E+%E2%80%9CSegmentation+tool+for+hadith+corpus+to+generate+TEI+encoding%2E%E2%80%9D+In+International+Conference+on+Advanced+Intelligent+Systems+and+Informatics%2C+25)
11. Pennington, Jeffrey, Socher, Richard and Manning, Christopher D. 2014. “[GloVe: Global Vectors for Word Representation](https://md.research.elamur.ai/free/en/papers/pennington-2014-glove-global-vectors-word-representation/).” In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP).
12. Ritter, Alan, Clark, Sam, Mausam and Etzioni, Oren. 2011. “[Named Entity Recognition in Tweets: An Experimental Study](https://md.research.elamur.ai/free/en/papers/ritter-2011-named-entity-recognition-tweets-experimental/).” Romanov, Maxim & Seydi, Masoumeh. (2019). OpenITI: A Machine-Readable Corpus of Islamicate Texts (Version 2019.1.1) [Data set].
13. Siddiqui, Muazzam, Saleh, Mostafa, and Bagais, Ahmed. 2014. Extraction and visualization of the chain of narrators from hadiths using named entity recognition and classification. Int. J. Comput. Linguist. Res, 5(1):14– 25. [find](https://scholar.google.com/scholar?q=Siddiqui%2C+Muazzam%2C+Saleh%2C+Mostafa%2C+and+Bagais%2C+Ahmed%2E+2014%2E+Extraction+and+visualization+of+the+chain+of+narrators+from+hadiths+using+named+entity+recognition+and+classification%2E+Int%2E+J%2E+Comput%2E+Lingu)
14. Tjong Kim Sang, Erik F. and De Meulder, Fien. (2003) “[Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition](https://md.research.elamur.ai/free/en/papers/sang-2003-introduction-conll-2003-shared-task/).” In Proceedings of CoNLL-2003.

*Updated 2 November 2026*