--- title: "Restoration of Fragmentary Babylonian Texts — Fetaya 2020" description: "Clay tablets from Achaemenid Babylonia are often broken, and experts fill the gaps by hand. The authors collect about 2,250 late Babylonian archival texts…" authors: ["Ethan Fetaya", "Yonatan Lifshitz", "Elad Aaron", "Shai Gordin"] year: 2020 venue: "arXiv:2003.01912" source: "https://doi.org/10.1073/pnas.2003794117" doi: "10.1073/pnas.2003794117" arxiv: "2003.01912" licence: "arXiv — non-exclusive license to distribute" licence_url: "http://arxiv.org/licenses/nonexclusive-distrib/1.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/langstream-2020-fetaya-restoration-fragmentary-babylonian-texts-using/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/langstream-2020-fetaya-restoration-fragmentary-babylonian-texts-using/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/page/4/) / Restoration of Fragmentary Babylonian Texts Using Recurrent Neural Networks # Restoration of Fragmentary Babylonian Texts Using Recurrent Neural Networks **Authors:** Ethan Fetaya; Yonatan Lifshitz; Elad Aaron; [Shai Gordin](https://md.research.elamur.ai/free/en/authors/shai-gordin/) · **Year:** 2020 · **Venue:** arXiv:2003.01912 **Link:** [arxiv.org/abs/2003.01912](https://arxiv.org/abs/2003.01912) · library `langstream-2020-fetaya-restoration-fragmentary-babylonian-texts-using` · **Licence:** [arXiv — non-exclusive license to distribute](https://arxiv.org/licenses/nonexclusive-distrib/1.0/license.html) — summary only (readonly) **Institutions:** [Bar-Ilan University](https://md.research.elamur.ai/free/en/universities/bar-ilan-university/) · [Weizmann Institute of Science](https://md.research.elamur.ai/free/en/universities/weizmann-institute-of-science/) · [Ariel University](https://md.research.elamur.ai/free/en/universities/ariel-university/) [**52** citations](https://openalex.org/works?filter=cites:W3010596015) OpenAlex, 2026-10-14 · [**13** citations in our library](https://md.research.elamur.ai/free/en/papers/langstream-2020-fetaya-restoration-fragmentary-babylonian-texts-using/cited-by/) of the 140884 papers whose bibliographies we read · [arXiv:2003.01912](https://openalex.org/S125754415) · [licence](http://arxiv.org/licenses/nonexclusive-distrib/1.0/) - [Publisher's page](https://doi.org/10.1073/pnas.2003794117) - [PDF](https://arxiv.org/pdf/2003.01912) - [DOI 10.1073/pnas.2003794117](https://doi.org/10.1073/pnas.2003794117) - [arXiv 2003.01912](https://arxiv.org/abs/2003.01912) - [OpenAlex](https://openalex.org/W3010596015) **Authors (4)** 1. [Ethan Fetaya](https://openalex.org/A5053007211) [ORCID](https://orcid.org/0000-0003-3125-1665) · [Semantic Scholar](https://www.semanticscholar.org/author/2645055) · h 19 · 1927 citations · 86 works 2. [Yonatan Lifshitz](https://openalex.org/A5033699566) [Semantic Scholar](https://www.semanticscholar.org/author/1519531835) · h 1 · 52 citations · 1 works 3. [Elad Aaron](https://openalex.org/A5054709431) [Semantic Scholar](https://www.semanticscholar.org/author/1519543737) · h 1 · 52 citations · 1 works 4. [Shai Gordin](https://openalex.org/A5068149720) [ORCID](https://orcid.org/0000-0002-8359-382X) · [Semantic Scholar](https://www.semanticscholar.org/author/117953216) · h 8 · 257 citations · 60 works Citations and author metrics: OpenAlex, 2026-10-14; authors with the same name are not always told apart. ## What it is about Clay tablets from Achaemenid Babylonia are often broken, and experts fill the gaps by hand. The authors collect about 2,250 late Babylonian archival texts (legal, economic and administrative) from an online corpus, tokenise them with a custom Akkadian tokenizer (names, gods, places and months become class tokens; broken parts become a break token; rare words become an unknown token), and train an LSTM language model. The vocabulary has 1,549 types over about 221,000 words. The LSTM reaches a test perplexity of 5.02 against 22.87 for a bigram model. On a cloze test that removes the middle word of test sentences of length 10 or more (166 sentences), the LSTM with full sentence context reaches a mean reciprocal rank of 0.89 and hit@10 of 95.5%, against 0.64 and 83.6% for the bigram. A 52-question multiple-choice test gives 88.5% accuracy, and most errors are semantic, not syntactic. ## Ideas - I1. A gap-filler for damaged Hebrew and Aramaic text in `tools/hbo`: remove a word, rank candidates from the lexicon and the grammar, and report MRR and hit@k on held-out verses, using the same cloze protocol as the paper. - I2. A transparent baseline first: a bigram model read in both directions (previous and next word) already reaches hit@1 of 52% in the paper. Build it from counts over MACULA before any neural model, and keep it as the reference that any learned ranker must beat. - I3. Class tokens and a break token in the Hebrew tokenizer for fragmentary inscriptions: a token for a damaged span, and for personal names and place names marked by a determinative, so that the model does not spend its vocabulary on them. ## For Mova I1 and I2 go into `tools/hbo` as a restoration test, with the bigram counts stored as a table; the neural ranker is not part of the SLM. I3 applies to fragmentary texts in [languages/arc/texts.md](https://mova.elamur.ai/free/en/docs/languages/arc/texts/) and [languages/hbo/09-discourse.md](https://mova.elamur.ai/free/en/docs/languages/hbo/09-discourse/). Topics: [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) ## Cite The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.1073/pnas.2003794117](https://doi.org/10.1073/pnas.2003794117) · [arXiv 2003.01912](https://arxiv.org/abs/2003.01912) ```bibtex @misc{fetaya2020restoration, title = {{Restoration of Fragmentary Babylonian Texts Using Recurrent Neural Networks}}, author = {Fetaya, Ethan and Lifshitz, Yonatan and Aaron, Elad and Gordin, Shai}, year = {2020}, doi = {10.1073/pnas.2003794117}, eprint = {2003.01912}, archivePrefix = {arXiv}, url = {https://doi.org/10.1073/pnas.2003794117} } ``` - [← previous Multi-Domain Dialogue Acts and Response Co-Generation](https://md.research.elamur.ai/free/en/papers/wang-2020-multi-domain-dialogue-acts-response/) - [next → A Multi-Platform Arabic News Comment Dataset for Offensive Language Detection](https://md.research.elamur.ai/free/en/papers/chowdhury-2020-multi-platform-arabic-news-comment/) - [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/page/4/)