--- title: "Restoration of Fragmentary Babylonian Texts Using Recurrent Neural Networks — Fetaya 2020" description: "The authors collect about 2,250 late Babylonian archival texts (legal, economic and administrative) from an… 88.5% accuracy. Cited by 13 papers here." authors: ["Ethan Fetaya", "Yonatan Lifshitz", "Elad Aaron", "Shai Gordin"] year: 2020 venue: "arXiv:2003.01912" source: "https://doi.org/10.1073/pnas.2003794117" doi: "10.1073/pnas.2003794117" arxiv: "2003.01912" licence: "arXiv — non-exclusive license to distribute" licence_url: "http://arxiv.org/licenses/nonexclusive-distrib/1.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/fetaya-2020-restoration-fragmentary-babylonian-texts-using/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/fetaya-2020-restoration-fragmentary-babylonian-texts-using/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/page/4/) / Restoration of Fragmentary Babylonian Texts Using Recurrent Neural Networks # Restoration of Fragmentary Babylonian Texts Using Recurrent Neural Networks **Authors:** Ethan Fetaya; Yonatan Lifshitz; Elad Aaron; [Shai Gordin](https://md.research.elamur.ai/free/en/authors/shai-gordin/) · **Year:** 2020 · **Venue:** arXiv:2003.01912 **Link:** [arxiv.org/abs/2003.01912](https://arxiv.org/abs/2003.01912) · library `langstream-2020-fetaya-restoration-fragmentary-babylonian-texts-using` · **Licence:** [arXiv — non-exclusive license to distribute](https://arxiv.org/licenses/nonexclusive-distrib/1.0/license.html) — summary only (readonly) [**52** citations](https://openalex.org/works?filter=cites:W3010596015) OpenAlex, 2026-10-14 · [**13** citations in our library](https://md.research.elamur.ai/free/en/papers/fetaya-2020-restoration-fragmentary-babylonian-texts-using/cited-by/) of the 140,884 papers whose bibliographies we read · [arXiv:2003.01912](https://openalex.org/S125754415) · [licence](http://arxiv.org/licenses/nonexclusive-distrib/1.0/) - [Publisher's page](https://doi.org/10.1073/pnas.2003794117) - [PDF](https://arxiv.org/pdf/2003.01912) - [DOI 10.1073/pnas.2003794117](https://doi.org/10.1073/pnas.2003794117) - [arXiv 2003.01912](https://arxiv.org/abs/2003.01912) - [OpenAlex](https://openalex.org/W3010596015) **Authors (4)** 1. [Ethan Fetaya](https://openalex.org/A5053007211) [ORCID](https://orcid.org/0000-0003-3125-1665) · [Semantic Scholar](https://www.semanticscholar.org/author/2645055) · h 19 · 1,927 citations · 86 works 2. [Yonatan Lifshitz](https://openalex.org/A5033699566) [Semantic Scholar](https://www.semanticscholar.org/author/1519531835) · h 1 · 52 citations · 1 works 3. [Elad Aaron](https://openalex.org/A5054709431) [Semantic Scholar](https://www.semanticscholar.org/author/1519543737) · h 1 · 52 citations · 1 works 4. [Shai Gordin](https://openalex.org/A5068149720) [ORCID](https://orcid.org/0000-0002-8359-382X) · [Semantic Scholar](https://www.semanticscholar.org/author/117953216) · h 8 · 257 citations · 60 works Citations and author metrics: OpenAlex, 2026-10-14; authors with the same name are not always told apart. ## What it is about Clay tablets from Achaemenid Babylonia are often broken, and experts fill the gaps by hand. The authors collect about 2,250 late Babylonian archival texts (legal, economic and administrative) from an online corpus, tokenise them with a custom Akkadian tokenizer (names, gods, places and months become class tokens; broken parts become a break token; rare words become an unknown token), and train an LSTM language model. The vocabulary has 1,549 types over about 221,000 words. The LSTM reaches a test perplexity of 5.02 against 22.87 for a bigram model. On a cloze test that removes the middle word of test sentences of length 10 or more (166 sentences), the LSTM with full sentence context reaches a mean reciprocal rank of 0.89 and hit@10 of 95.5%, against 0.64 and 83.6% for the bigram. A 52-question multiple-choice test gives 88.5% accuracy, and most errors are semantic, not syntactic. ## Ideas - I2. A transparent baseline first: a bigram model read in both directions (previous and next word) already reaches hit@1 of 52% in the paper. Build it from counts over MACULA before any neural model, and keep it as the reference that any learned ranker must beat. - I3. Class tokens and a break token in the Hebrew tokenizer for fragmentary inscriptions: a token for a damaged span, and for personal names and place names marked by a determinative, so that the model does not spend its vocabulary on them. ## For Mova - I1. A gap-filler for damaged Hebrew and Aramaic text in `tools/hbo`: remove a word, rank candidates from the lexicon and the grammar, and report MRR and hit@k on held-out verses, using the same cloze protocol as the paper. I1 and I2 go into `tools/hbo` as a restoration test, with the bigram counts stored as a table; the neural ranker is not part of the SLM. I3 applies to fragmentary texts in [languages/arc/texts.md](https://mova.elamur.ai/free/en/docs/languages/arc/texts/) and [languages/hbo/09-discourse.md](https://mova.elamur.ai/free/en/docs/languages/hbo/09-discourse/). ## Institutions [🎓**Bar-Ilan University** Ramat Gan · Israel 102 works · 17,587 citations](https://md.research.elamur.ai/free/en/universities/bar-ilan-university/) · [🎓**Weizmann Institute of Science** Rehovot · Israel 7 works · 2,300 citations](https://md.research.elamur.ai/free/en/universities/weizmann-institute-of-science/) · [🎓**Ariel University** Ariel · Israel 8 works · 519 citations](https://md.research.elamur.ai/free/en/universities/ariel-university/) Topics[Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) ## Cite Cite as Ethan Fetaya, Yonatan Lifshitz, Elad Aaron and Shai Gordin. 2020. Restoration of Fragmentary Babylonian Texts Using Recurrent Neural Networks. arXiv:2003.01912. The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.1073/pnas.2003794117](https://doi.org/10.1073/pnas.2003794117) · [arXiv 2003.01912](https://arxiv.org/abs/2003.01912) ```bibtex @misc{fetaya2020restoration, title = {{Restoration of Fragmentary Babylonian Texts Using Recurrent Neural Networks}}, author = {Ethan Fetaya, Yonatan Lifshitz, Elad Aaron and Shai Gordin}, year = {2020}, doi = {10.1073/pnas.2003794117}, eprint = {2003.01912}, archivePrefix = {arXiv}, url = {https://doi.org/10.1073/pnas.2003794117} } ``` - [← previous Multi-Domain Dialogue Acts and Response Co-Generation](https://md.research.elamur.ai/free/en/papers/wang-2020-multi-domain-dialogue-acts-response/) - [next → A Multi-Platform Arabic News Comment Dataset for Offensive Language Detection](https://md.research.elamur.ai/free/en/papers/chowdhury-2020-multi-platform-arabic-news-comment/) - [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/page/4/)