--- title: "OtoBERT: Identifying Suffixed Verbal Forms in Modern Hebrew Literature — Shmidman 2024" description: "Modern Hebrew literature sometimes fuses a verb with its direct-object pronoun into one word. 10 references." authors: ["Avi Shmidman", "Shaltiel Shmidman"] year: 2024 venue: "Proceedings of the Third Workshop on Text Simplification, Accessibility and Readability (TSAR 2024)" source: "https://aclanthology.org/2024.tsar-1.2/" doi: "10.18653/v1/2024.tsar-1.2" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/shmidman-2024-otobert-identifying-suffixed-verbal-forms/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/shmidman-2024-otobert-identifying-suffixed-verbal-forms/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/6/) / OtoBERT: Identifying Suffixed Verbal Forms in Modern Hebrew Literature # OtoBERT: Identifying Suffixed Verbal Forms in Modern Hebrew Literature **Authors:** [Avi Shmidman](https://md.research.elamur.ai/free/en/authors/avi-shmidman/) and [Shaltiel Shmidman](https://md.research.elamur.ai/free/en/authors/shaltiel-shmidman/) · **Year:** 2024 · **Venue:** Proceedings of the Third Workshop on Text Simplification, Accessibility and Readability (TSAR 2024) **Link:** [aclanthology.org/2024.tsar-1.2](https://aclanthology.org/2024.tsar-1.2/) · library `aclbulk-2024-shmidman-otobert-identifying-suffixed-verbal-forms` · **Licence:** [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) [**0** citations](https://openalex.org/works?filter=cites:W4404780822) OpenAlex, 2026-10-14 · [Proceedings of the Third Workshop on Text Simplification, Accessibility and Readability (TSAR 2024)](https://aclanthology.org/volumes/2024.tsar-1/) · [licence](https://creativecommons.org/licenses/by/4.0/) - [Publisher's page](https://aclanthology.org/2024.tsar-1.2/) - [PDF](https://aclanthology.org/2024.tsar-1.2.pdf) - [DOI 10.18653/v1/2024.tsar-1.2](https://doi.org/10.18653/v1/2024.tsar-1.2) - [OpenAlex](https://openalex.org/W4404780822) **Authors (2)** 1. [Avi Shmidman](https://openalex.org/A5013212409) [Semantic Scholar](https://www.semanticscholar.org/author/3361477) · h 5 · 114 citations · 53 works 2. [Shaltiel Shmidman](https://openalex.org/A5041361841) [Semantic Scholar](https://www.semanticscholar.org/author/1680059376) · h 3 · 27 citations · 21 works Citations and author metrics: OpenAlex, 2026-10-14; authors with the same name are not always told apart. ## What it is about Modern Hebrew literature sometimes fuses a verb with its direct-object pronoun into one word. The fused form is often identical to a common verb with another meaning, so readers are misled until the sentence ends. Annotators found 222 suffixed verbs in 135K words of literature (17.76 per 10K) against 7 in 185K words of news and 2 in 43K words of another news source; 64 of the literary cases were ambiguous. The authors pretrain a BERT-base model from scratch with a 128K vocabulary in which each verb-plus-pronoun pair is one token. A form is flagged when at least N of the top K masked-language-model predictions are such tokens. Tested on 2,589 unsuffixed and 264 suffixed homographs, K = 1000 gives precision 100% at N = 25 (recall 19%), 84% at N = 10 (recall 52%) and 54% at N = 5 (recall 74%). Fine-tuned classifiers on mBERT, AlephBERT and DictaBERT reach F1 0.39–0.58, and the DictaBERT morphological tagger has recall of 24%. The model and dataset are public; the model is Apache-licensed as stated in the paper. ## Ideas - I1. Paired readings in the lexicon: for each ambiguous form, store both analyses (a bare verb, and a verb with a person-gender object clitic) with the clitic's features. The paper's examples ("they ordered" against "he ordered it") make good seed pairs. In UD this is a verb with a pronoun object merged in the surface form, so the segmenter has to split it. - I3. A held-out test: the 264 suffixed and 2,589 unsuffixed homographs are a clean test for the Modern Hebrew parser, and the paper's own tagger result (recall 24%) is a baseline to beat. Check the dataset's licence before use, because the text does not state it. ## For Mova - I2. Confidence tiers with a stated precision: the paper's thresholds give three tiers (precision 100%, 84%, 54%), each with a fixed hedge in the gloss ("likely", "perhaps"). Mova can output the same three tiers with the rule that fired, so the gloss says why. I1 goes into [languages/he/05b-verb-paradigms.md](https://mova.elamur.ai/free/en/docs/languages/he/05b-verb-paradigms/) (paired readings) and [languages/he/05-verbs.md](https://mova.elamur.ai/free/en/docs/languages/he/05-verbs/) (object clitics). I2 is an explanation rule in `prag`. I3 is a test for [languages/he/11-ud-analysis.md](https://mova.elamur.ai/free/en/docs/languages/he/11-ud-analysis/). Topics[Hebrew & Aramaic](https://md.research.elamur.ai/free/en/topics/hebrew-aramaic/) · [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) ## Cite Cite as Avi Shmidman and Shaltiel Shmidman. 2024. OtoBERT: Identifying Suffixed Verbal Forms in Modern Hebrew Literature. Proceedings of the Third Workshop on Text Simplification, Accessibility and Readability (TSAR 2024). The paper itself, not this card. BibTeX from the library's record of the work. [DOI 10.18653/v1/2024.tsar-1.2](https://doi.org/10.18653/v1/2024.tsar-1.2) ```bibtex @inproceedings{shmidman2024otobert, title = {{OtoBERT: Identifying Suffixed Verbal Forms in Modern Hebrew Literature}}, author = {Avi Shmidman and Shaltiel Shmidman}, booktitle = {Proceedings of the Third Workshop on Text Simplification, Accessibility and Readability (TSAR 2024)}, year = {2024}, doi = {10.18653/v1/2024.tsar-1.2}, url = {https://doi.org/10.18653/v1/2024.tsar-1.2} } ``` - [← previous On the importance of Data Scale in Pretraining Arabic Language Models](https://md.research.elamur.ai/free/en/papers/ghaddar-2024-importance-data-scale-pretraining-arabic/) - [next → Performance and Challenges of InstructGPT in Named Entity Recognition](https://md.research.elamur.ai/free/en/papers/sun-2024-performance-challenges-instructgpt/) — (InstructGPT在命名实体识别任务中的表现和挑战) - [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/6/) ## References 10 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. S. Y. Agnon. 1953a. At the Handles of the Lock. Schocken Publishing House. [find](https://scholar.google.com/scholar?q=S%2E+Y%2E+Agnon%2E+1953a%2E+At+the+Handles+of+the+Lock%2E+Schocken+Publishing+House%2E) 2. S. Y. Agnon. 1953b. Only Yesterday. Schocken Publishing House. [find](https://scholar.google.com/scholar?q=S%2E+Y%2E+Agnon%2E+1953b%2E+Only+Yesterday%2E+Schocken+Publishing+House%2E) 3. Tuqa Bani Yaseen, Qusai Ismail, Sarah Al-Omari, Eslam Al-Sobh, and Malak Abdullah. 2021. JUST-BLUE at SemEval-2021 task 1: Predicting lexical complexity using BERT and RoBERTa pre-trained language models. In Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), pages 661–666, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Tuqa+Bani+Yaseen%2C+Qusai+Ismail%2C+Sarah+Al%2DOmari%2C+Eslam+Al%2DSobh%2C+and+Malak+Abdullah%2E+2021%2E+JUST%2DBLUE+at+SemEval%2D2021+task+1%3A+Predicting+lexical+complexity+using+BERT+and+RoBERTa+pre%2Dtrained+language+mod) 4. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019a. Bert: Pre-training of deep bidirectional transformers for language understanding. Preprint, arXiv:1810.04805. [↗](https://arxiv.org/abs/1810.04805) [our card](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) 5. Shaltiel Shmidman, Avi Shmidman, Moshe Koppel, and Reut Tsarfaty. 2024. MRL parsing without tears: The case of Hebrew. In Findings of the Association for Computational Linguistics ACL 2024, pages 4537–4550, Bangkok, Thailand and virtual meeting. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/shmidman-2024-mrl-parsing-without-tears-case/) 6. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019b. Bert: Pre-training of deep bidirectional transformers for language understanding. Preprint, arXiv:1810.04805. [↗](https://arxiv.org/abs/1810.04805) [our card](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/) 7. Xinying Song, Alex Salcianu, Yang Song, Dave Dopson, and Denny Zhou. 2021. Fast wordpiece tokenization. Preprint, arXiv:2012.15524. [↗](https://arxiv.org/abs/2012.15524) 8. Eylon Gueta, Avi Shmidman, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Joshua Guedalia, Moshe Koppel, Dan Bareket, Amit Seker, and Reut Tsarfaty. 2023. Large pre-trained models with extra-large vocabularies: A contrastive analysis of hebrew bert models and a new one to outperform them all. Preprint, arXiv:2211.15199. [↗](https://arxiv.org/abs/2211.15199) [our card](https://md.research.elamur.ai/free/en/papers/gueta-2022-large-pre-trained-models-extra/) 9. Reut Tsarfaty and Yoav Goldberg. 2008. Word-based or morpheme-based? annotation strategies for Modern Hebrew clitics. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC’08), Marrakech, Morocco. European Language Resources Association (ELRA). [our card](https://md.research.elamur.ai/free/en/papers/tsarfaty-2008-word-based-or-morpheme-based/) 10. Abdelhak Kelious, Mathieu Constant, and Christophe Coeur. 2024. Complex word identification: A comparative study between ChatGPT and a dedicated model for this task. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 3645–3653, Torino, Italia. ELRA and ICCL. [find](https://scholar.google.com/scholar?q=Abdelhak+Kelious%2C+Mathieu+Constant%2C+and+Christophe+Coeur%2E+2024%2E+Complex+word+identification%3A+A+comparative+study+between+ChatGPT+and+a+dedicated+model+for+this+task%2E+In+Proceedings+of+the+2024+Joint+I)