---
title: "Challenging the Transformer-based models with a Classical Arabic dataset — Altammami 2022"
description: "The authors argue these scores overstate real understanding for two reasons. 40 references, cited by 2 papers here."
authors: ["Shatha Altammami", "Eric Atwell"]
year: 2022
venue: "Proceedings of the Thirteenth Language Resources and Evaluation Conference"
source: "https://aclanthology.org/2022.lrec-1.157/"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/altammami-2022-challenging-transformer-based-models-classical/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/altammami-2022-challenging-transformer-based-models-classical/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2022](https://md.research.elamur.ai/free/en/papers/2022/page/4/) / Challenging the Transformer-based models with a Classical Arabic dataset: Quran and Hadith

# Challenging the Transformer-based models with a Classical Arabic dataset: Quran and Hadith

**Authors:** [Shatha Altammami](https://md.research.elamur.ai/free/en/authors/shatha-altammami/) and [Eric Atwell](https://md.research.elamur.ai/free/en/authors/eric-atwell/) · **Year:** 2022 · **Venue:** Proceedings of the Thirteenth Language Resources and Evaluation Conference · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2022.lrec-1.157/) · [PDF](https://aclanthology.org/2022.lrec-1.157.pdf) · [OpenAlex](https://openalex.org/W7160246478)

**Citations:** 4 citations (OpenAlex, 2026-10-14) · 2 in our library, of the 140,884 papers whose bibliographies we read

## Summary
Transformer models score near or above human level on popular similarity benchmarks. The authors argue these scores overstate real understanding for two reasons. Random train/test splits leak instances between sets, and benchmark sentences are easy to read. Both problems are worse for Classical Arabic, which has few datasets and hard morphology, orthography and rhetoric. The authors frame the task as binary classification: do two Classical Arabic passages share the same underlying message? They built a new test set of Quran-verse/Hadith-teaching pairs. Each link comes from reputable Islamic scholars, and non-related pairs were added as negatives. Models are fine-tuned on an extended version of the Qursim dataset, which holds only Quran–Quran pairs, and then evaluated on the stylistically different Quran–Hadith pairs. Several monolingual, bilingual and multilingual state-of-the-art models were compared. The authors conclude that these models still fall short at capturing deep meaning in complex, low-resource texts. The datasets are released publicly.

## Key points
- Only three Arabic semantic similarity/relatedness datasets existed: Qursim (CA, 7,679 pairs, 2012), Q2Q from NSURL (MSA, 15,712 pairs, 2019) and the SemEval-2017 STS Arabic set (MSA, 1,104 pairs). Qursim was the only Classical Arabic one.
- The Quran–Hadith (QH) test set was built in five stages:
  - choose expert sources that state relatedness explicitly;
  - extract the pairs;
  - check each text against the original corpora so that full verses and teachings are kept;
  - generate non-related pairs;
  - strip punctuation and diacritics.
- The QH pairs come from two sources:
  - Sahih Albukhari, where section headings that cite a Quran verse are paired with the Hadith Matn (the teaching without its chain of narrators) of that section, taken from the LK-Hadith-Corpus;
  - the archived Fatwas of Abdul-Aziz ibn Baz.
- Qursim was itself mined from Ibn Kathir's commentary, which explains each verse by pointing to related verses. The extended Qursim was used for fine-tuning and validation, and QH was reserved for testing.
- The authors cite earlier work reporting that random splits can produce up to 70% instance overlap between training and test data. This is part of why training and testing here use different text types.

## Interesting ideas
- Train on pairs from one text type (Quran–Quran) and test on a related but stylistically distinct type (Quran–Hadith), so that scores reflect generalization rather than memorized overlap.
- Instead of crowdsourcing labels that need expertise, harvest them from the structure of expert-authored documents, such as section headings citing a verse or rulings that cite both texts.
- Check every extracted fragment against the source corpus so that each item is a complete unit rather than a truncated excerpt.
- Treat multi-topic sources with caution, because a link between two passages may be unclear once they are lifted out of their wider context.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (learn): Silver-trained components could be scored on a deliberately different genre, for example training on expository prose and testing on fables, as a built-in check against leakage.
- **I2** (answer): Textbook chapters whose headings and worked exercises point to specific passages could yield question–evidence pairs for school-course tests without manual annotation.
- **I3** (learn): When assembling silver sentences or frame examples from scraped material, re-anchoring each item to its original document would catch clipped sentences before they reach training.
- **I4** (answer): QA items for fables and tales could be filtered so the answer is supported by the given passage alone, not by context lost during extraction.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

Topics: [🐪 Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/)

## Institutions

- [University of Leeds](https://md.research.elamur.ai/free/en/universities/university-of-leeds/) — University, Leeds, United Kingdom · 19 works · 1,290 citations
- [King Saud University](https://md.research.elamur.ai/free/en/universities/king-saud-university/) — University, Riyadh, Saudi Arabia · 13 works · 290 citations

## Cite

Cite as: Shatha Altammami and Eric Atwell. 2022. Challenging the Transformer-based models with a Classical Arabic dataset: Quran and Hadith. Proceedings of the Thirteenth Language Resources and Evaluation Conference.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{altammami2022challenging,
  title = {{Challenging the Transformer-based models with a Classical Arabic dataset: Quran and Hadith}},
  author = {Shatha Altammami and Eric Atwell},
  booktitle = {Proceedings of the Thirteenth Language Resources and Evaluation Conference},
  year = {2022},
  doi = {10.63317/2j3tytcry54x},
  url = {https://doi.org/10.63317/2j3tytcry54x}
}
```

- [← previous A Universal Dependencies Treebank of Ancient Hebrew](https://md.research.elamur.ai/free/en/papers/swanson-2022-universal-dependencies-treebank-ancient-hebrew/)
- [next → Deep Multi-Task Models for Misogyny Identification and Categorization on Arabic Social Media](https://md.research.elamur.ai/free/en/papers/mahdaouy-2022-deep-multi-task-models-misogyny/)
- [↑ back to papers of 2022](https://md.research.elamur.ai/free/en/papers/2022/page/4/)

## References

40 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Abbas, N. H. (2009). Quran ’search for a concept’ tool and website. Master’s thesis, University of Leeds. [find](https://scholar.google.com/scholar?q=Abbas%2C+N%2E+H%2E+%282009%29%2E+Quran+%E2%80%99search+for+a+concept%E2%80%99+tool+and+website%2E+Master%E2%80%99s+thesis%2C+University+of+Leeds%2E)
2. Abdul-Raof, H. (2013). Qur’an translation: Discourse, texture and exegesis. Routledge. [find](https://scholar.google.com/scholar?q=Abdul%2DRaof%2C+H%2E+%282013%29%2E+Qur%E2%80%99an+translation%3A+Discourse%2C+texture+and+exegesis%2E+Routledge%2E)
3. Alsaleh, A. N., Atwell, E., and Altahhan, A. (2021). Quranic verses semantic relatedness using arabert. In Proceedings of the Sixth Arabic Natural Language Processing Workshop, pages 185–190. Leeds. [find](https://scholar.google.com/scholar?q=Alsaleh%2C+A%2E+N%2E%2C+Atwell%2C+E%2E%2C+and+Altahhan%2C+A%2E+%282021%29%2E+Quranic+verses+semantic+relatedness+using+arabert%2E+In+Proceedings+of+the+Sixth+Arabic+Natural+Language+Processing+Workshop%2C+pages+185%E2%80%93190%2E+Leeds%2E)
4. Alshammeri, M., Atwell, E., and Alsalka, M. A. (2020). Quranic topic modelling using paragraph vectors. In Proceedings of SAI Intelligent Systems Conference, pages 218–230. Springer. [find](https://scholar.google.com/scholar?q=Alshammeri%2C+M%2E%2C+Atwell%2C+E%2E%2C+and+Alsalka%2C+M%2E+A%2E+%282020%29%2E+Quranic+topic+modelling+using+paragraph+vectors%2E+In+Proceedings+of+SAI+Intelligent+Systems+Conference%2C+pages+218%E2%80%93230%2E+Springer%2E)
5. Altammami, S., Atwell, E., and Alsalka, A. (2020a). Constructing a bilingual hadith corpus using a segmentation tool. In Proceedings of The 12th Language Resources and Evaluation Conference, pages 3390–3398. [find](https://scholar.google.com/scholar?q=Altammami%2C+S%2E%2C+Atwell%2C+E%2E%2C+and+Alsalka%2C+A%2E+%282020a%29%2E+Constructing+a+bilingual+hadith+corpus+using+a+segmentation+tool%2E+In+Proceedings+of+The+12th+Language+Resources+and+Evaluation+Conference%2C+pages+339)
6. Altammami, S., Atwell, E., and Alsalka, A. (2020b). Towards a joint ontology of quran and hadith. International Journal on Islamic Applications in Computer Science And Technology. [find](https://scholar.google.com/scholar?q=Altammami%2C+S%2E%2C+Atwell%2C+E%2E%2C+and+Alsalka%2C+A%2E+%282020b%29%2E+Towards+a+joint+ontology+of+quran+and+hadith%2E+International+Journal+on+Islamic+Applications+in+Computer+Science+And+Technology%2E)
7. Alyafeai, Z., Masoud, M., Ghaleb, M., and Al-shaibani, M. S. (2021). Masader: Metadata sourcing for arabic text and speech data resources. [our card](https://md.research.elamur.ai/free/en/papers/alyafeai-2022-masader-metadata-sourcing-arabic-text/)
8. Antoun, W., Baly, F., and Hajj, H. (2020). Arabert: Transformer-based model for arabic language understanding. arXiv preprint arXiv:2003.00104. [↗](https://arxiv.org/abs/2003.00104) [our card](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/)
9. Bashir, M. H., M Azmi, A., Nawaz, H., Zaghouani, W., Diab, M., Al-Fuqaha, A., and Qadir, J. (2021). Arabic natural language processing for qur’anic research: A systematic review. [find](https://scholar.google.com/scholar?q=Bashir%2C+M%2E+H%2E%2C+M+Azmi%2C+A%2E%2C+Nawaz%2C+H%2E%2C+Zaghouani%2C+W%2E%2C+Diab%2C+M%2E%2C+Al%2DFuqaha%2C+A%2E%2C+and+Qadir%2C+J%2E+%282021%29%2E+Arabic+natural+language+processing+for+qur%E2%80%99anic+research%3A+A+systematic+review%2E)
10. Belinkov, Y., Magidow, A., Barrón-Cedeño, A., Shmidman, A., and Romanov, M. (2019). Studying the history of the arabic language: language technology and a large-scale historical corpus. Language Resources and Evaluation, 53(4):771–805. [find](https://scholar.google.com/scholar?q=Belinkov%2C+Y%2E%2C+Magidow%2C+A%2E%2C+Barro%CC%81n%2DCeden%CC%83o%2C+A%2E%2C+Shmidman%2C+A%2E%2C+and+Romanov%2C+M%2E+%282019%29%2E+Studying+the+history+of+the+arabic+language%3A+language+technology+and+a+large%2Dscale+historical+corpus%2E+Language+Res)
11. Bender, E. M. and Koller, A. (2020). Climbing towards nlu: On meaning, form, and understanding in the age of data. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5185–5198. [our card](https://md.research.elamur.ai/free/en/papers/bender-2020-climbing-nlu-meaning-form-understanding/)
12. Bojanowski, P., Grave, E., Joulin, A., and Mikolov, T. (2017). Enriching word vectors with subword information. Transactions of the Association for Computational Linguistics, 5:135–146. [our card](https://md.research.elamur.ai/free/en/papers/bojanowski-2017-enriching-word-vectors-subword-information/)
13. Bounhas, I. (2019). On the usage of a classical arabic corpus as a language resource: related research and key challenges. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), 18(3):1–45. [find](https://scholar.google.com/scholar?q=Bounhas%2C+I%2E+%282019%29%2E+On+the+usage+of+a+classical+arabic+corpus+as+a+language+resource%3A+related+research+and+key+challenges%2E+ACM+Transactions+on+Asian+and+Low%2DResource+Language+Information+Processing+%28T)
14. Cer, D., Diab, M., Agirre, E., Lopez-Gazpio, I., and Specia, L. (2017). Semeval-2017 task 1: Semantic textual similarity-multilingual and cross-lingual focused evaluation. arXiv preprint arXiv:1708.00055. [↗](https://arxiv.org/abs/1708.00055) [our card](https://md.research.elamur.ai/free/en/papers/cer-2017-semeval-2017-task-1-semantic/)
15. Chandrasekaran, D. and Mago, V. (2020). Domain specific complex sentence (dscs) semantic similarity dataset. arXiv preprint arXiv:2010.12637. [↗](https://arxiv.org/abs/2010.12637)
16. Chicco, D. and Jurman, G. (2020). The advantages of the matthews correlation coefficient (mcc) over f1 score and accuracy in binary classification evaluation. BMC genomics, 21(1):1–13. [find](https://scholar.google.com/scholar?q=Chicco%2C+D%2E+and+Jurman%2C+G%2E+%282020%29%2E+The+advantages+of+the+matthews+correlation+coefficient+%28mcc%29+over+f1+score+and+accuracy+in+binary+classification+evaluation%2E+BMC+genomics%2C+21%281%29%3A1%E2%80%9313%2E)
17. Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., and Stoyanov, V. (2019). Unsupervised cross-lingual representation learning at scale. arXiv preprint arXiv:1911.02116. [↗](https://arxiv.org/abs/1911.02116)
18. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. [↗](https://arxiv.org/abs/1810.04805) [our card](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)
19. Elangovan, A., He, J., and Verspoor, K. (2021). Memorization vs. generalization: quantifying data leakage in nlp performance evaluation. arXiv preprint arXiv:2102.01818. [↗](https://arxiv.org/abs/2102.01818)
20. Habash, N. Y. (2010). Introduction to arabic natural language processing. Synthesis Lectures on Human Language Technologies, 3(1):1–187. [find](https://scholar.google.com/scholar?q=Habash%2C+N%2E+Y%2E+%282010%29%2E+Introduction+to+arabic+natural+language+processing%2E+Synthesis+Lectures+on+Human+Language+Technologies%2C+3%281%29%3A1%E2%80%93187%2E)
21. Hakkoum, A. and Raghay, S. (2016). Ontological approach for semantic modeling and querying. International Journal on Islamic Applications in Computer Science and Technology, pages 37–37. [find](https://scholar.google.com/scholar?q=Hakkoum%2C+A%2E+and+Raghay%2C+S%2E+%282016%29%2E+Ontological+approach+for+semantic+modeling+and+querying%2E+International+Journal+on+Islamic+Applications+in+Computer+Science+and+Technology%2C+pages+37%E2%80%9337%2E)
22. Inoue, G., Alhafni, B., Baimukan, N., Bouamor, H., and Habash, N. (2021). The interplay of variant, size, and task type in arabic pre-trained language models. arXiv preprint arXiv:2103.06678. [↗](https://arxiv.org/abs/2103.06678) [our card](https://md.research.elamur.ai/free/en/papers/inoue-2021-interplay-variant-size-task-type/)
23. Kidwai, A.-R. (1987). Translating the untranslatable: a survey of english translations of the quran. The Muslim World Book Review, 7(4):66–71. [find](https://scholar.google.com/scholar?q=Kidwai%2C+A%2E%2DR%2E+%281987%29%2E+Translating+the+untranslatable%3A+a+survey+of+english+translations+of+the+quran%2E+The+Muslim+World+Book+Review%2C+7%284%29%3A66%E2%80%9371%2E)
24. Lan, W., Chen, Y., Xu, W., and Ritter, A. (2020). An empirical study of pre-trained transformers for arabic information extraction. arXiv preprint arXiv:2004.14519. [↗](https://arxiv.org/abs/2004.14519)
25. Le, Q. and Mikolov, T. (2014). Distributed representations of sentences and documents. In International conference on machine learning, pages 1188–1196. PMLR. [our card](https://md.research.elamur.ai/free/en/papers/le-2014-distributed-representations-sentences-documents/)
26. Lewis, P., Stenetorp, P., and Riedel, S. (2020). Question and answer test-train overlap in open-domain question answering datasets. arXiv preprint arXiv:2008.02637. [↗](https://arxiv.org/abs/2008.02637)
27. Marelli, M., Menini, S., Baroni, M., Bentivogli, L., Bernardi, R., Zamparelli, R., et al. (2014). A sick cure for the evaluation of compositional distributional semantic models. In Lrec, pages 216–223. Reykjavik. [our card](https://md.research.elamur.ai/free/en/papers/marelli-2014-sick-cure-evaluation-compositional-distributional/)
28. Mozannar, H., Maamary, E., El Hajal, K., and Hajj, H. (2019). Neural Arabic question answering. In Proceedings of the Fourth Arabic Natural Language Processing Workshop, pages 108–118, Florence, Italy, aug. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Mozannar%2C+H%2E%2C+Maamary%2C+E%2E%2C+El+Hajal%2C+K%2E%2C+and+Hajj%2C+H%2E+%282019%29%2E+Neural+Arabic+question+answering%2E+In+Proceedings+of+the+Fourth+Arabic+Natural+Language+Processing+Workshop%2C+pages+108%E2%80%93118%2C+Florence%2C+Italy)
29. Mubarak, H., Darwish, K., Magdy, W., Elsayed, T., and Al-Khalifa, H. (2020). Overview of OSACT4 Arabic offensive language detection shared task. In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pages 48– 52, Marseille, France, may. European Language Resource Association. [find](https://scholar.google.com/scholar?q=Mubarak%2C+H%2E%2C+Darwish%2C+K%2E%2C+Magdy%2C+W%2E%2C+Elsayed%2C+T%2E%2C+and+Al%2DKhalifa%2C+H%2E+%282020%29%2E+Overview+of+OSACT4+Arabic+offensive+language+detection+shared+task%2E+In+Proceedings+of+the+4th+Workshop+on+Open%2DSource+Arabi)
30. Nagoudi, E. M., Ferrero, J., and Schwab, D. (2017). Lim-lig at semeval-2017 task1: Enhancing the semantic similarity for arabic sentences with vectors weighting. In Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), pages 134–138. [find](https://scholar.google.com/scholar?q=Nagoudi%2C+E%2E+M%2E%2C+Ferrero%2C+J%2E%2C+and+Schwab%2C+D%2E+%282017%29%2E+Lim%2Dlig+at+semeval%2D2017+task1%3A+Enhancing+the+semantic+similarity+for+arabic+sentences+with+vectors+weighting%2E+In+Proceedings+of+the+11th+Internation)
31. Obeid, O., Zalmout, N., Khalifa, S., Taji, D., Oudah, M., Alhafni, B., Inoue, G., Eryani, F., Erdmann, A., and Habash, N. (2020). CAMeL tools: An open source python toolkit for Arabic natural language processing. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 7022– 7032, Marseille, France, May. European Language Resources Association. [our card](https://md.research.elamur.ai/free/en/papers/obeid-2020-camel-tools-open-source-python/)
32. Peuriekeu, Y. M., Noyum, V. D., Feudjio, C., Goktug, A., and Fokoue, E. (2021). A text mining discovery of similarities and dissimilarities among sacred scriptures. arXiv preprint arXiv:2102.04421. [↗](https://arxiv.org/abs/2102.04421)
33. Qahl, S. H. M. (2014). An automatic similarity detection engine between sacred texts using text mining and similarity measures. Rochester Institute of Technology. [find](https://scholar.google.com/scholar?q=Qahl%2C+S%2E+H%2E+M%2E+%282014%29%2E+An+automatic+similarity+detection+engine+between+sacred+texts+using+text+mining+and+similarity+measures%2E+Rochester+Institute+of+Technology%2E)
34. Reimers, N. and Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv:1908.10084. [↗](https://arxiv.org/abs/1908.10084) [our card](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/)
35. Saeed, S., Haider, S., and Rajput, Q. (2020). On finding similar verses from the holy quran using word embeddings. In 2020 International Conference on Emerging Trends in Smart Technologies (ICETST), pages 1–6. IEEE. [find](https://scholar.google.com/scholar?q=Saeed%2C+S%2E%2C+Haider%2C+S%2E%2C+and+Rajput%2C+Q%2E+%282020%29%2E+On+finding+similar+verses+from+the+holy+quran+using+word+embeddings%2E+In+2020+International+Conference+on+Emerging+Trends+in+Smart+Technologies+%28ICETST%29%2C+p)
36. Safaya, A., Abdullatif, M., and Yuret, D. (2020). Kuisail at semeval-2020 task 12: Bert-cnn for offensive speech identification in social media. In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 2054–2059. [our card](https://md.research.elamur.ai/free/en/papers/safaya-2020-kuisail-semeval-2020-task-12/)
37. Seelawi, H., Mustafa, A., Al-Bataineh, H., Farhan, W., and Al-Natsheh, H. T. (2019). Nsurl-2019 task 8: Semantic question similarity in arabic. In Proceedings of The First International Workshop on NLP Solutions for Under Resourced Languages (NSURL 2019) co-located with ICNLSP 2019-Short Papers, pages 1–8. [find](https://scholar.google.com/scholar?q=Seelawi%2C+H%2E%2C+Mustafa%2C+A%2E%2C+Al%2DBataineh%2C+H%2E%2C+Farhan%2C+W%2E%2C+and+Al%2DNatsheh%2C+H%2E+T%2E+%282019%29%2E+Nsurl%2D2019+task+8%3A+Semantic+question+similarity+in+arabic%2E+In+Proceedings+of+The+First+International+Workshop+on+NL)
38. Sharaf, A.-B. and Atwell, E. (2012). Qursim: A corpus for evaluation of relatedness in short texts. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC’12), pages 2295–2302. [find](https://scholar.google.com/scholar?q=Sharaf%2C+A%2E%2DB%2E+and+Atwell%2C+E%2E+%282012%29%2E+Qursim%3A+A+corpus+for+evaluation+of+relatedness+in+short+texts%2E+In+Proceedings+of+the+Eighth+International+Conference+on+Language+Resources+and+Evaluation+%28LREC%E2%80%9912%29)
39. Varghese, N. and Punithavalli, M. (2019). Lexical and semantic analysis of sacred texts using machine learning and natural language processing. International Journal of Scientific & Technology Research, 8(12):3133–3140. [find](https://scholar.google.com/scholar?q=Varghese%2C+N%2E+and+Punithavalli%2C+M%2E+%282019%29%2E+Lexical+and+semantic+analysis+of+sacred+texts+using+machine+learning+and+natural+language+processing%2E+International+Journal+of+Scientific+%26+Technology+Researc)
40. Verma, M. (2017). Lexical analysis of religious texts using text mining and machine learning tools. International Journal of Computer Applications, 168(8):39–45. [find](https://scholar.google.com/scholar?q=Verma%2C+M%2E+%282017%29%2E+Lexical+analysis+of+religious+texts+using+text+mining+and+machine+learning+tools%2E+International+Journal+of+Computer+Applications%2C+168%288%29%3A39%E2%80%9345%2E)