---
title: "Contextual-Boosted Deep Neural Collaborative Filtering"
description: "The authors build a hybrid recommender with two parallel towers, one for users and one for items. 32 references."
authors: ["Ons Meddeb", "Mohsen Maraoui", "Mounir Zrigui"]
year: 2022
venue: "Proceedings of the 36th Pacific Asia Conference on Language, Information and Computation"
source: "https://aclanthology.org/2022.paclic-1.54/"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/meddeb-2022-contextual-boosted-deep-neural-collaborative/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/meddeb-2022-contextual-boosted-deep-neural-collaborative/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2022](https://md.research.elamur.ai/free/en/papers/2022/page/9/) / Contextual-Boosted Deep Neural Collaborative Filtering Approach for Arabic Textual Documents Recommendation

# Contextual-Boosted Deep Neural Collaborative Filtering Approach for Arabic Textual Documents Recommendation

**Authors:** Ons Meddeb, [Mohsen Maraoui](https://md.research.elamur.ai/free/en/authors/mohsen-maraoui/) and [Mounir Zrigui](https://md.research.elamur.ai/free/en/authors/mounir-zrigui/) · **Year:** 2022 · **Venue:** [Proceedings of the 36th Pacific Asia Conference on Language, Information and Computation](https://md.research.elamur.ai/free/en/venues/paclic/) ([PACLIC 2022](https://md.research.elamur.ai/free/en/venues/paclic/2022/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2022.paclic-1.54/) · [PDF](https://aclanthology.org/2022.paclic-1.54.pdf)

## Summary
The paper addresses recommending Arabic books and documents when user ratings are sparse. Pure collaborative filtering struggles with users or items that have few ratings, and most review-aware recommenders target English. Arabic text adds rich morphology and heavy lexical ambiguity. The authors build a hybrid recommender with two parallel towers, one for users and one for items. Each tower combines two signals:
- dense ID embeddings learned from the rating matrix;
- the texts of the reviews a user wrote or an item received, encoded with a compact fine-tuned AraBERT and then a GRU.

The user and item vectors are joined in a shared layer, and an MLP predicts the rating in place of a dot product. Tested on BRAD1.0 (Goodreads book reviews in Arabic), the model reaches an RMSE of 0.855. This beats PMF, SVD++, J-NCF and the CNN-based DeepCoNN. The authors read this as evidence that contextual embeddings capture Arabic review semantics better than static word vectors. Only one dataset and one metric are reported, and there is no ablation separating the AraBERT, GRU and MLP contributions.

## Key points
- Data is BRAD1.0: 4,993 Arabic books of various genres, 76,530 users and 510,600 interactions, each with a review and a 1–5 rating.
- The AraBERT encoder is small (4 layers, 4 heads, hidden size 256) and fine-tuned during training. Each review is fed as a single segment of 256 tokens.
- The GRU stack uses 256/128/64 units. The interaction MLP has hidden layers of 128/64/8 and K=16 latent factors, which the authors found to be the best setting.
- RMSE results: PMF 1.355, SVD++ 1.215, J-NCF 1.050, DeepCoNN 0.905, proposed model 0.855.
- Planned future work is a bidirectional recurrent layer, so that both preceding and following words shape a word's representation.

## Interesting ideas
- Users and items get identically built towers that differ only in input, so one architecture learns profiles for both sides of a relation; this keeps the design simple and symmetric.
- Each side fuses an identity-based signal from the rating matrix with a content-based signal from text, so sparse identity data is backed up by descriptive evidence.
- The baselines form a ladder by information used: ratings only, then non-linear interaction, then reviews, then contextual reviews. A feature table states exactly what each method sees, which makes it clearer where gains come from.
- A deliberately compact transformer (4 layers, 256 hidden) is fine-tuned end-to-end inside a larger pipeline rather than used as a frozen feature extractor. This shows a light encoder can be one trainable component among others.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (world): An entity profile could be assembled the same way from every clause where the entity acts and every clause where it is acted upon, using one shared procedure for both views.
- **I2** (learn): When pooling silver annotations, each witness parser's track record (an identity signal) could be combined with features of the sentence at hand (a content signal) to weigh disagreements.
- **I3** (learn): Evaluation reports could carry a similar matrix marking which knowledge sources each Mova variant uses (VerbNet, WordNet, LLM teacher), turning comparisons into crude ablations.
- **I4** (tree): gparse could test small, jointly fine-tuned encoder configurations to cut GPU cost while staying trainable together with the parser head.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (2): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works

🧭 Topics (1): [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · 3,066 works

## Cite

Cite as: Ons Meddeb, Mohsen Maraoui and Mounir Zrigui. 2022. Contextual-Boosted Deep Neural Collaborative Filtering Approach for Arabic Textual Documents Recommendation. Proceedings of the 36th Pacific Asia Conference on Language, Information and Computation.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{meddeb2022contextual,
  title = {{Contextual-Boosted Deep Neural Collaborative Filtering Approach for Arabic Textual Documents Recommendation}},
  author = {Ons Meddeb, Mohsen Maraoui and Mounir Zrigui},
  booktitle = {Proceedings of the 36th Pacific Asia Conference on Language, Information and Computation},
  year = {2022},
  url = {https://aclanthology.org/2022.paclic-1.54/}
}
```

- [← previous Claudia Lange & Sven Leuckert, Corpus Linguistics for World Englishes, A Guide for Research](https://md.research.elamur.ai/free/en/papers/guillemin-bonniec-2022-claudia-lange-amp-sven-leuckert/)
- [next → Do Bashal and Hepsō really mean 'boil'? A preliminary study in the semantics of biblical Hebrew and Septuagint Greek](https://md.research.elamur.ai/free/en/papers/mangum-2022-bashal-hepso-really-mean-boil/)
- [↑ back to papers of 2022](https://md.research.elamur.ai/free/en/papers/2022/page/9/)

## References

32 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Bai T., Wen J., Zhang J., and Zhao W. X. 2017. A neural collaborative filtering model with interaction-based neighborhood, ACM on Conference on Information and Knowledge Management (ICKM): 1979–1982. [find](https://scholar.google.com/scholar?q=Bai+T%2E%2C+Wen+J%2E%2C+Zhang+J%2E%2C+and+Zhao+W%2E+X%2E+2017%2E+A+neural+collaborative+filtering+model+with+interaction%2Dbased+neighborhood%2C+ACM+on+Conference+on+Information+and+Knowledge+Management+%28ICKM%29%3A+1979%E2%80%931982%2E)
2. Bao Y., Fang H., Zhang J. 2014. TopicMF: simultaneously exploiting ratings and reviews for recommendation, 28 th AAAI Conference on Artificial Intelligence, Quebec, Canada: 2-8. [find](https://scholar.google.com/scholar?q=Bao+Y%2E%2C+Fang+H%2E%2C+Zhang+J%2E+2014%2E+TopicMF%3A+simultaneously+exploiting+ratings+and+reviews+for+recommendation%2C+28+th+AAAI+Conference+on+Artificial+Intelligence%2C+Quebec%2C+Canada%3A+2%2D8%2E)
3. Bellagha M. L., and Zrigui M. 2020. Speaker naming in tv programs based on speaker role recognition, IEEE/ACS 17 th International Conference on Computer Systems and Applications (AICCSA), Antalya, Turkey: 1-8. [find](https://scholar.google.com/scholar?q=Bellagha+M%2E+L%2E%2C+and+Zrigui+M%2E+2020%2E+Speaker+naming+in+tv+programs+based+on+speaker+role+recognition%2C+IEEE%2FACS+17+th+International+Conference+on+Computer+Systems+and+Applications+%28AICCSA%29%2C+Antalya%2C+Tur)
4. Chen C., Zhang M., Liu Y., and Ma S. 2018. Neural attentional rating regression with review-level explanations, International World Wide Web Conferences Steering Committee (WWW): 1583– 1592. [find](https://scholar.google.com/scholar?q=Chen+C%2E%2C+Zhang+M%2E%2C+Liu+Y%2E%2C+and+Ma+S%2E+2018%2E+Neural+attentional+rating+regression+with+review%2Dlevel+explanations%2C+International+World+Wide+Web+Conferences+Steering+Committee+%28WWW%29%3A+1583%E2%80%93+1592%2E)
5. Chen W., Cai F., Chen H., and Rijke M. D. 2019. Joint neural collaborative filtering for recommender systems, ACM Transactions on Information Systems, 1(1): 1-30. [find](https://scholar.google.com/scholar?q=Chen+W%2E%2C+Cai+F%2E%2C+Chen+H%2E%2C+and+Rijke+M%2E+D%2E+2019%2E+Joint+neural+collaborative+filtering+for+recommender+systems%2C+ACM+Transactions+on+Information+Systems%2C+1%281%29%3A+1%2D30%2E)
6. Devlin J., Chang M., Lee K., and Toutanova K. 2018. [Bert: pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). arXiv preprint arXiv:1810.04805. [↗](https://arxiv.org/abs/1810.04805)
7. Dhelim S., Aung N., Bouras M., Ning H., and Cambria E. 2022. A survey on personality-aware recommendation systems, Artificial Intelligence Review, volume 55: 2409-2454. [find](https://scholar.google.com/scholar?q=Dhelim+S%2E%2C+Aung+N%2E%2C+Bouras+M%2E%2C+Ning+H%2E%2C+and+Cambria+E%2E+2022%2E+A+survey+on+personality%2Daware+recommendation+systems%2C+Artificial+Intelligence+Review%2C+volume+55%3A+2409%2D2454%2E)
8. Duan R., Jiang C., and Jain H. 2022. Combining review-based collaborative filtering and matrix factorization: A solution to rating’s sparsity problem, Decision Support Systems, volume 156:113748. [find](https://scholar.google.com/scholar?q=Duan+R%2E%2C+Jiang+C%2E%2C+and+Jain+H%2E+2022%2E+Combining+review%2Dbased+collaborative+filtering+and+matrix+factorization%3A+A+solution+to+rating%E2%80%99s+sparsity+problem%2C+Decision+Support+Systems%2C+volume+156%3A113748%2E)
9. Fang J., Zhang X., Hu Y., Xu Y., Yang M., and Liu J. 2020. Probabilistic latent factor model for collaborative filtering with Bayesian inference, 25 th International Conference on Pattern Recognition (ICPR), Milan, Italy: 73-80. [find](https://scholar.google.com/scholar?q=Fang+J%2E%2C+Zhang+X%2E%2C+Hu+Y%2E%2C+Xu+Y%2E%2C+Yang+M%2E%2C+and+Liu+J%2E+2020%2E+Probabilistic+latent+factor+model+for+collaborative+filtering+with+Bayesian+inference%2C+25+th+International+Conference+on+Pattern+Recognition+)
10. Haffar N., Ayadi R., Hkiri E., and Zrigui M. 2021. Temporal ordering of events via deep neural networks, 16 th International Conference on Document Analysis and Recognition (ICDAR), Lausanne, Switzerland: 762-777. [find](https://scholar.google.com/scholar?q=Haffar+N%2E%2C+Ayadi+R%2E%2C+Hkiri+E%2E%2C+and+Zrigui+M%2E+2021%2E+Temporal+ordering+of+events+via+deep+neural+networks%2C+16+th+International+Conference+on+Document+Analysis+and+Recognition+%28ICDAR%29%2C+Lausanne%2C+Switzerl)
11. Hazar M. J., Maraoui M., and Zrigui M. 2022. Recommendation system based on video processing in an E-learning platform, Journal of Human University (Natural Sciences), 49(6): 49-61. [find](https://scholar.google.com/scholar?q=Hazar+M%2E+J%2E%2C+Maraoui+M%2E%2C+and+Zrigui+M%2E+2022%2E+Recommendation+system+based+on+video+processing+in+an+E%2Dlearning+platform%2C+Journal+of+Human+University+%28Natural+Sciences%29%2C+49%286%29%3A+49%2D61%2E)
12. He X., Liao L., Zhang H., Nie L., and Chua T.S. 2017. Neural collaborative filtering, 26 th International Conference on World Wide Web (WWW), Perth Australia: 173–182 [find](https://scholar.google.com/scholar?q=He+X%2E%2C+Liao+L%2E%2C+Zhang+H%2E%2C+Nie+L%2E%2C+and+Chua+T%2ES%2E+2017%2E+Neural+collaborative+filtering%2C+26+th+International+Conference+on+World+Wide+Web+%28WWW%29%2C+Perth+Australia%3A+173%E2%80%93182)
13. Jian P. K., Patel A., Kuari S., and Pamula R. 2022. Predicting airline customers’ recommendations using qualitative and quantitative contents of online reviews, Multimedia and Tools, volume 81: 6979-6994. [find](https://scholar.google.com/scholar?q=Jian+P%2E+K%2E%2C+Patel+A%2E%2C+Kuari+S%2E%2C+and+Pamula+R%2E+2022%2E+Predicting+airline+customers%E2%80%99+recommendations+using+qualitative+and+quantitative+contents+of+online+reviews%2C+Multimedia+and+Tools%2C+volume+81%3A+6979%2D6)
14. King G. L. L. 2014. Ratings meet reviews, a combined approach to recommend, 8 th ACM Conference on Recommender Systems (RecSys), Silicon Valley, CA, USA: 105–112. [find](https://scholar.google.com/scholar?q=King+G%2E+L%2E+L%2E+2014%2E+Ratings+meet+reviews%2C+a+combined+approach+to+recommend%2C+8+th+ACM+Conference+on+Recommender+Systems+%28RecSys%29%2C+Silicon+Valley%2C+CA%2C+USA%3A+105%E2%80%93112%2E)
15. Lee D., and Seung H. S. 2001. Algorithms for non-negative matrix factorization, Advances in Neural Information Processing Systems (NIPS), Vancouver, BC, Canada: 556–562. [find](https://scholar.google.com/scholar?q=Lee+D%2E%2C+and+Seung+H%2E+S%2E+2001%2E+Algorithms+for+non%2Dnegative+matrix+factorization%2C+Advances+in+Neural+Information+Processing+Systems+%28NIPS%29%2C+Vancouver%2C+BC%2C+Canada%3A+556%E2%80%93562%2E)
16. Mahmoud A., and Zrigui M. 2017. [Semantic similarity analysis for paraphrase identification in Arabic texts](https://md.research.elamur.ai/free/en/papers/mahmoud-2017-semantic-similarity-analysis-paraphrase-identification/), 31 st Pacific Asia Conference on Language, Information and Computation (PACLIC), Philippine: 274-281.
17. Mahmoud A., and Zrigui M. 2021a. BLSTM-API: Bi-LSTM recurrent neural-based approach for Arabic paraphrase identification, Arabian for Science and Engineering, volume 46: 4163-4174. [find](https://scholar.google.com/scholar?q=Mahmoud+A%2E%2C+and+Zrigui+M%2E+2021a%2E+BLSTM%2DAPI%3A+Bi%2DLSTM+recurrent+neural%2Dbased+approach+for+Arabic+paraphrase+identification%2C+Arabian+for+Science+and+Engineering%2C+volume+46%3A+4163%2D4174%2E)
18. Mahmoud A., and Zrigui M. 2021b. Semantic similarity analysis for corpus development and paraphrase detection in Arabic, International Arab Journal of Information Technology (IAJIT), volume 18: 1-7. [find](https://scholar.google.com/scholar?q=Mahmoud+A%2E%2C+and+Zrigui+M%2E+2021b%2E+Semantic+similarity+analysis+for+corpus+development+and+paraphrase+detection+in+Arabic%2C+International+Arab+Journal+of+Information+Technology+%28IAJIT%29%2C+volume+18%3A+1%2D7%2E)
19. McAuley J., and Leskovec J. 2013. Hidden factors and hidden topics: understanding rating dimensions with review text, 7 th ACM Conference on Recommender systems, Hong Kong, China: 165– 172. [find](https://scholar.google.com/scholar?q=McAuley+J%2E%2C+and+Leskovec+J%2E+2013%2E+Hidden+factors+and+hidden+topics%3A+understanding+rating+dimensions+with+review+text%2C+7+th+ACM+Conference+on+Recommender+systems%2C+Hong+Kong%2C+China%3A+165%E2%80%93+172%2E)
20. Meddeb O., Maraoui M., Aljawarneh S. 2017. Hybrid modelling of an off line Arabic handwriting recognition system: results and evaluation, International Journal Intelligent Enterprise, 4(½): 168–189. [find](https://scholar.google.com/scholar?q=Meddeb+O%2E%2C+Maraoui+M%2E%2C+Aljawarneh+S%2E+2017%2E+Hybrid+modelling+of+an+off+line+Arabic+handwriting+recognition+system%3A+results+and+evaluation%2C+International+Journal+Intelligent+Enterprise%2C+4%28%C2%BD%29%3A+168%E2%80%93189%2E)
21. Meddeb O., Maraoui M., and Zrigui M. 2021a. Deep learning based semantic approach for Arabic textual documents recommendation, IEEE International Conference on INnovations in Intelligent SysTems and Applications (INISTA), Kocaeli, Turkey: 1-6. [find](https://scholar.google.com/scholar?q=Meddeb+O%2E%2C+Maraoui+M%2E%2C+and+Zrigui+M%2E+2021a%2E+Deep+learning+based+semantic+approach+for+Arabic+textual+documents+recommendation%2C+IEEE+International+Conference+on+INnovations+in+Intelligent+SysTems+and+A)
22. Meddeb O., Maraoui M., and Zrigui M. 2021b. Arabic text documents recommendation using joint deep representations learning, Procedia Computer Science, 192(1): 812-821. [find](https://scholar.google.com/scholar?q=Meddeb+O%2E%2C+Maraoui+M%2E%2C+and+Zrigui+M%2E+2021b%2E+Arabic+text+documents+recommendation+using+joint+deep+representations+learning%2C+Procedia+Computer+Science%2C+192%281%29%3A+812%2D821%2E)
23. Meddeb O., Maraoui M., and Zrigui M. 2021c. Personalized smart learning recommendation system for Arabic users in smart campus, International Journal of Web-based learning and Teaching Technologies, 51(5): 1734-1747. [find](https://scholar.google.com/scholar?q=Meddeb+O%2E%2C+Maraoui+M%2E%2C+and+Zrigui+M%2E+2021c%2E+Personalized+smart+learning+recommendation+system+for+Arabic+users+in+smart+campus%2C+International+Journal+of+Web%2Dbased+learning+and+Teaching+Technologies%2C+5)
24. Mnih A., and Salakhutdinov R. 2007. Probabilistic matrix factorization, Advances in Neural Information Processing Systems, volume 20: 1257-1264. [find](https://scholar.google.com/scholar?q=Mnih+A%2E%2C+and+Salakhutdinov+R%2E+2007%2E+Probabilistic+matrix+factorization%2C+Advances+in+Neural+Information+Processing+Systems%2C+volume+20%3A+1257%2D1264%2E)
25. Saeed R. M. K., Rady S., and Gharib T. F. 2021. Optimizing sentiment classification for Arabic opinion texts, Cognitive Computation, volume 13: 164–178. [find](https://scholar.google.com/scholar?q=Saeed+R%2E+M%2E+K%2E%2C+Rady+S%2E%2C+and+Gharib+T%2E+F%2E+2021%2E+Optimizing+sentiment+classification+for+Arabic+opinion+texts%2C+Cognitive+Computation%2C+volume+13%3A+164%E2%80%93178%2E)
26. Sghaier M. A., and Zrigui M. 2020. Rule-based machine translation from Tunisian dialect to modern Arabic standard, Procedia Computer Science, volume 196: 310-319 [find](https://scholar.google.com/scholar?q=Sghaier+M%2E+A%2E%2C+and+Zrigui+M%2E+2020%2E+Rule%2Dbased+machine+translation+from+Tunisian+dialect+to+modern+Arabic+standard%2C+Procedia+Computer+Science%2C+volume+196%3A+310%2D319)
27. Slimi A., Zrigui M., and Nicolas H. 2022. MuLER: Multiplet-loss for emotion recognition, International Conference on Multimedia Retrieval (ICMR), Newark, NJ, USA: 435-442. [find](https://scholar.google.com/scholar?q=Slimi+A%2E%2C+Zrigui+M%2E%2C+and+Nicolas+H%2E+2022%2E+MuLER%3A+Multiplet%2Dloss+for+emotion+recognition%2C+International+Conference+on+Multimedia+Retrieval+%28ICMR%29%2C+Newark%2C+NJ%2C+USA%3A+435%2D442%2E)
28. Sun C., Qiu X., Xu Y., and Huang X. 2019. [How to fine-tune bert for text classification?](https://md.research.elamur.ai/free/en/papers/sun-2019-fine-tune-bert-text-classification/): arXiv preprint arXiv:1905.05583. [↗](https://arxiv.org/abs/1905.05583)
29. Trigui A., Mars A., Ben Jannet M. A., Maroui M., and Zrigui M. 2022. Foreign accent classification for Arabic speech learning: 1-5. [find](https://scholar.google.com/scholar?q=Trigui+A%2E%2C+Mars+A%2E%2C+Ben+Jannet+M%2E+A%2E%2C+Maroui+M%2E%2C+and+Zrigui+M%2E+2022%2E+Foreign+accent+classification+for+Arabic+speech+learning%3A+1%2D5%2E)
30. Wang X., He X., Nie L., and Chua T. 2017. Item silk road: Recommending items from information domains to social users, 40 th International ACM SIGIR Conference on Research and Development in Information Retrieval: 185–194. [find](https://scholar.google.com/scholar?q=Wang+X%2E%2C+He+X%2E%2C+Nie+L%2E%2C+and+Chua+T%2E+2017%2E+Item+silk+road%3A+Recommending+items+from+information+domains+to+social+users%2C+40+th+International+ACM+SIGIR+Conference+on+Research+and+Development+in+Informati)
31. Zhang Y., Ai Q., Chen X., and Croft W. 2017. Joint representation learning for topn recommendation with heterogeneous information sources. ACM on Conference on Information and Knowledge Management (ICKM): 1449–1458. [find](https://scholar.google.com/scholar?q=Zhang+Y%2E%2C+Ai+Q%2E%2C+Chen+X%2E%2C+and+Croft+W%2E+2017%2E+Joint+representation+learning+for+topn+recommendation+with+heterogeneous+information+sources%2E+ACM+on+Conference+on+Information+and+Knowledge+Management+%28IC)
32. Zheng L., Noroozi V., and Yu P. S. 2017. Joint deep modeling of users and items using reviews for recommendation, 10 th ACM International Conference on Web Search and Data Mining (WSDM): 425-434. [find](https://scholar.google.com/scholar?q=Zheng+L%2E%2C+Noroozi+V%2E%2C+and+Yu+P%2E+S%2E+2017%2E+Joint+deep+modeling+of+users+and+items+using+reviews+for+recommendation%2C+10+th+ACM+International+Conference+on+Web+Search+and+Data+Mining+%28WSDM%29%3A+425%2D434%2E)

*Updated 2 November 2026*