---
title: "AC/DG at Cruciverb-IT — paper by Yassine et al. (2026)"
description: "The paper tackles Task 1 of Cruciverb-IT (EVALITA 2026): given an Italian crossword clue and the… 21 references, cited by 1 paper here."
authors: ["Ali Yassine", "Claudio Savelli", "Davide Napolitano", "Giuseppe Gallipoli", "Luca Cagliero", "Elena Baralis"]
year: 2026
venue: "Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026)"
source: "https://aclanthology.org/2026.evalita-1.37/"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/yassine-2026-ac-dg-cruciverb-it-retrieval/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/yassine-2026-ac-dg-cruciverb-it-retrieval/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/) / AC/DG at Cruciverb-IT: Retrieval-Based Approaches for Italian Crossword Clue Answering

# AC/DG at Cruciverb-IT: Retrieval-Based Approaches for Italian Crossword Clue Answering

**Authors:** [Ali Yassine](https://md.research.elamur.ai/free/en/authors/ali-yassine/), [Claudio Savelli](https://md.research.elamur.ai/free/en/authors/claudio-savelli/), Davide Napolitano, [Giuseppe Gallipoli](https://md.research.elamur.ai/free/en/authors/giuseppe-gallipoli/), [Luca Cagliero](https://md.research.elamur.ai/free/en/authors/luca-cagliero/) and Elena Baralis · **Year:** 2026 · **Venue:** [Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026)](https://md.research.elamur.ai/free/en/venues/evalita/) ([Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop 2026](https://md.research.elamur.ai/free/en/venues/evalita/2026/)) · **Publisher:** [CEUR Workshop Proceedings](https://md.research.elamur.ai/free/en/publishers/ceur-workshop-proceedings/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.evalita-1.37/) · [PDF](https://aclanthology.org/2026.evalita-1.37.pdf) · [OpenAlex](https://openalex.org/W7218089687)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper tackles Task 1 of Cruciverb-IT (EVALITA 2026): given an Italian crossword clue and the length of the expected answer, a system must return a ranked list of candidate solutions. Italian makes this hard because it has many near-synonyms and rich inflection, such as gender and number variants. The AC/DG team (Politecnico di Torino) frames the problem as retrieval over a training set of roughly 410,000 clue–answer pairs built from ItaCW plus web-collected data. They compare three systems:

- a tuned BM25 lexical retriever;
- a dense retriever built on Italian sentence embeddings;
- a hybrid in which a zero-shot Qwen3 8B model judges and reorders the top BM25 and dense candidates, and can generate a new answer if neither seems right.

All three beat the official BM25 baseline. Dense retrieval performs best on every metric. The LLM judge does not surpass it, partly because near-duplicate clues produce plausible but wrong distractors. The work matters because it shows that simple embedding-based retrieval is a strong, inexpensive approach for crossword answering in a morphologically rich, non-English language.

## Key points
- **Data and evaluation:** The dataset combines ItaCW with web-sourced clue–answer pairs (about 410k unique pairs). External sources containing crossword clues were banned. Systems are scored with Acc@1, Acc@10 and MRR.
- **Official baseline:** It retrieves the 10 most BM25-similar training clues and returns their answers. Scores were Acc@1 0.394, Acc@10 0.612 and MRR 0.457.
- **Dense retrieval (best system):** It uses `nickprock/sentence-bert-base-italian-xxl-uncased` and reaches Acc@1 0.510 (+29.4%), Acc@10 0.730 and MRR 0.570.
- **Optimized BM25:** It scores Acc@1 0.470, Acc@10 0.670 and MRR 0.530. It is strongest when test clues lexically overlap with training clues.
- **Hybrid Qwen3 8B judge (zero-shot, with generative fallback):** It scores Acc@1 0.460, Acc@10 0.690 and MRR 0.520. That puts it below BM25 at Acc@1 but above it at Acc@10. The authors propose future work on per-category clue analysis and on full grid solving (Task 2).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Politecnico di Torino](https://md.research.elamur.ai/free/en/universities/politecnico-di-torino/) — University, Turin, Italy · 11 works · 18 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works

🧭 Topics (1): [🔍 Information retrieval & search](https://md.research.elamur.ai/free/en/topics/information-retrieval/) · 473 works

## Cite

Cite as: Ali Yassine, Claudio Savelli, Davide Napolitano, Giuseppe Gallipoli, Luca Cagliero and Elena Baralis. 2026. AC/DG at Cruciverb-IT: Retrieval-Based Approaches for Italian Crossword Clue Answering. Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{yassine2026ac,
  title = {{AC/DG at Cruciverb-IT: Retrieval-Based Approaches for Italian Crossword Clue Answering}},
  author = {Ali Yassine, Claudio Savelli, Davide Napolitano, Giuseppe Gallipoli, Luca Cagliero and Elena Baralis},
  booktitle = {Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026)},
  year = {2026},
  url = {https://aclanthology.org/2026.evalita-1.37/}
}
```

- [← previous Aatman at SemEval-2026 Task 9: Transfer Learning for Multilingual Polarization Detection](https://md.research.elamur.ai/free/en/papers/vaidya-2026-aatman-semeval-2026-task-9/)
- [next → Activation-Guided Local Editing for Jailbreaking Attacks](https://md.research.elamur.ai/free/en/papers/wang-2026-activation-guided-local-editing-jailbreaking/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/)

## References

21 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. S. Kulshreshtha, O. Kovaleva, N. Shivagunde, A. Rumshisky, Down and across: Introducing crossword-solving as a new NLP benchmark, in: S. Muresan, P. Nakov, A. Villavicencio (Eds.), Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Associ… [find](https://scholar.google.com/scholar?q=S%2E+Kulshreshtha%2C+O%2E+Kovaleva%2C+N%2E+Shivagunde%2C+A%2E+Rumshisky%2C+Down+and+across%3A+Introducing+crossword%2Dsolving+as+a+new+NLP+benchmark%2C+in%3A+S%2E+Muresan%2C+P%2E+Nakov%2C+A%2E+Villavicencio+%28Eds%2E%29%2C+Proceedings+of+the+)
2. G. Angelini, M. Ernandes, M. Gori, Solving italian crosswords using the web, in: S. Bandini, S. Manzoni (Eds.), AI*IA 2005: Advances in Artificial Intelligence, Springer Berlin Heidelberg, Berlin, Heidelberg, 2005, pp. 393–405. [find](https://scholar.google.com/scholar?q=G%2E+Angelini%2C+M%2E+Ernandes%2C+M%2E+Gori%2C+Solving+italian+crosswords+using+the+web%2C+in%3A+S%2E+Bandini%2C+S%2E+Manzoni+%28Eds%2E%29%2C+AI%2AIA+2005%3A+Advances+in+Artificial+Intelligence%2C+Springer+Berlin+Heidelberg%2C+Berlin%2C+Hei)
3. G. Barlacchi, M. Nicosia, A. Moschitti, A retrieval model for automatic resolution of crossword puzzles in italian language, in: Proceedings of the First Italian Conference on Computational Linguistics CLiC-it 2014 & the Fourth International Workshop EVALITA 2014: 9-11 December 2014, Pisa, Pisa Univ… [find](https://scholar.google.com/scholar?q=G%2E+Barlacchi%2C+M%2E+Nicosia%2C+A%2E+Moschitti%2C+A+retrieval+model+for+automatic+resolution+of+crossword+puzzles+in+italian+language%2C+in%3A+Proceedings+of+the+First+Italian+Conference+on+Computational+Linguistic)
4. P. Giadikiaroglou, M. Lymperaiou, G. Filandrianos, G. Stamou, [Puzzle solving using reasoning of large language models: A survey](https://md.research.elamur.ai/free/en/papers/giadikiaroglou-2024-puzzle-solving-reasoning-large-language/), in: Y. Al-Onaizan, M. Bansal, Y.-N. Chen (Eds.), Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Association for Computational Ling…
5. S. Saha, S. Chakraborty, S. Saha, U. Garain, Language models are crossword solvers, in: L. Chiruzzo, A. Ritter, L. Wang (Eds.), Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Pape… [find](https://scholar.google.com/scholar?q=S%2E+Saha%2C+S%2E+Chakraborty%2C+S%2E+Saha%2C+U%2E+Garain%2C+Language+models+are+crossword+solvers%2C+in%3A+L%2E+Chiruzzo%2C+A%2E+Ritter%2C+L%2E+Wang+%28Eds%2E%29%2C+Proceedings+of+the+2025+Conference+of+the+Nations+of+the+Americas+Chapte)
6. A. Sadallah, D. Kotova, E. Kochmar, What makes cryptic crosswords challenging for LLMs?, in: O. Rambow, L. Wanner, M. Apidianaki, H. Al-Khalifa, B. D. Eugenio, S. Schockaert (Eds.), Proceedings of the 31st International Conference on Computational Linguistics, Association for Computational Linguisti… [find](https://scholar.google.com/scholar?q=A%2E+Sadallah%2C+D%2E+Kotova%2C+E%2E+Kochmar%2C+What+makes+cryptic+crosswords+challenging+for+LLMs%3F%2C+in%3A+O%2E+Rambow%2C+L%2E+Wanner%2C+M%2E+Apidianaki%2C+H%2E+Al%2DKhalifa%2C+B%2E+D%2E+Eugenio%2C+S%2E+Schockaert+%28Eds%2E%29%2C+Proceedings+of+the)
7. C. Ciaccio, G. Sarti, A. Miaschi, F. Dell’Orletta, Crossword space: Latent manifold learning for Italian crosswords and beyond, in: C. Bosco, E. Jezek, M. Polignano, M. Sanguinetti (Eds.), Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025), CEUR Workshop Proce… [find](https://scholar.google.com/scholar?q=C%2E+Ciaccio%2C+G%2E+Sarti%2C+A%2E+Miaschi%2C+F%2E+Dell%E2%80%99Orletta%2C+Crossword+space%3A+Latent+manifold+learning+for+Italian+crosswords+and+beyond%2C+in%3A+C%2E+Bosco%2C+E%2E+Jezek%2C+M%2E+Polignano%2C+M%2E+Sanguinetti+%28Eds%2E%29%2C+Proceedings)
8. C. Ciaccio, G. Sarti, A. Miaschi, F. Dell’Orletta, M. Nissim, Cruciverb-it @ evalita 2026: Overview of the crossword solving in italian task, in: Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026), CEUR.org, Bari, I… [find](https://scholar.google.com/scholar?q=C%2E+Ciaccio%2C+G%2E+Sarti%2C+A%2E+Miaschi%2C+F%2E+Dell%E2%80%99Orletta%2C+M%2E+Nissim%2C+Cruciverb%2Dit+%40+evalita+2026%3A+Overview+of+the+crossword+solving+in+italian+task%2C+in%3A+Proceedings+of+the+Ninth+Evaluation+Campaign+of+Natura)
9. F. Cutugno, A. Miaschi, A. P. Aprosio, G. Rambelli, L. Siciliani, M. A. Stranisci, Evalita 2026: Overview of the 9th evaluation campaign of natural language processing and speech tools for italian, in: Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for I… [find](https://scholar.google.com/scholar?q=F%2E+Cutugno%2C+A%2E+Miaschi%2C+A%2E+P%2E+Aprosio%2C+G%2E+Rambelli%2C+L%2E+Siciliani%2C+M%2E+A%2E+Stranisci%2C+Evalita+2026%3A+Overview+of+the+9th+evaluation+campaign+of+natural+language+processing+and+speech+tools+for+italian%2C+in)
10. E. Wallace, N. Tomlin, A. Xu, K. Yang, E. Pathak, M. Ginsberg, D. Klein, Automated crossword solving, in: S. Muresan, P. Nakov, A. Villavicencio (Eds.), Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Ling… [find](https://scholar.google.com/scholar?q=E%2E+Wallace%2C+N%2E+Tomlin%2C+A%2E+Xu%2C+K%2E+Yang%2C+E%2E+Pathak%2C+M%2E+Ginsberg%2C+D%2E+Klein%2C+Automated+crossword+solving%2C+in%3A+S%2E+Muresan%2C+P%2E+Nakov%2C+A%2E+Villavicencio+%28Eds%2E%29%2C+Proceedings+of+the+60th+Annual+Meeting+of+the+A)
11. J. Rozner, C. Potts, K. Mahowald, Decrypting cryptic crosswords: Semantically complex wordplay puzzles as a target for nlp, in: M. Ranzato, A. Beygelzimer, Y. Dauphin, P. Liang, J. W. Vaughan (Eds.), Advances in Neural Information Processing Systems, volume 34, Curran Associates, Inc., 2021, pp. 114… [find](https://scholar.google.com/scholar?q=J%2E+Rozner%2C+C%2E+Potts%2C+K%2E+Mahowald%2C+Decrypting+cryptic+crosswords%3A+Semantically+complex+wordplay+puzzles+as+a+target+for+nlp%2C+in%3A+M%2E+Ranzato%2C+A%2E+Beygelzimer%2C+Y%2E+Dauphin%2C+P%2E+Liang%2C+J%2E+W%2E+Vaughan+%28Eds%2E%29%2C+)
12. A. Efrat, U. Shaham, D. Kilman, O. Levy, Cryptonite: A cryptic crossword benchmark for extreme ambiguity in language, in: M.-F. Moens, X. Huang, L. Specia, S. W.-t. Yih (Eds.), Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Association for Computational Lingu… [find](https://scholar.google.com/scholar?q=A%2E+Efrat%2C+U%2E+Shaham%2C+D%2E+Kilman%2C+O%2E+Levy%2C+Cryptonite%3A+A+cryptic+crossword+benchmark+for+extreme+ambiguity+in+language%2C+in%3A+M%2E%2DF%2E+Moens%2C+X%2E+Huang%2C+L%2E+Specia%2C+S%2E+W%2E%2Dt%2E+Yih+%28Eds%2E%29%2C+Proceedings+of+the+2021)
13. J. Huang, K. C.-C. Chang, [Towards reasoning in large language models: A survey](https://md.research.elamur.ai/free/en/papers/huang-2023-reasoning-large-language-models-survey/), in: A. Rogers, J. Boyd-Graber, N. Okazaki (Eds.), Findings of the Association for Computational Linguistics: ACL 2023, Association for Computational Linguistics, Toronto, Canada, 2023, pp. 1049–1065. URL: https://aclanth…
14. G. Sarti, T. Caselli, M. Nissim, A. Bisazza, Non verbis, sed rebus: Large language models are weak solvers of Italian rebuses, in: F. Dell’Orletta, A. Lenci, S. Montemagni, R. Sprugnoli (Eds.), Proceedings of the Tenth Italian Conference on Computational Linguistics (CLiC-it 2024), CEUR Workshop Pro… [find](https://scholar.google.com/scholar?q=G%2E+Sarti%2C+T%2E+Caselli%2C+M%2E+Nissim%2C+A%2E+Bisazza%2C+Non+verbis%2C+sed+rebus%3A+Large+language+models+are+weak+solvers+of+Italian+rebuses%2C+in%3A+F%2E+Dell%E2%80%99Orletta%2C+A%2E+Lenci%2C+S%2E+Montemagni%2C+R%2E+Sprugnoli+%28Eds%2E%29%2C+Procee)
15. K. Zeinalipour, T. Iaquinta, A. Zanollo, G. Angelini, L. Rigutini, M. Maggini, M. Gori, Italian crossword generator: Enhancing education through interactive word puzzles, in: F. Boschetti, G. E. Lebani, B. Magnini, N. Novielli (Eds.), Proceedings of the Ninth Italian Conference on Computational Ling… [find](https://scholar.google.com/scholar?q=K%2E+Zeinalipour%2C+T%2E+Iaquinta%2C+A%2E+Zanollo%2C+G%2E+Angelini%2C+L%2E+Rigutini%2C+M%2E+Maggini%2C+M%2E+Gori%2C+Italian+crossword+generator%3A+Enhancing+education+through+interactive+word+puzzles%2C+in%3A+F%2E+Boschetti%2C+G%2E+E%2E+Leban)
16. A. Zugarini, K. Zeinalipour, S. S. Kadali, M. Maggini, M. Gori, L. Rigutini, Clue-instruct: Text-based clue generation for educational crossword puzzles, in: N. Calzolari, M.-Y. Kan, V. Hoste, A. Lenci, S. Sakti, N. Xue (Eds.), Proceedings of the 2024 Joint International Conference on Computational… [find](https://scholar.google.com/scholar?q=A%2E+Zugarini%2C+K%2E+Zeinalipour%2C+S%2E+S%2E+Kadali%2C+M%2E+Maggini%2C+M%2E+Gori%2C+L%2E+Rigutini%2C+Clue%2Dinstruct%3A+Text%2Dbased+clue+generation+for+educational+crossword+puzzles%2C+in%3A+N%2E+Calzolari%2C+M%2E%2DY%2E+Kan%2C+V%2E+Hoste%2C+A%2E+Lenc)
17. G. Gallipoli, L. Cagliero, [It is not a piece of cake for GPT: Explaining textual entailment recognition in the presence of figurative language](https://md.research.elamur.ai/free/en/papers/gallipoli-2025-it-is-not-piece-cake/), in: O. Rambow, L. Wanner, M. Apidianaki, H. Al-Khalifa, B. D. Eugenio, S. Schockaert (Eds.), Proceedings of the 31st International Conference on Computation…
18. G. Gallipoli, M. L. Quatra, D. R. Cambrin, S. Greco, L. Cagliero, DANTE at geolingit: Dialect-aware multi-granularity pre-training for locating tweets within italy, in: Proceedings of the Eighth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA… [find](https://scholar.google.com/scholar?q=G%2E+Gallipoli%2C+M%2E+L%2E+Quatra%2C+D%2E+R%2E+Cambrin%2C+S%2E+Greco%2C+L%2E+Cagliero%2C+DANTE+at+geolingit%3A+Dialect%2Daware+multi%2Dgranularity+pre%2Dtraining+for+locating+tweets+within+italy%2C+in%3A+Proceedings+of+the+Eighth+Evalu)
19. K. Zeinalipour, T. Iaquinta, A. Zanollo, G. Angelini, L. Rigutini, M. Maggini, M. Gori, Italian crossword generator: Enhancing education through interactive word puzzles (2023). [find](https://scholar.google.com/scholar?q=K%2E+Zeinalipour%2C+T%2E+Iaquinta%2C+A%2E+Zanollo%2C+G%2E+Angelini%2C+L%2E+Rigutini%2C+M%2E+Maggini%2C+M%2E+Gori%2C+Italian+crossword+generator%3A+Enhancing+education+through+interactive+word+puzzles+%282023%29%2E)
20. C. Savelli, F. Giobergia, Enhancing cross-lingual word embeddings: Aligned subword vectors for out-of-vocabulary terms in fasttext, in: 2024 IEEE 18th International Conference on Application of Information and Communication Technologies (AICT), IEEE, 2024, pp. 1–6. [find](https://scholar.google.com/scholar?q=C%2E+Savelli%2C+F%2E+Giobergia%2C+Enhancing+cross%2Dlingual+word+embeddings%3A+Aligned+subword+vectors+for+out%2Dof%2Dvocabulary+terms+in+fasttext%2C+in%3A+2024+IEEE+18th+International+Conference+on+Application+of+Inform)
21. D. Rege Cambrin, G. Gallipoli, I. Benedetto, L. Cagliero, P. Garza, Beyond accuracy optimization: Computer vision losses for large language model fine-tuning, in: Y. Al-Onaizan, M. Bansal, Y.-N. Chen (Eds.), Findings of the Association for Computational Linguistics: EMNLP 2024, Association for Compu… [find](https://scholar.google.com/scholar?q=D%2E+Rege+Cambrin%2C+G%2E+Gallipoli%2C+I%2E+Benedetto%2C+L%2E+Cagliero%2C+P%2E+Garza%2C+Beyond+accuracy+optimization%3A+Computer+vision+losses+for+large+language+model+fine%2Dtuning%2C+in%3A+Y%2E+Al%2DOnaizan%2C+M%2E+Bansal%2C+Y%2E%2DN%2E+Chen+)

*Updated 31 October 2026*