---
title: "SMTE at ATE-IT — paper by Maule and Nunzio (2026)"
description: "The paper presents SMTE, a system for Subtask A of the ATE-IT shared task at EVALITA 2026. 11 references, cited by 1 paper here."
authors: ["Sofia Maule", "Giorgio Maria Di Nunzio"]
year: 2026
venue: "Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026)"
source: "https://aclanthology.org/2026.evalita-1.55/"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/maule-2026-smte-ate-it-ensemble-term/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/maule-2026-smte-ate-it-ensemble-term/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/17/) / SMTE at ATE-IT: Ensemble Term Extraction with Italian BERT, spaCy, and Vocabulary-Based Filtering

# SMTE at ATE-IT: Ensemble Term Extraction with Italian BERT, spaCy, and Vocabulary-Based Filtering

**Authors:** Sofia Maule and [Giorgio Maria Di Nunzio](https://md.research.elamur.ai/free/en/authors/giorgio-maria-di-nunzio/) · **Year:** 2026 · **Venue:** [Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026)](https://md.research.elamur.ai/free/en/venues/evalita/) ([Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop 2026](https://md.research.elamur.ai/free/en/venues/evalita/2026/)) · **Publisher:** [CEUR Workshop Proceedings](https://md.research.elamur.ai/free/en/publishers/ceur-workshop-proceedings/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.evalita-1.55/) · [PDF](https://aclanthology.org/2026.evalita-1.55.pdf) · [OpenAlex](https://openalex.org/W7204978345)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper presents SMTE, a system for Subtask A of the ATE-IT shared task at EVALITA 2026. The task is to extract single- and multi-word domain terms from Italian institutional sentences about municipal waste management. Outputs must be lowercase, have no duplicates within a sentence, and exclude terms nested inside longer ones.

SMTE combines two supervised taggers:
- dbmdz/bert-base-italian-uncased, fine-tuned with BIO labels;
- a spaCy NER component (it_core_news_md), retrained for a single TERM label.

A whitelist of normalized gold terms from train+dev guides how their outputs are merged. Short BERT fragments are swapped for longer spaCy spans found in the vocabulary, and further vocabulary-backed spaCy multiwords are added. Rule-based cleanup then discards truncated spans, generic single words and nested terms.

The authors report that the ensemble beats either tagger alone, whereas LLM reranking did not raise Micro F1. The study shows that strict, deterministic constraint handling matters, because every rule violation counts as a false positive.

## Key points
- Evaluation uses Micro F1 (over occurrences) and Type F1 (over unique terms). The official scores are in a section missing from the extracted text.
- BERT setup: HuggingFace Trainer on train+dev, learning rate 2×10⁻⁵, batch 16, 7 epochs, weight decay 0.01, warmup ratio 0.1, seed 42.
- spaCy setup: 40 iterations, dropout 0.1, batch 8. Sentences without any TERM annotation are excluded from training.
- Post-processing removes multiword candidates ending in a function word (e.g., "di", "dei", "e"). It resolves nesting by greedily keeping the longest character spans.
- Main limitation: the gold-derived vocabulary may cap recall on unseen test terminology. Code is available at github.com/sofiamaule/ATE-IT_SofiaMaule.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Padua](https://md.research.elamur.ai/free/en/universities/university-of-padua/) — University, Padua, Italy · 18 works · 4,260 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

## Cite

Cite as: Sofia Maule and Giorgio Maria Di Nunzio. 2026. SMTE at ATE-IT: Ensemble Term Extraction with Italian BERT, spaCy, and Vocabulary-Based Filtering. Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{maule2026smte,
  title = {{SMTE at ATE-IT: Ensemble Term Extraction with Italian BERT, spaCy, and Vocabulary-Based Filtering}},
  author = {Sofia Maule and Giorgio Maria {Di Nunzio}},
  booktitle = {Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026)},
  year = {2026},
  url = {https://aclanthology.org/2026.evalita-1.55/}
}
```

- [← previous SMARTER: A Data-efficient Framework to Improve Toxicity Detection with Explanation via Self-augmenting Large Language Models](https://md.research.elamur.ai/free/en/papers/nghiem-2026-smarter-data-efficient-framework-improve/)
- [next → Social Story Frames: Contextual Reasoning about Narrative Intent and Reception](https://md.research.elamur.ai/free/en/papers/mire-2026-social-story-frames-contextual-reasoning/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/17/)

## References

11 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. G. M. Di Nunzio, S. Marchesin, G. Silvello, A systematic review of Automatic Term Extraction: What happened in 2022?, Digital Scholarship in the Humanities 38 (2023) i41–i47. doi: 10.1093/ llc/fqad030 . [find](https://scholar.google.com/scholar?q=G%2E+M%2E+Di+Nunzio%2C+S%2E+Marchesin%2C+G%2E+Silvello%2C+A+systematic+review+of+Automatic+Term+Extraction%3A+What+happened+in+2022%3F%2C+Digital+Scholarship+in+the+Humanities+38+%282023%29+i41%E2%80%93i47%2E+doi%3A+10%2E1093%2F+llc%2Ffqad030)
2. B. Jehangir, S. Radhakrishnan, R. Agarwal, A survey on Named Entity Recognition — datasets, tools, and methodologies, Natural Language Processing Journal 3 (2023) 100017. doi: 10.1016/j. nlp.2023.100017 . — [doi:10.1016/j](https://doi.org/10.1016/j) [find](https://scholar.google.com/scholar?q=B%2E+Jehangir%2C+S%2E+Radhakrishnan%2C+R%2E+Agarwal%2C+A+survey+on+Named+Entity+Recognition+%E2%80%94+datasets%2C+tools%2C+and+methodologies%2C+Natural+Language+Processing+Journal+3+%282023%29+100017%2E+doi%3A+10%2E1016%2Fj%2E+nlp%2E2023%2E1000)
3. F. Cutugno, A. Miaschi, A. P. Aprosio, G. Rambelli, L. Siciliani, M. A. Stranisci, Evalita 2026: Overview of the 9th evaluation campaign of natural language processing and speech tools for italian, in: Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for I… [find](https://scholar.google.com/scholar?q=F%2E+Cutugno%2C+A%2E+Miaschi%2C+A%2E+P%2E+Aprosio%2C+G%2E+Rambelli%2C+L%2E+Siciliani%2C+M%2E+A%2E+Stranisci%2C+Evalita+2026%3A+Overview+of+the+9th+evaluation+campaign+of+natural+language+processing+and+speech+tools+for+italian%2C+in)
4. N. Cirillo, G. M. Di Nunzio, F. Vezzani, Ate-it at evalita 2026: Overview of the automatic term extraction italian testbed task, in: Proceedings of the Ninth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2026), CEUR.org, Bari, Italy, 2026. [find](https://scholar.google.com/scholar?q=N%2E+Cirillo%2C+G%2E+M%2E+Di+Nunzio%2C+F%2E+Vezzani%2C+Ate%2Dit+at+evalita+2026%3A+Overview+of+the+automatic+term+extraction+italian+testbed+task%2C+in%3A+Proceedings+of+the+Ninth+Evaluation+Campaign+of+Natural+Language+Pr)
5. R. Verborgh, M. Röder, R. Usbeck, A.-C. Ngonga Ngomo, Gerbil – benchmarking named entity recognition and linking consistently, Semantic Web 9 (2018) 605–625. doi: 10.3233/SW-170286 . — [doi:10.3233/sw-170286](https://doi.org/10.3233/sw-170286) [find](https://scholar.google.com/scholar?q=R%2E+Verborgh%2C+M%2E+R%C3%B6der%2C+R%2E+Usbeck%2C+A%2E%2DC%2E+Ngonga+Ngomo%2C+Gerbil+%E2%80%93+benchmarking+named+entity+recognition+and+linking+consistently%2C+Semantic+Web+9+%282018%29+605%E2%80%93625%2E+doi%3A+10%2E3233%2FSW%2D170286+%2E+%E2%80%94+%5Bdoi%3A10%2E3233%2Fsw)
6. M. Martinelli, Ata_tutorship: Tutorship baseline code and reference implementations for ate-it, GitHub repository, 2025. URL: [https://github.com/MMartinelli-hub/ATA_Tutorship](https://github.com/MMartinelli-hub/ATA_Tutorship). [↗](https://github.com/MMartinelli-hub/ATA_Tutorship)
7. J. Devlin, M.-W. Chang, K. Lee, K. Toutanova, [Bert: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/), in: Proceedings of NAACL-HLT, 2019, pp. 4171–4186. doi: 10.18653/ v1/N19-1423 .
8. L. Ramshaw, M. Marcus, [Text Chunking using Transformation-Based Learning](https://md.research.elamur.ai/free/en/papers/ramshaw-1995-text-chunking-transformation-based-learning/), in: Third Workshop on Very Large Corpora, 1995.
9. T. Wolf, L. Debut, V. Sanh, J. Chaumond, C. Delangue, A. Moi, P. Cistac, T. Rault, R. Louf, M. Funtowicz, J. Brew, [Transformers: State-of-the-art natural language processing](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/), in: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, 2020, pp.…
10. M. Honnibal, I. Montani, S. Van Landeghem, A. Boyd, spacy: Industrial-strength natural language processing in python, Website, 2025. URL: [https://spacy.io/](https://spacy.io/). [↗](https://spacy.io/)
11. ATE-IT Shared Task, Ate-it results (evalita 2026) — official leaderboard, Website, 2025. URL: [https://nicolacirillo.github.io/ate-it/results.html](https://nicolacirillo.github.io/ate-it/results.html). [↗](https://nicolacirillo.github.io/ate-it/results.html)

*Updated 31 October 2026*