---
title: "Overview of the EVALITA 2018 Task on Irony — Cignarella 2018"
description: "IronITA, a shared task at EVALITA 2018, addresses automatic irony recognition in Italian Twitter posts."
authors: ["Alessandra Teresa Cignarella", "Simona Frenda", "Valerio Basile", "Cristina Bosco", "Viviana Patti", "Paolo Rosso"]
year: 2018
venue: "Proceedings of the Sixth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2018)"
source: "https://aclanthology.org/2018.evalita-1.6/"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/cignarella-2018-overview-evalita-2018-task-irony/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/cignarella-2018-overview-evalita-2018-task-irony/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2018](https://md.research.elamur.ai/free/papers/2018/page/3/) / Overview of the EVALITA 2018 Task on Irony Detection in Italian Tweets (IronITA)

# Overview of the EVALITA 2018 Task on Irony Detection in Italian Tweets (IronITA)

**Authors:** [Alessandra Teresa Cignarella](https://md.research.elamur.ai/free/authors/alessandra-teresa-cignarella/), [Simona Frenda](https://md.research.elamur.ai/free/authors/simona-frenda/), [Valerio Basile](https://md.research.elamur.ai/free/authors/valerio-basile/), [Cristina Bosco](https://md.research.elamur.ai/free/authors/cristina-bosco/), [Viviana Patti](https://md.research.elamur.ai/free/authors/viviana-patti/), [Paolo Rosso](https://md.research.elamur.ai/free/authors/paolo-rosso/) · **Year:** 2018 · **Venue:** Proceedings of the Sixth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2018) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2018.evalita-1.6/) · [PDF](https://aclanthology.org/2018.evalita-1.6.pdf) · [OpenAlex](https://openalex.org/W2907186736)

**Citations:** 60 citations (openalex-snapshot · 2026-10-14) · [35](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
IronITA, a shared task at EVALITA 2018, addresses automatic irony recognition in Italian Twitter posts. Irony can flip the apparent polarity of a message, which harms sentiment analysis and opinion mining. The task had two subtasks. Task A was a binary ironic/non-ironic decision. Task B was a three-way split into sarcasm, other irony, and non-irony. Sarcasm was defined as pointed, target-directed irony meant to hurt or criticize. The organizers built the data from existing annotated corpora, the Hate Speech Corpus (HSC) and TWITTIRÒ. Native-speaker annotators then added a new layer marking sarcasm within the ironic tweets. Systems were scored by macro F1 against two baselines: most-frequent-class and random. Seven teams took part. The best Task A system, ItaliaNLP, used a deep-learning, multi-task setup. It clearly beat earlier irony subtasks run within SENTIPOLC and was comparable to results for English at SemEval2018-Task3. The organizers see this as evidence that Italian NLP resources are maturing. They also note that separating sarcasm from other irony remains hard, and Task B drew fewer participants.

## Key points
- **Dataset size and sources:** 3,977 training tweets and 872 test tweets (roughly an 82/18 split), shared by both tasks.
  - Sources are HSC plus TWITTIRÒ (TW-BS, TW-SENTIPOLC, TW-SPINO).
  - The test set also includes some TWITA tweets.
- **Sarcasm annotation:**
  - Four annotators produced the sarcasm labels.
  - 131 persistently disputed tweets were discarded.
  - Fleiss' κ was 0.56 on TWITTIRÒ and 0.52 on HSC.
- **Participation:** 17 Task A runs and 7 Task B runs came from 7 teams. Both constrained and unconstrained runs were allowed.
- **Task A results:**
  - Top macro F1 was 0.731 (ItaliaNLP, constrained run).
  - Earlier SENTIPOLC irony subtasks peaked at F = 0.575 (2014) and 0.5412 (2016).
- **Methods and resources:**
  - Teams used affective lexica such as SentiWordNet translations and the Distributed Polarity Lexicon.
  - Some exploited the fact that a sarcastic tweet must also be ironic, through multi-task learning (ItaliaNLP) or cascade classifiers (UNITOR).
  - The data overlaps with HaSpeeDe: 781 training tweets and 96 test tweets.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/)

## Cited by

Cited by

35 papers of our library cite it (of the 140673 whose bibliographies we read); 6 of them have a page here, 29 not yet.

- [DAICT: A Dialectal Arabic Irony Corpus Extracted from Twitter](https://md.research.elamur.ai/free/papers/abbes-2020-daict-dialectal-arabic-irony-corpus/)
- [Multilingual Irony Detection with Dependency Syntax and Neural Models](https://md.research.elamur.ai/free/papers/cignarella-2020-multilingual-irony-detection-dependency-syntax/)
- [EPIC: Multi-Perspective Annotation of a Corpus of Irony](https://md.research.elamur.ai/free/papers/frenda-2023-epic-multi-perspective-annotation-corpus/)
- [When did you become so smart, oh wise one?! Sarcasm Explanation in Multi-modal Multi-party Dialogues](https://md.research.elamur.ai/free/papers/kumar-2022-when-did-you-become-so/)
- [iSarcasm: A Dataset of Intended Sarcasm](https://md.research.elamur.ai/free/papers/oprea-2020-isarcasm-dataset-intended-sarcasm/)
- [A Survey in Automatic Irony Processing: Linguistic, Cognitive, and Multi-X Perspectives](https://md.research.elamur.ai/free/papers/zeng-2022-survey-automatic-irony-processing-linguistic/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{cignarella2018overview,
  title = {{Overview of the EVALITA 2018 Task on Irony Detection in Italian Tweets (IronITA)}},
  author = {Cignarella, Alessandra Teresa and Frenda, Simona and Basile, Valerio and Bosco, Cristina and Patti, Viviana and Rosso, Paolo},
  booktitle = {Proceedings of the Sixth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2018)},
  year = {2018},
  doi = {10.4000/books.aaccademia.4470},
  url = {https://doi.org/10.4000/books.aaccademia.4470}
}
```

- [← previous OpenSubtitles2018: Statistical Rescoring of Sentence Alignments in Large, Noisy Parallel Corpora](https://md.research.elamur.ai/free/papers/lison-2018-opensubtitles2018-statistical-rescoring-sentence-alignments/)
- [next → ParaNMT-50M: Pushing the Limits of Paraphrastic Sentence Embeddings with Millions of Machine Translations](https://md.research.elamur.ai/free/papers/wieting-2018-paranmt-50m-pushing-limits-paraphrastic/)
- [↑ back to papers of 2018](https://md.research.elamur.ai/free/papers/2018/page/3/)

## References

36 references, 6 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Salvatore Attardo. 2007. Irony as relevant inappropriateness. In H. Colston and R. Gibbs, editors, Irony in language and thought: A cognitive science reader, pages 135–172. Lawrence Erlbaum. [find](https://scholar.google.com/scholar?q=Salvatore+Attardo%2E+2007%2E+Irony+as+relevant+inappropriateness%2E+In+H%2E+Colston+and+R%2E+Gibbs%2C+editors%2C+Irony+in+language+and+thought%3A+A+cognitive+science+reader%2C+pages+135%E2%80%93172%2E+Lawrence+Erlbaum%2E)
2. Francesco Barbieri, Valerio Basile, Danilo Croce, Malvina Nissim, Nicole Novielli, and Viviana Patti. 2016. Overview of the Evalita 2016 sentiment polarity classification task. In Proceedings of 3rd Italian Conference on Computational Linguistics (CLiC-it 2016) & 5th Evaluation Campaign of Natural L… [find](https://scholar.google.com/scholar?q=Francesco+Barbieri%2C+Valerio+Basile%2C+Danilo+Croce%2C+Malvina+Nissim%2C+Nicole+Novielli%2C+and+Viviana+Patti%2E+2016%2E+Overview+of+the+Evalita+2016+sentiment+polarity+classification+task%2E+In+Proceedings+of+3rd+I)
3. Pierpaolo Basile and Giovanni Semeraro. 2018. UNIBA - Integrating distributional semantics features in a supervised approach for detecting irony in Italian tweets. In Proceedings of the 6th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA’18), Turin, Italy. CE… [find](https://scholar.google.com/scholar?q=Pierpaolo+Basile+and+Giovanni+Semeraro%2E+2018%2E+UNIBA+%2D+Integrating+distributional+semantics+features+in+a+supervised+approach+for+detecting+irony+in+Italian+tweets%2E+In+Proceedings+of+the+6th+evaluation)
4. Valerio Basile, Andrea Bolioli, Malvina Nissim, Viviana Patti, and Paolo Rosso. 2014. Overview of the Evalita 2014 sentiment polarity classification task. In Proceedings of the 4th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA’14), Pisa, Italy. Pisa Univers… [find](https://scholar.google.com/scholar?q=Valerio+Basile%2C+Andrea+Bolioli%2C+Malvina+Nissim%2C+Viviana+Patti%2C+and+Paolo+Rosso%2E+2014%2E+Overview+of+the+Evalita+2014+sentiment+polarity+classification+task%2E+In+Proceedings+of+the+4th+evaluation+campaign)
5. Valerio Basile, Mirko Lai, and Manuela Sanguinetti. 2018. Long-term Social Media Data Collection at the University of Turin. In Proceedings of the 5th Italian Conference on Computational Linguistics (CLiC-it 2018), Turin, Italy. CEUR.org. [find](https://scholar.google.com/scholar?q=Valerio+Basile%2C+Mirko+Lai%2C+and+Manuela+Sanguinetti%2E+2018%2E+Long%2Dterm+Social+Media+Data+Collection+at+the+University+of+Turin%2E+In+Proceedings+of+the+5th+Italian+Conference+on+Computational+Linguistics+%28)
6. Cristina Bosco, Felice Dell’Orletta, Fabio Poletto, Manuela Sanguinetti, and Maurizio Tesconi. 2018. Overview of the Evalita 2018 Hate Speech Detection Task. In Proceedings of the 6th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA’18), Turin, Italy. CEUR.org… [find](https://scholar.google.com/scholar?q=Cristina+Bosco%2C+Felice+Dell%E2%80%99Orletta%2C+Fabio+Poletto%2C+Manuela+Sanguinetti%2C+and+Maurizio+Tesconi%2E+2018%2E+Overview+of+the+Evalita+2018+Hate+Speech+Detection+Task%2E+In+Proceedings+of+the+6th+evaluation+campa)
7. Andrea Bowes and Albert Katz. 2011. When sarcasm stings. Discourse Processes: A Multidisciplinary Journal, 48(4):215–236. [find](https://scholar.google.com/scholar?q=Andrea+Bowes+and+Albert+Katz%2E+2011%2E+When+sarcasm+stings%2E+Discourse+Processes%3A+A+Multidisciplinary+Journal%2C+48%284%29%3A215%E2%80%93236%2E)
8. Tommaso Caselli, Nicole Novielli, Viviana Patti, and Paolo Rosso. 2018. [find](https://scholar.google.com/scholar?q=Tommaso+Caselli%2C+Nicole+Novielli%2C+Viviana+Patti%2C+and+Paolo+Rosso%2E+2018%2E)
9. EVALITA 2018: Overview of the 6th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. In Proceedings of 6th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. [find](https://scholar.google.com/scholar?q=EVALITA+2018%3A+Overview+of+the+6th+Evaluation+Campaign+of+Natural+Language+Processing+and+Speech+Tools+for+Italian%2E+In+Proceedings+of+6th+Evaluation+Campaign+of+Natural+Language+Processing+and+Speech+T)
10. Final Workshop (EVALITA 2018), Turin, Italy. CEUR.org. [find](https://scholar.google.com/scholar?q=Final+Workshop+%28EVALITA+2018%29%2C+Turin%2C+Italy%2E+CEUR%2Eorg%2E)
11. Giuseppe Castellucci, Danilo Croce, and Roberto Basili. 2016. A language independent method for generating large scale polarity lexicons. In Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016), Portorož, Slovenia. ELRA. [find](https://scholar.google.com/scholar?q=Giuseppe+Castellucci%2C+Danilo+Croce%2C+and+Roberto+Basili%2E+2016%2E+A+language+independent+method+for+generating+large+scale+polarity+lexicons%2E+In+Proceedings+of+the+10th+International+Conference+on+Languag)
12. Alessandra Teresa Cignarella, Cristina Bosco, Viviana Patti, and Mirko Lai. 2018. Application and Analysis of a Multi-layered Scheme for Irony on the Italian Twitter Corpus TWITTIRÒ. In Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan… [find](https://scholar.google.com/scholar?q=Alessandra+Teresa+Cignarella%2C+Cristina+Bosco%2C+Viviana+Patti%2C+and+Mirko+Lai%2E+2018%2E+Application+and+Analysis+of+a+Multi%2Dlayered+Scheme+for+Irony+on+the+Italian+Twitter+Corpus+TWITTIR%C3%92%2E+In+Proceedings+of) [our card](https://md.research.elamur.ai/free/papers/cignarella-2018-application-analysis-multi-layered-scheme/)
13. Andrea Cimino, Lorenzo De Mattei, and Felice Dell’Orletta. 2018. Multi-task Learning in Deep Neural Networks at EVALITA 2018. In Proceedings of the 6th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA’18), Turin, Italy. CEUR.org. [find](https://scholar.google.com/scholar?q=Andrea+Cimino%2C+Lorenzo+De+Mattei%2C+and+Felice+Dell%E2%80%99Orletta%2E+2018%2E+Multi%2Dtask+Learning+in+Deep+Neural+Networks+at+EVALITA+2018%2E+In+Proceedings+of+the+6th+evaluation+campaign+of+Natural+Language+Processi)
14. Rodolfo Delmonte. 2014. A linguistic rule-based system for pragmatic text processing. In Proceedings of Fourth International Workshop EVALITA 2014, Pisa. Edizioni PLUS, Pisa University Press. [find](https://scholar.google.com/scholar?q=Rodolfo+Delmonte%2E+2014%2E+A+linguistic+rule%2Dbased+system+for+pragmatic+text+processing%2E+In+Proceedings+of+Fourth+International+Workshop+EVALITA+2014%2C+Pisa%2E+Edizioni+PLUS%2C+Pisa+University+Press%2E)
15. Emanuele Di Rosa and Alberto Durante. 2018. Irony detection in tweets: X2Check at Ironita 2018. In Proceedings of the 6th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA’18), Turin, Italy. CEUR.org. [find](https://scholar.google.com/scholar?q=Emanuele+Di+Rosa+and+Alberto+Durante%2E+2018%2E+Irony+detection+in+tweets%3A+X2Check+at+Ironita+2018%2E+In+Proceedings+of+the+6th+evaluation+campaign+of+Natural+Language+Processing+and+Speech+tools+for+Italia)
16. César Chesneau Du Marsais, Jean Paulhan, and Claude Mouchard. 1981. Traité des tropes. Le Nouveau Commerce. [find](https://scholar.google.com/scholar?q=C%C3%A9sar+Chesneau+Du+Marsais%2C+Jean+Paulhan%2C+and+Claude+Mouchard%2E+1981%2E+Trait%C3%A9+des+tropes%2E+Le+Nouveau+Commerce%2E)
17. Christopher J. Lee and Albert N. Katz. 1998. The differential role of ridicule in sarcasm and irony. Metaphor and Symbol, 13(1):1–15. [find](https://scholar.google.com/scholar?q=Christopher+J%2E+Lee+and+Albert+N%2E+Katz%2E+1998%2E+The+differential+role+of+ridicule+in+sarcasm+and+irony%2E+Metaphor+and+Symbol%2C+13%281%29%3A1%E2%80%9315%2E)
18. A. Marchetti, D. Massaro, and A. Valle. 2007. Non dicevo sul serio. Riflessioni su ironia e psicologia. Collana di psicologia. Franco Angeli. [find](https://scholar.google.com/scholar?q=A%2E+Marchetti%2C+D%2E+Massaro%2C+and+A%2E+Valle%2E+2007%2E+Non+dicevo+sul+serio%2E+Riflessioni+su+ironia+e+psicologia%2E+Collana+di+psicologia%2E+Franco+Angeli%2E)
19. Saif M Mohammad, Parinaz Sobhani, and Svetlana Kiritchenko. 2017. Stance and sentiment in tweets. ACM Transactions on Internet Technology (TOIT), 17(3):26. [find](https://scholar.google.com/scholar?q=Saif+M+Mohammad%2C+Parinaz+Sobhani%2C+and+Svetlana+Kiritchenko%2E+2017%2E+Stance+and+sentiment+in+tweets%2E+ACM+Transactions+on+Internet+Technology+%28TOIT%29%2C+17%283%29%3A26%2E)
20. Reynier Ortega-Bueno and José E. Medina Pagola. 2018. UO_IRO: Linguistic informed deep-learning model for irony detection. In Proceedings of the 6th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA’18), Turin, Italy. CEUR.org. [find](https://scholar.google.com/scholar?q=Reynier+Ortega%2DBueno+and+Jos%C3%A9+E%2E+Medina+Pagola%2E+2018%2E+UO%5FIRO%3A+Linguistic+informed+deep%2Dlearning+model+for+irony+detection%2E+In+Proceedings+of+the+6th+evaluation+campaign+of+Natural+Language+Processing+)
21. Marta Dynel. 2014. Linguistic approaches to (non) humorous irony. Humor - International Journal of Humor Research, 27(6):537–550. [find](https://scholar.google.com/scholar?q=Marta+Dynel%2E+2014%2E+Linguistic+approaches+to+%28non%29+humorous+irony%2E+Humor+%2D+International+Journal+of+Humor+Research%2C+27%286%29%3A537%E2%80%93550%2E)
22. Irene Russo, Francesca Frontini, and Valeria Quochi. 2016. OpeNER sentiment lexicon italian - LMF. ILC-CNR for CLARIN-IT repository hosted at Institute for Computational Linguistics “A. Zampolli”, National Research Council, in Pisa. [find](https://scholar.google.com/scholar?q=Irene+Russo%2C+Francesca+Frontini%2C+and+Valeria+Quochi%2E+2016%2E+OpeNER+sentiment+lexicon+italian+%2D+LMF%2E+ILC%2DCNR+for+CLARIN%2DIT+repository+hosted+at+Institute+for+Computational+Linguistics+%E2%80%9CA%2E+Zampolli%E2%80%9D%2C+Nat)
23. Andrea Esuli and Fabrizio Sebastiani. 2006. Sentiwordnet: A publicly available lexical resource for opinion mining. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC 2006), Genova, Italy. [find](https://scholar.google.com/scholar?q=Andrea+Esuli+and+Fabrizio+Sebastiani%2E+2006%2E+Sentiwordnet%3A+A+publicly+available+lexical+resource+for+opinion+mining%2E+In+Proceedings+of+the+5th+International+Conference+on+Language+Resources+and+Evaluat) [our card](https://md.research.elamur.ai/free/papers/esuli-2006-sentiwordnet-publicly-available-lexical-resource/)
24. Magnus Sahlgren. 2005. An introduction to random indexing. In In Methods and Applications of Semantic Indexing Workshop at the 7th International Conference on Terminology and Knowledge Engineering, TKE 2005. [find](https://scholar.google.com/scholar?q=Magnus+Sahlgren%2E+2005%2E+An+introduction+to+random+indexing%2E+In+In+Methods+and+Applications+of+Semantic+Indexing+Workshop+at+the+7th+International+Conference+on+Terminology+and+Knowledge+Engineering%2C+TK)
25. Elisabetta Fersini, Maria Anzovino, and Paolo Rosso. 2018. Overview of the Task on Automatic Misogyny Identification at IberEval. In Proceedings of 3rd Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval 2018). CEUR-WS.org. [find](https://scholar.google.com/scholar?q=Elisabetta+Fersini%2C+Maria+Anzovino%2C+and+Paolo+Rosso%2E+2018%2E+Overview+of+the+Task+on+Automatic+Misogyny+Identification+at+IberEval%2E+In+Proceedings+of+3rd+Workshop+on+Evaluation+of+Human+Language+Technol)
26. Manuela Sanguinetti, Fabio Poletto, Cristina Bosco, Viviana Patti, and Marco Stranisci. 2018. An Italian Twitter Corpus of Hate Speech against Immigrants. In Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan. [find](https://scholar.google.com/scholar?q=Manuela+Sanguinetti%2C+Fabio+Poletto%2C+Cristina+Bosco%2C+Viviana+Patti%2C+and+Marco+Stranisci%2E+2018%2E+An+Italian+Twitter+Corpus+of+Hate+Speech+against+Immigrants%2E+In+Proceedings+of+the+11th+International+Conf) [our card](https://md.research.elamur.ai/free/papers/sanguinetti-2018-italian-twitter-corpus-hate-speech/)
27. Joseph L. Fleiss. 1971. Measuring nominal scale agreement among many raters. Psychological bulletin. [find](https://scholar.google.com/scholar?q=Joseph+L%2E+Fleiss%2E+1971%2E+Measuring+nominal+scale+agreement+among+many+raters%2E+Psychological+bulletin%2E)
28. Andrea Santilli, Danilo Croce, and Roberto Basili. 2018. A Kernel-based Approach for Irony and Sarcasm Detection in Italian. In Proceedings of the 6th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA’18), Turin, Italy. CEUR.org. [find](https://scholar.google.com/scholar?q=Andrea+Santilli%2C+Danilo+Croce%2C+and+Roberto+Basili%2E+2018%2E+A+Kernel%2Dbased+Approach+for+Irony+and+Sarcasm+Detection+in+Italian%2E+In+Proceedings+of+the+6th+evaluation+campaign+of+Natural+Language+Processin)
29. Raymond W. Gibbs. 2000. Irony in talk among friends. Metaphor and symbol, 15(1-2):5–27. [find](https://scholar.google.com/scholar?q=Raymond+W%2E+Gibbs%2E+2000%2E+Irony+in+talk+among+friends%2E+Metaphor+and+symbol%2C+15%281%2D2%29%3A5%E2%80%9327%2E)
30. Rachel Giora, Adi Cholev, Ofer Fein, and Orna Pe-leg. 2018. On the superiority of defaultness: Hemi-spheric perspectives of processing negative and affirmative sarcasm. Metaphor and Symbol, 33(3):163– 174. [find](https://scholar.google.com/scholar?q=Rachel+Giora%2C+Adi+Cholev%2C+Ofer+Fein%2C+and+Orna+Pe%2Dleg%2E+2018%2E+On+the+superiority+of+defaultness%3A+Hemi%2Dspheric+perspectives+of+processing+negative+and+affirmative+sarcasm%2E+Metaphor+and+Symbol%2C+33%283%29%3A163%E2%80%93)
31. Valentino Giudice. 2018. Aspie96 at IronITA (EVALITA 2018): Irony Detection in Italian Tweets with Character-Level Convolutional RNN. In Proceedings of the 6th evaluation campaign of Natural Language Processing and Speech tools for Italian (EVALITA’18), Turin, Italy. CEUR.org. [find](https://scholar.google.com/scholar?q=Valentino+Giudice%2E+2018%2E+Aspie96+at+IronITA+%28EVALITA+2018%29%3A+Irony+Detection+in+Italian+Tweets+with+Character%2DLevel+Convolutional+RNN%2E+In+Proceedings+of+the+6th+evaluation+campaign+of+Natural+Language+)
32. Aditya Joshi, Pushpak Bhattacharyya, and Mark James Carman. 2017. Automatic sarcasm detection: A survey. ACM Comput. Surv., 50(5):73:1–73:22. [find](https://scholar.google.com/scholar?q=Aditya+Joshi%2C+Pushpak+Bhattacharyya%2C+and+Mark+James+Carman%2E+2017%2E+Automatic+sarcasm+detection%3A+A+survey%2E+ACM+Comput%2E+Surv%2E%2C+50%285%29%3A73%3A1%E2%80%9373%3A22%2E) [our card](https://md.research.elamur.ai/free/papers/joshi-2016-automatic-sarcasm-detection-survey/)
33. Petra Kralj Novak, Jasmina Smailović, Borut Sluban, and Igor Mozetič. 2015. Sentiment of emojis. PLOS ONE, 10(12):1–22, 12. [find](https://scholar.google.com/scholar?q=Petra+Kralj+Novak%2C+Jasmina+Smailovic%CC%81%2C+Borut+Sluban%2C+and+Igor+Mozetic%CC%8C%2E+2015%2E+Sentiment+of+emojis%2E+PLOS+ONE%2C+10%2812%29%3A1%E2%80%9322%2C+12%2E)
34. Marco Stranisci, Cristina Bosco, Delia Irazú Hernández Farías, and Viviana Patti. 2016. Annotating Sentiment and Irony in the Online Italian Political Debate on \#labuonascuola. In Proceedings of the 10th International Conference on Language Resources and Evaluation (LREC 2016), Portorož, Slovenia. E… [find](https://scholar.google.com/scholar?q=Marco+Stranisci%2C+Cristina+Bosco%2C+Delia+Iraz%C3%BA+Hern%C3%A1ndez+Far%C3%ADas%2C+and+Viviana+Patti%2E+2016%2E+Annotating+Sentiment+and+Irony+in+the+Online+Italian+Political+Debate+on+%5C%23labuonascuola%2E+In+Proceedings+of+the+) [our card](https://md.research.elamur.ai/free/papers/stranisci-2016-annotating-sentiment-irony-online-italian/)
35. Emilio Sulis, D. Irazú Hernández Farías, Paolo Rosso, Viviana Patti, and Giancarlo Ruffo. 2016. Figurative messages and affect in Twitter: Differences between \#irony, \#sarcasm and \#not. Knowledge-Based Systems, 108:132 – 143. New Avenues in Knowledge Bases for Natural Language Processing. [find](https://scholar.google.com/scholar?q=Emilio+Sulis%2C+D%2E+Iraz%C3%BA+Hern%C3%A1ndez+Far%C3%ADas%2C+Paolo+Rosso%2C+Viviana+Patti%2C+and+Giancarlo+Ruffo%2E+2016%2E+Figurative+messages+and+affect+in+Twitter%3A+Differences+between+%5C%23irony%2C+%5C%23sarcasm+and+%5C%23not%2E+Knowledge%2DB)
36. Cynthia Van Hee, Els Lefever, and Véronique Hoste. 2018. Semeval-2018 task 3: Irony detection in English tweets. In Proceedings of The 12th International Workshop on Semantic Evaluation. [find](https://scholar.google.com/scholar?q=Cynthia+Van+Hee%2C+Els+Lefever%2C+and+V%C3%A9ronique+Hoste%2E+2018%2E+Semeval%2D2018+task+3%3A+Irony+detection+in+English+tweets%2E+In+Proceedings+of+The+12th+International+Workshop+on+Semantic+Evaluation%2E) [our card](https://md.research.elamur.ai/free/papers/hee-2018-semeval-2018-task-3-irony/)