--- title: "SemEval-2021 Task 6 — paper by Dimitrov et al. (2021)" description: "This shared task addresses the automatic identification of propaganda and persuasion devices in memes. 1 reference, cited by 70 papers here." authors: ["Dimitar Dimitrov", "Bishr Bin Ali", "Shaden Shaar", "Firoj Alam", "Fabrizio Silvestri", "Hamed Firooz", "Preslav Nakov", "Giovanni Da San Martino"] year: 2021 venue: "Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)" source: "https://aclanthology.org/2021.semeval-1.7/" doi: "10.18653/v1/2021.semeval-1.7" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/dimitrov-2021-semeval-2021-task-6-detection/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/dimitrov-2021-semeval-2021-task-6-detection/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2021](https://md.research.elamur.ai/free/en/papers/2021/page/4/) / SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Images # SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Images **Authors:** [Dimitar Dimitrov](https://md.research.elamur.ai/free/en/authors/dimitar-dimitrov/), Bishr Bin Ali, [Shaden Shaar](https://md.research.elamur.ai/free/en/authors/shaden-shaar/), [Firoj Alam](https://md.research.elamur.ai/free/en/authors/firoj-alam/), Fabrizio Silvestri, [Hamed Firooz](https://md.research.elamur.ai/free/en/authors/hamed-firooz/), [Preslav Nakov](https://md.research.elamur.ai/free/en/authors/preslav-nakov/) and [Giovanni Da San Martino](https://md.research.elamur.ai/free/en/authors/giovanni-da-san-martino/) · **Year:** 2021 · **Venue:** [Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)](https://md.research.elamur.ai/free/en/venues/semeval/) ([SemEval 2021](https://md.research.elamur.ai/free/en/venues/semeval/2021/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2021.semeval-1.7/) · [PDF](https://aclanthology.org/2021.semeval-1.7.pdf) · [DOI 10.18653/v1/2021.semeval-1.7](https://doi.org/10.18653/v1/2021.semeval-1.7) · [OpenAlex](https://openalex.org/W3162359478) **Citations:** 5 citations (OpenAlex, 2026-10-14) · [70](https://md.research.elamur.ai/free/en/papers/dimitrov-2021-semeval-2021-task-6-detection/cited-by/) in our library, of the 141,840 papers whose bibliographies we read ## Summary This shared task addresses the automatic identification of propaganda and persuasion devices in memes. Memes carry their message through both overlaid text and the picture, so studying text alone misses part of the signal. Building on SemEval-2020 task 11, which covered news text only, the organisers created a multimodal corpus of memes. Annotators marked persuasion techniques in the text, including their exact spans, and also techniques expressed visually. The inventory grew to 22 techniques: 20 apply to both text and images, and 2 apply only to images. Three subtasks were defined: - text-level multilabel classification, - span-level tagging of techniques in the text, - whole-meme classification using both text and image. The task drew 71 registrations, 22 test-set submissions and 15 system papers. Transformer text encoders, mostly BERT, dominated. In the multimodal subtask, image encoders were usually ResNet variants. The results showed that both modalities contribute, and some teams found that modelling the interaction between text and image jointly worked better than simple early or late fusion. The task provides a benchmark for multimodal disinformation analysis. ## Key points - Subtasks: ST1 is multilabel classification of meme text over 20 techniques. ST2 adds span detection, making it a multilabel sequence tagging task. ST3 classifies the full meme (text plus image) over 22 techniques. Appeal to (Strong) Emotions and Transfer are image-only. - Participation: 71 registered teams, 22 official test submissions, 15 system description papers. - ST2 (F1-micro): Volta ranked first with .482, followed by HOMADOS (.407) and TeamFPAI (.397). A random span baseline scored .010. - ST3 (F1-micro): Alpha won with .581, ahead of MinD (.566) and 1213Li (.549). The majority baseline, which always predicts Smears, reached .354, and the random baseline reached .071. - Alpha's system was an ensemble of DeBERTa+ResNet, DeBERTa+BUTD and ERNIE-VIL. It used grid features from ResNet50 and salient-region features from BUTD. ## Interesting ideas - **Modality-specific labels.** The label inventory explicitly separates techniques that only make sense visually from those shared by text and image. This lets one corpus support both text-only and multimodal subtasks, a useful design for any annotation scheme covering mixed media. - **Copyright-safe examples.** All meme examples in the paper are the authors' own recreations built from images with clear licences. This is a practical way to illustrate sensitive social-media data in publications without redistributing copyrighted content. - **Span detection as QA.** TeamFPAI reframed span-level technique detection as machine reading comprehension, posing a question per technique and extracting answer spans. They combined this with data augmentation and loss design to cope with sparse, imbalanced labels. The same reframing could suit other low-resource span-labelling tasks. - **Label embeddings with attention.** 1213Li learned an embedding for each label and used multimodal attention to score how well each label matches the fused text-image features. This approach helps when there are many labels with uneven frequencies. - **Exploiting meme layout.** MinD added positional embeddings derived from OCR text boxes and a face recognition component. Layout and the people depicted can be cheap but informative signals for analysing memes or other image-text content. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* 📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works · [🤔 Philosophy](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/philosophy/) · 211 works 🧭 Topics (1): [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 269 works ## Cite Cite as: Dimitar Dimitrov, Bishr Bin Ali, Shaden Shaar, Firoj Alam, Fabrizio Silvestri, Hamed Firooz, Preslav Nakov and Giovanni Da San Martino. 2021. SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Images. Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{dimitrov2021semeval, title = {{SemEval-2021 Task 6: Detection of Persuasion Techniques in Texts and Images}}, author = {Dimitar Dimitrov, Bishr {Bin Ali}, Shaden Shaar, Firoj Alam, Fabrizio Silvestri, Hamed Firooz, Preslav Nakov and Giovanni {Da San Martino}}, booktitle = {Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)}, year = {2021}, doi = {10.18653/v1/2021.semeval-1.7}, url = {https://doi.org/10.18653/v1/2021.semeval-1.7} } ``` - [← previous Idiomatic Expression Identification using Semantic Compatibility](https://md.research.elamur.ai/free/en/papers/zeng-2021-idiomatic-expression-identification-semantic-compatibility/) - [next → CLiMP: A Benchmark for Chinese Language Model Evaluation](https://md.research.elamur.ai/free/en/papers/xiang-2021-climp-benchmark-chinese-language-model/) - [↑ back to papers of 2021](https://md.research.elamur.ai/free/en/papers/2021/page/4/) ## References 1 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Shamsiah Abd Kadir, Anitawati Lokman, and T. Tsuchiya. 2016. Emotion and techniques of propaganda in YouTube videos. Indian Journal of Science and Technology, Vol (9):1–8. [find](https://scholar.google.com/scholar?q=Shamsiah+Abd+Kadir%2C+Anitawati+Lokman%2C+and+T%2E+Tsuchiya%2E+2016%2E+Emotion+and+techniques+of+propaganda+in+YouTube+videos%2E+Indian+Journal+of+Science+and+Technology%2C+Vol+%289%29%3A1%E2%80%938%2E) *Updated 24 October 2026*