--- title: "DANGNT@SGU at SemEval-2026 Task 1: A Two-Stage Mistral" description: "This paper describes the system DANGNT@SGU submitted to Subtask A of SemEval-2026 Task 1 (MWAHAHA), in the… 10 references." authors: ["Tan Loc Nguyen", "Dang Tuan Nguyen"] year: 2026 venue: "Proceedings of the 20th International Workshop on Semantic Evaluation (2026)" source: "https://aclanthology.org/2026.semeval-1.375/" doi: "10.18653/v1/2026.semeval-1.375" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/nguyen-2026-dangnt-sgu-semeval-2026-task/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/nguyen-2026-dangnt-sgu-semeval-2026-task/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/29/) / DANGNT@SGU at SemEval-2026 Task 1: A Two-Stage Mistral Generator with DistilBERT Reranking for English Humor Generation # DANGNT@SGU at SemEval-2026 Task 1: A Two-Stage Mistral Generator with DistilBERT Reranking for English Humor Generation **Authors:** Tan Loc Nguyen and Dang Tuan Nguyen · **Year:** 2026 · **Venue:** [Proceedings of the 20th International Workshop on Semantic Evaluation (2026)](https://md.research.elamur.ai/free/en/venues/semeval/) ([SemEval 2026](https://md.research.elamur.ai/free/en/venues/semeval/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.semeval-1.375/) · [PDF](https://aclanthology.org/2026.semeval-1.375.pdf) · [DOI 10.18653/v1/2026.semeval-1.375](https://doi.org/10.18653/v1/2026.semeval-1.375) · [OpenAlex](https://openalex.org/W7166883141) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary This paper describes the system DANGNT@SGU submitted to Subtask A of SemEval-2026 Task 1 (MWAHAHA), in the English-language category. The task asks systems to write short jokes under two kinds of constraints: including two given words (Word Inclusion) or relating to a news headline (News Headline). Organizers supplied no reference jokes, so the authors built their own training data. For Word Inclusion, they used spaCy to extract keywords from the Kaggle Short Jokes corpus. For News Headline, they paired official headlines with jokes through sentence-embedding similarity. They fine-tuned Mistral-7B-Instruct-v0.2 with QLoRA in two steps: - **Stage 1:** the model learns general joke style from raw jokes. - **Stage 2:** the model learns the task's prompt formats. At inference, the system samples five candidates per prompt. A DistilBERT classifier, trained to separate jokes from Wikipedia text, picks the best one. The submission placed 13th with Elo 962. Local ablations suggest that each training stage contributes a different benefit. The pipeline uses only open models and public data, which makes it a reproducible baseline for controllable humor generation. ## Key points - **Official result:** 13th place in the English leaderboard, Elo 962 (95% CI 926–986), based on human pairwise judgments. - **Resources:** - Generator: mistralai/Mistral-7B-Instruct-v0.2 with 4-bit NF4 QLoRA (r = 64, α = 16, adapters on q/k/v/o). - Reranker: distilbert-base-uncased. - Headline–joke matching: all-MiniLM-L6-v2 with a cosine threshold of 0.4. - Reranker negatives: wikimedia/wikipedia (20231101.en). - **Training data balance:** Stage 2 caps Word Inclusion to News Headline pairs at roughly 10:1. - **Local ablation (100 prompts, top-1 output, no reranker):** - Stage 2 raised word-inclusion success from 68% to 96%. - Adding Stage 1 lifted the mean DistilBERT joke score from 0.58 to 0.74, versus 0.44 for zero-shot. - **Reported weaknesses:** - Outputs can include the required words yet still be unfunny. - Jokes drift away from the headline topic. - The reranker favors generic short jokes. - The code is released at github.com/tanloc49/dangnt-sgu-mwahaha. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions Also on the byline: [Ton Duc Thang University](https://ror.org/01drq0835). 📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,649 works · [💭 Social Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/social-psychology/) · 330 works 🧭 Topics (2): [English](https://md.research.elamur.ai/free/en/topics/english/) · 2,379 works · [🔍 Information retrieval & search](https://md.research.elamur.ai/free/en/topics/information-retrieval/) · 552 works ## Cite Cite as: Tan Loc Nguyen and Dang Tuan Nguyen. 2026. DANGNT@SGU at SemEval-2026 Task 1: A Two-Stage Mistral Generator with DistilBERT Reranking for English Humor Generation. Proceedings of the 20th International Workshop on Semantic Evaluation (2026). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{nguyen2026dangnt, title = {{DANGNT@SGU at SemEval-2026 Task 1: A Two-Stage Mistral Generator with DistilBERT Reranking for English Humor Generation}}, author = {Tan Loc Nguyen and Dang Tuan Nguyen}, booktitle = {Proceedings of the 20th International Workshop on Semantic Evaluation (2026)}, year = {2026}, doi = {10.18653/v1/2026.semeval-1.375}, url = {https://doi.org/10.18653/v1/2026.semeval-1.375} } ``` - [← previous Danger Depends on the Mind: A Theory-of-Mind Grounded Dataset and Model for Context-Dependent Dangerous Speech](https://md.research.elamur.ai/free/en/papers/shi-2026-danger-depends-mind-theory-mind/) - [next → DART: Mitigating Harm Drift in Difference-Aware LLMs via Distill-Audit-Repair Training](https://md.research.elamur.ai/free/en/papers/pan-2026-dart-mitigating-harm-drift-difference/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/29/) ## References 10 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Santiago Castro, Luis Chiruzzo, Santiago Góngora, Salar Rahili, Naihao Deng, Ignacio Sastre, Victoria Amoroso, Guillermo Rey, Aiala Rosá, Guillermo Moncecchi, J. A. Meaney, Juan José Prada, and Rada Mihalcea. 2026. SemEval-2026 Task 1: MWA-HAHA, Models Write Automatic Humor And Humans Annotate. In Proceedings of the 20th International Workshop on Semantic Evaluation (SemEval-2026). [find](https://scholar.google.com/scholar?q=Santiago+Castro%2C+Luis+Chiruzzo%2C+Santiago+G%C3%B3ngora%2C+Salar+Rahili%2C+Naihao+Deng%2C+Ignacio+Sastre%2C+Victoria+Amoroso%2C+Guillermo+Rey%2C+Aiala+Ros%C3%A1%2C+Guillermo+Moncecchi%2C+J%2E+A%2E+Meaney%2C+Juan+Jos%C3%A9+Prada%2C+and+Rada+M) 2. Santiago Castro and Luis Chiruzzo. 2026. Submission list, annotation, and paper submission. Google Groups post to the semeval-2026-task-1-humor-gen mailing list, February 3, 2026. [find](https://scholar.google.com/scholar?q=Santiago+Castro+and+Luis+Chiruzzo%2E+2026%2E+Submission+list%2C+annotation%2C+and+paper+submission%2E+Google+Groups+post+to+the+semeval%2D2026%2Dtask%2D1%2Dhumor%2Dgen+mailing+list%2C+February+3%2C+2026%2E) 3. Luis Chiruzzo. 2026. Final results. Google Groups post to the semeval-2026-task-1-humor-gen mailing list, February 21, 2026. [find](https://scholar.google.com/scholar?q=Luis+Chiruzzo%2E+2026%2E+Final+results%2E+Google+Groups+post+to+the+semeval%2D2026%2Dtask%2D1%2Dhumor%2Dgen+mailing+list%2C+February+21%2C+2026%2E) 4. Albert Q. Jiang et al. 2023. Mistral 7B. arXiv preprint arXiv:2310.06825. [↗](https://arxiv.org/abs/2310.06825) 5. Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. [DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter](https://md.research.elamur.ai/free/en/papers/sanh-2019-distilbert-distilled-version-bert-smaller/). arXiv preprint arXiv:1910.01108. [↗](https://arxiv.org/abs/1910.01108) 6. Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023. [QLoRA: Efficient finetuning of quantized LLMs](https://md.research.elamur.ai/free/en/papers/dettmers-2023-qlora-efficient-finetuning-quantized-llms/). In Advances in Neural Information Processing Systems (NeurIPS). 7. Peng-Yu Chen and Von-Wun Soo. 2018. Humor Recognition Using Deep Learning. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 113–117, New Orleans, Louisiana. Association for Computational Linguistics. doi:10.18653/v1/N18-2018. [↗](https://doi.org/10.18653/v1/n18-2018) 8. Abhinav Moudgil. n.d. Short Jokes. Kaggle dataset. [https://www.kaggle.com/datasets/](https://www.kaggle.com/datasets/) abhinavmoudgil95/short-jokes. Accessed: 2026-02-25. [↗](https://www.kaggle.com/datasets/) 9. Hugging Face and Wikimedia Foundation. n.d. wikimedia/wikipedia. Hugging Face Datasets. [https://huggingface.co/datasets/](https://huggingface.co/datasets/) wikimedia/wikipedia. Configuration used: 20231101.en. Accessed: 2026-02-25. [↗](https://huggingface.co/datasets/) 10. Nils Reimers and Iryna Gurevych. 2019. [Sentence-BERT: Sentence embeddings using Siamese BERT-networks](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP-IJCNLP). *Updated 2 November 2026*