--- title: "SLPGFJWUWarda at SemEval-2026 Task 1: A Multimodal" description: "This system paper describes a submission to SemEval-2026 Task 1 (MWAHAHA), Subtask B1. The subtask asks a model to… 4 references." authors: ["Warda Yousaf"] year: 2026 venue: "Proceedings of the 20th International Workshop on Semantic Evaluation (2026)" source: "https://aclanthology.org/2026.semeval-1.156/" doi: "10.18653/v1/2026.semeval-1.156" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/yousaf-2026-slpgfjwuwarda-semeval-2026-task-1/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/yousaf-2026-slpgfjwuwarda-semeval-2026-task-1/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/50/) / SLPGFJWUWarda at SemEval-2026 Task 1: A Multimodal Vision-Language Approach for Humor Generation Using Fine-Tuned BLIP # SLPGFJWUWarda at SemEval-2026 Task 1: A Multimodal Vision-Language Approach for Humor Generation Using Fine-Tuned BLIP **Authors:** Warda Yousaf · **Year:** 2026 · **Venue:** [Proceedings of the 20th International Workshop on Semantic Evaluation (2026)](https://md.research.elamur.ai/free/en/venues/semeval/) ([SemEval 2026](https://md.research.elamur.ai/free/en/venues/semeval/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.semeval-1.156/) · [PDF](https://aclanthology.org/2026.semeval-1.156.pdf) · [DOI 10.18653/v1/2026.semeval-1.156](https://doi.org/10.18653/v1/2026.semeval-1.156) · [OpenAlex](https://openalex.org/W7166853827) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary This system paper describes a submission to SemEval-2026 Task 1 (MWAHAHA), Subtask B1. The subtask asks a model to produce a free-form humorous English caption for a still image or an animated GIF. Standard captioning models describe what is literally visible, so the author tries to steer a vision-language model toward meme-style jokes. The pipeline keeps only the first frame of each GIF, converted to RGB with PIL. It then fine-tunes the pre-trained blip-image-captioning-base model, which pairs a ViT image encoder with a BERT-based causal text decoder. Fine-tuning uses a standard language-modeling loss on a filtered portion of the MemeCap dataset, and captions are decoded with beam search. The fine-tuned model typically writes first-person, exaggerated captions in the familiar "Me trying to…" style. It received a leaderboard rating of 1077 on the 300 test items, reported as a shared first place. However, the official table lists the zero-shot BLIP baseline at a higher rating (1124), also ranked 1. The work illustrates a cheap, single-GPU recipe for adapting captioning models to humor. ## Key points - **Data:** MemeCap captions were filtered to 3–20 words, leaving 4,206 samples split 90/10 into train and validation. - **Training setup:** AdamW with a learning rate of 3e-5, 2 epochs, batch size 2, and AMP on a Google Colab T4 GPU. The best checkpoint reached a validation loss of 0.1075. - **Decoding and GIF handling:** Beam search used num_beams = 5 and max_length = 30. Only the first frame (t = 0) of each GIF is used. - **Official results:** The fine-tuned BLIP scored 1077 and the zero-shot BLIP baseline scored 1124, with both listed at Rank 1. - **Main weakness and future work:** The model struggles with images whose humor depends on embedded text, because BLIP has no OCR. Planned extensions are OCR integration and sampling a few frames from GIFs. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Fatima Jinnah Women University](https://md.research.elamur.ai/free/en/universities/fatima-jinnah-women-university/) — University, Rawalpindi, Pakistan · 3 works 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 3,486 works · [💭 Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/) · 1,649 works · [💭 Social Psychology](https://md.research.elamur.ai/free/en/shelves/psychology/social-psychology/) · 330 works 🧭 Topics (1): [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 811 works ## Cite Cite as: Warda Yousaf. 2026. SLPGFJWUWarda at SemEval-2026 Task 1: A Multimodal Vision-Language Approach for Humor Generation Using Fine-Tuned BLIP. Proceedings of the 20th International Workshop on Semantic Evaluation (2026). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{yousaf2026slpgfjwuwarda, title = {{SLPGFJWUWarda at SemEval-2026 Task 1: A Multimodal Vision-Language Approach for Humor Generation Using Fine-Tuned BLIP}}, author = {Warda Yousaf}, booktitle = {Proceedings of the 20th International Workshop on Semantic Evaluation (2026)}, year = {2026}, doi = {10.18653/v1/2026.semeval-1.156}, url = {https://doi.org/10.18653/v1/2026.semeval-1.156} } ``` - [← previous SLPGFJWUInsa at SemEval-2026 Task 1: Enhancing Linguistic Creativity for English Text-Based Humor](https://md.research.elamur.ai/free/en/papers/abbas-2026-slpgfjwuinsa-semeval-2026-task-1/) - [next → Small Agents, Big Gains: Journey-Aware and Critic-Guided Simulation for Long-Horizon Shopping Dialogues](https://md.research.elamur.ai/free/en/papers/ping-2026-small-agents-big-gains-journey/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/50/) ## References 4 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Santiago Castro, Luis Chiruzzo, Santiago Góngora, Salar Rahili, Naihao Deng, Ignacio Sastre, Victoria Amoroso, Guillermo Rey, Aiala Rosá, Guillermo Moncecchi, J. A. Meaney, Juan José Prada, and Rada Mihalcea. 2026. SemEval-2026 Task 1: MWA-HAHA, Models Write Automatic Humor And Humans Annotate. In P… [find](https://scholar.google.com/scholar?q=Santiago+Castro%2C+Luis+Chiruzzo%2C+Santiago+G%C3%B3ngora%2C+Salar+Rahili%2C+Naihao+Deng%2C+Ignacio+Sastre%2C+Victoria+Amoroso%2C+Guillermo+Rey%2C+Aiala+Ros%C3%A1%2C+Guillermo+Moncecchi%2C+J%2E+A%2E+Meaney%2C+Juan+Jos%C3%A9+Prada%2C+and+Rada+M) 2. Eu-Jin Hwang, Seong Joon Oh, and Seung-Won Hwang. 2021. Memecap: A dataset for image-based meme captioning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. [find](https://scholar.google.com/scholar?q=Eu%2DJin+Hwang%2C+Seong+Joon+Oh%2C+and+Seung%2DWon+Hwang%2E+2021%2E+Memecap%3A+A+dataset+for+image%2Dbased+meme+captioning%2E+In+Proceedings+of+the+IEEE%2FCVF+Conference+on+Computer+Vision+and+Pattern+Recognition+Worksho) 3. Junnan Li, Dongxu Li, Caiming Xiong, and Steven Hoi. 2022. [Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation](https://md.research.elamur.ai/free/en/papers/li-2022-blip-bootstrapping-language-image-pre/). In Proceedings of the International Conference on Machine Learning (ICML), pages 12888–12900. PMLR. 4. Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, and 1 others. 2019. [Pytorch: An imperative style, high-performance deep learning library](https://md.research.elamur.ai/free/en/papers/paszke-2019-pytorch-imperative-style-high-performance/). Advances in Neural Information Processing Systems, 32. *Updated 2 November 2026*