--- title: "CITD@UIT at SemEval-2026 Task 4: Structured Reasoning and" description: "This paper describes the CITD@UIT entry to SemEval-2026 Task 4, which asks whether systems can… 7 references, cited by 1 paper here." authors: ["Thach Nguyen", "Duc-Vu Nguyen", "Dang Thin"] year: 2026 venue: "Proceedings of the 20th International Workshop on Semantic Evaluation (2026)" source: "https://aclanthology.org/2026.semeval-1.158/" doi: "10.18653/v1/2026.semeval-1.158" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/nguyen-2026-citd-uit-semeval-2026-task/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/nguyen-2026-citd-uit-semeval-2026-task/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/11/) / CITD@UIT at SemEval-2026 Task 4: Structured Reasoning and Metric Specialization for Narrative Similarity # CITD@UIT at SemEval-2026 Task 4: Structured Reasoning and Metric Specialization for Narrative Similarity **Authors:** Thach Nguyen, [Duc-Vu Nguyen](https://md.research.elamur.ai/free/en/authors/duc-vu-nguyen/) and [Dang Thin](https://md.research.elamur.ai/free/en/authors/dang-van-thin/) · **Year:** 2026 · **Venue:** [Proceedings of the 20th International Workshop on Semantic Evaluation (2026)](https://md.research.elamur.ai/free/en/venues/semeval/) ([SemEval 2026](https://md.research.elamur.ai/free/en/venues/semeval/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.semeval-1.158/) · [PDF](https://aclanthology.org/2026.semeval-1.158.pdf) · [DOI 10.18653/v1/2026.semeval-1.158](https://doi.org/10.18653/v1/2026.semeval-1.158) · [OpenAlex](https://openalex.org/W7166832143) **Citations:** 0 citations (OpenAlex, 2026-10-14) · 1 in our library, of the 149,439 papers whose bibliographies we read ## Summary This paper describes the CITD@UIT entry to SemEval-2026 Task 4, which asks whether systems can judge how similar stories are in narrative terms rather than in wording. The task has two tracks. Track A asks which of two candidate stories is closer to an anchor. Track B asks for story embeddings whose distances reflect narrative similarity. For Track A, the authors tested three LLM-based designs in turn, each built to address the previous one's weaknesses. The best was a two-step Gemini pipeline. Gemini 2.5 Flash first rewrites each story into a cleaner, safety-compliant form. Gemini 2.5 Pro then compares the candidates with chain-of-thought prompting in both orders, focusing on moral agency and outcomes. For Track B, which ships only unlabeled stories, they fine-tuned BGE-M3 with LoRA. Part of the training data was synthetic adversarial examples modeled on Track A errors. The results suggest that outcome and the protagonist's moral path matter more than shared vocabulary. They also show that relative ranking suits LLMs better than absolute scoring. ## Key points - Track A approaches, in order: - A DeBERTa-v3-base cross-encoder with a Gemini 2.5 Flash/Pro arbitration ensemble (66.5% dev). - DSPy decomposition into five narrative dimensions with absolute 0–100 scoring (68.0% dev, 66.75% test). - Symmetric pairwise CoT (77.39% dev, 69.25% test), which ranked 17th of 46 teams. - Track B used BGE-M3 (LoRA), trained with Multiple Negatives Ranking Loss, an instruction prefix, CLS pooling, and L2-normalized 1024-dimensional vectors. It scored 68.75% and ranked 6th of 26 teams. - The Track B training set had 3,223 samples. These combined Track A dev data, the organizers' synthetic data, and 1,126 new adversarial "trap" examples. - Applying the Track B embeddings directly to the Track A test set gave 59.00%, about 10 points below the reasoning pipeline. - The main error types were: - Lexical Gravity: shared motifs mislead the model. - Moral agency rigidity: the model handles ethically ambiguous characters poorly. - Thematic over-abstraction: the sanitization step removes distinctive details. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Vietnam National University Ho Chi Minh City](https://md.research.elamur.ai/free/en/universities/vietnam-national-university-ho-chi-minh-city/) — University, Ho Chi Minh City, Vietnam · 21 works · 14 citations - [University of Information Technology](https://md.research.elamur.ai/free/en/universities/university-of-information-technology/) — University, Ho Chi Minh City, Vietnam · 13 works · 7 citations 📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 3,486 works 🧭 Topics (1): [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,685 works ## Cite Cite as: Thach Nguyen, Duc-Vu Nguyen and Dang Thin. 2026. CITD@UIT at SemEval-2026 Task 4: Structured Reasoning and Metric Specialization for Narrative Similarity. Proceedings of the 20th International Workshop on Semantic Evaluation (2026). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{nguyen2026citd, title = {{CITD@UIT at SemEval-2026 Task 4: Structured Reasoning and Metric Specialization for Narrative Similarity}}, author = {Thach Nguyen, Duc-Vu Nguyen and Dang Thin}, booktitle = {Proceedings of the 20th International Workshop on Semantic Evaluation (2026)}, year = {2026}, doi = {10.18653/v1/2026.semeval-1.158}, url = {https://doi.org/10.18653/v1/2026.semeval-1.158} } ``` - [← previous CITD@UIT at SemEval-2026 Task 2: Temporal Mixture-of-Experts for Longitudinal Valence and Arousal Prediction from Ecological Essays](https://md.research.elamur.ai/free/en/papers/phuong-2026-citd-uit-semeval-2026-task/) - [next → CityCube: Benchmarking Cross-view Spatial Reasoning on Vision-Language Models in Urban Environments](https://md.research.elamur.ai/free/en/papers/xu-2026-citycube-benchmarking-cross-view-spatial/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/11/) ## References 7 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Nathanael Chambers and Dan Jurafsky. 2008. Unsupervised learning of narrative event chains. In Proceedings of ACL-08: HLT, pages 789–797, Columbus, Ohio. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Nathanael+Chambers+and+Dan+Jurafsky%2E+2008%2E+Unsupervised+learning+of+narrative+event+chains%2E+In+Proceedings+of+ACL%2D08%3A+HLT%2C+pages+789%E2%80%93797%2C+Columbus%2C+Ohio%2E+Association+for+Computational+Linguistics%2E) 2. Jianlv Chen, Shitao Xiao, Peitian Zhang, Kun Luo, Defu Lian, and Zheng Liu. 2024. [Bge m3-embedding: Multi-lingual, multi-functionality, multi-granularity text embeddings through self-knowledge distillation](https://md.research.elamur.ai/free/en/papers/chen-2024-m3-embedding-multi-linguality/). Preprint, arXiv:2402.03216. 3. Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, and 1 others. 2025. [Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities](https://md.research.elamur.ai/free/en/papers/comanici-2025-gemini-2-5-pushing-frontier/). Preprint, arXiv:2502.10001. 4. Mark Alan Finlayson. 2012. Learning Narrative Structure from Annotated Folktales. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA. Advisor: Patrick H. Winston. [find](https://scholar.google.com/scholar?q=Mark+Alan+Finlayson%2E+2012%2E+Learning+Narrative+Structure+from+Annotated+Folktales%2E+PhD+thesis%2C+Massachusetts+Institute+of+Technology%2C+Cambridge%2C+MA%2E+Advisor%3A+Patrick+H%2E+Winston%2E) 5. Hans Ole Hatzel, Ekaterina Artemova, Haimo Stiemer, Evelyn Gius, and Chris Biemann. 2026. SemEval-2025 task 4: Narrative similarity and narrative representation learning. In Proceedings of the 20th International Workshop on Semantic Evaluation (SemEval-2026), San Diego, CA, USA. [find](https://scholar.google.com/scholar?q=Hans+Ole+Hatzel%2C+Ekaterina+Artemova%2C+Haimo+Stiemer%2C+Evelyn+Gius%2C+and+Chris+Biemann%2E+2026%2E+SemEval%2D2025+task+4%3A+Narrative+similarity+and+narrative+representation+learning%2E+In+Proceedings+of+the+20th+In) 6. Pengcheng He, Jianfeng Gao, and Weizhu Chen. 2021. [Debertav3: Improving deberta using electra-style pre-training with gradient-disentangled embedding sharing](https://md.research.elamur.ai/free/en/papers/he-2021-debertav3-improving-deberta-using-electra/). Preprint, arXiv:2111.09543. 7. Nils Reimers and Iryna Gurevych. 2019. [Sentence-BERT: Sentence embeddings using Siamese BERT-networks](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 3982–3992,… *Updated 31 October 2026*