---
title: "MPBoCo — paper by Sun et al. (2026) — summary and ideas"
description: "The authors introduce a new task, abbreviated CMERJE, in which entities and relations are extracted jointly from… 7.2 points. 38 references."
authors: ["Guanglu Sun", "Xinyu Liu", "Lili Liang", "Yang Yu", "Fei Lang", "Suxia Zhu", "Ming Liu"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.1220/"
doi: "10.18653/v1/2026.acl-long.1220"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/sun-2026-mpboco-multimodal-prompt-based-boundary/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/sun-2026-mpboco-multimodal-prompt-based-boundary/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/37/) / MPBoCo: Multimodal Prompt-based Boundary-enhanced Continual Framework for Joint Entity and Relation Extraction

# MPBoCo: Multimodal Prompt-based Boundary-enhanced Continual Framework for Joint Entity and Relation Extraction

**Authors:** Guanglu Sun, [Xinyu Liu](https://md.research.elamur.ai/free/en/authors/xinyu-liu/), Lili Liang, [Yang Yu](https://md.research.elamur.ai/free/en/authors/yang-yu/), Fei Lang, Suxia Zhu and [Ming Liu](https://md.research.elamur.ai/free/en/authors/ming-liu/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.1220/) · [PDF](https://aclanthology.org/2026.acl-long.1220.pdf) · [DOI 10.18653/v1/2026.acl-long.1220](https://doi.org/10.18653/v1/2026.acl-long.1220) · [OpenAlex](https://openalex.org/W7166841444)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Multimodal knowledge graphs must keep pace with social-media streams in which new entity and relation types keep appearing. Static multimodal extractors would need retraining on all past data. Existing continual approaches either store old examples, which raises storage and privacy concerns, or use pipelines that compound errors. The authors introduce a new task, abbreviated CMERJE, in which entities and relations are extracted jointly from multimodal inputs under a continual-learning regime, and they build a matching benchmark dataset. Their framework, MPBoCo, keeps a VLMO backbone frozen and learns, for each task, a set of image-text key-prompt pairs. For every input, the most relevant pairs are retrieved and injected into the backbone. Prompts from finished tasks are frozen so that later tasks do not overwrite them. Because global prompts tend to blur token-level span edges, a dual-branch fusion module adds an auxiliary text branch that preserves local syntactic continuity and supervises boundary decisions. MPBoCo beats the strongest baselines by 5.5 points in the 10-task setting and 7.2 points in the 5-task setting. It also comes close to a joint-training upper bound without replaying any historical data.

## Key points
- **Task and resource:** CMERJE is presented as the first dataset for continual multimodal joint extraction. It uses a class-incremental setup with disjoint label sets per task, and the targets are quintuples of subject, subject type, object, object type, and relation.
- **Prompt pool design:** Prompt keys are initialized from type descriptions (subject–relation–object) encoded by the frozen text encoder. Key regularization and type-aware enhancement are also used, and ablations confirm both help.
- **Results:** In the 5-task setting, MPBoCo reaches an average of 42.5 versus 35.3 for the best baseline. In the 10-task setting, its average is about 28.5.
- **Best configuration:** Attaching prompts to 8 unimodal and 2 multimodal expert layers works best. Two multimodal prompt layers consistently outperform one.
- **Backbone and limits:** Unfreezing the backbone improves learning of new tasks but increases forgetting. The method depends on VLMO's text and vision experts, and fine-grained boundary recognition remains a stated weakness.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Harbin Institute of Technology](https://md.research.elamur.ai/free/en/universities/harbin-institute-of-technology/) — University, Harbin, China · 158 works · 28,841 citations

Also on the byline: [Harbin University of Science and Technology](https://ror.org/04e6y1282).

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works

🧭 Topics (2): [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 657 works · [🔎 Information extraction](https://md.research.elamur.ai/free/en/topics/information-extraction/) · 167 works

## Cite

Cite as: Guanglu Sun, Xinyu Liu, Lili Liang, Yang Yu, Fei Lang, Suxia Zhu and Ming Liu. 2026. MPBoCo: Multimodal Prompt-based Boundary-enhanced Continual Framework for Joint Entity and Relation Extraction. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{sun2026mpboco,
  title = {{MPBoCo: Multimodal Prompt-based Boundary-enhanced Continual Framework for Joint Entity and Relation Extraction}},
  author = {Guanglu Sun, Xinyu Liu, Lili Liang, Yang Yu, Fei Lang, Suxia Zhu and Ming Liu},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.1220},
  url = {https://doi.org/10.18653/v1/2026.acl-long.1220}
}
```

- [← previous Mostly Grounded, Occasionally Risky: Expert Evaluation of LLM-Generated Supervisory Feedback in a Psychotherapy Training Simulator](https://md.research.elamur.ai/free/en/papers/montesano-2026-mostly-grounded-occasionally-risky-expert/)
- [next → MQM Re-Annotation: A Technique for Collaborative Evaluation of Machine Translation](https://md.research.elamur.ai/free/en/papers/riley-2026-mqm-re-annotation-technique-collaborative/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/37/)

## References

38 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Xiang Chen, Jingtian Zhang, Xiaohan Wang, Ningyu Zhang, Tongtong Wu, Yuxiang Wang, Yongheng Wang, and Huajun Chen. 2024. Continual multimodal knowledge graph construction. In Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence (IJCAI), pages 6225– 6233. [find](https://scholar.google.com/scholar?q=Xiang+Chen%2C+Jingtian+Zhang%2C+Xiaohan+Wang%2C+Ningyu+Zhang%2C+Tongtong+Wu%2C+Yuxiang+Wang%2C+Yongheng+Wang%2C+and+Huajun+Chen%2E+2024%2E+Continual+multimodal+knowledge+graph+construction%2E+In+Proceedings+of+the+Thirty)
2. Jian Cheng, Kaifang Long, Shuang Zhang, Tian Zhang, Lianbo Ma, Shi Cheng, and Yinan Guo. 2023. Text-image scene graph fusion for multi-modal named entity recognition. IEEE Transactions on Artificial Intelligence, 5(6):2828–2839. [find](https://scholar.google.com/scholar?q=Jian+Cheng%2C+Kaifang+Long%2C+Shuang+Zhang%2C+Tian+Zhang%2C+Lianbo+Ma%2C+Shi+Cheng%2C+and+Yinan+Guo%2E+2023%2E+Text%2Dimage+scene+graph+fusion+for+multi%2Dmodal+named+entity+recognition%2E+IEEE+Transactions+on+Artificial+I)
3. Leyang Cui, Yu Wu, Jian Liu, Sen Yang, and Yue Zhang. 2021. [Template-based named entity recognition using bart](https://md.research.elamur.ai/free/en/papers/cui-2021-template-based-named-entity-recognition/). In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 1835–1845. Association for Computational Linguistics.
4. Mehrdad Farajtabar, Navid Azizan, Alex Mott, and Ang Li. 2020. Orthogonal gradient descent for continual learning. In Proceedings of the Twenty-Third International Conference on Artificial Intelligence and Statistics (AISTATS), volume 108, pages 3762–3773. [find](https://scholar.google.com/scholar?q=Mehrdad+Farajtabar%2C+Navid+Azizan%2C+Alex+Mott%2C+and+Ang+Li%2E+2020%2E+Orthogonal+gradient+descent+for+continual+learning%2E+In+Proceedings+of+the+Twenty%2DThird+International+Conference+on+Artificial+Intelligenc)
5. Xu Han, Yi Dai, Tianyu Gao, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, and Jie Zhou. 2020. [Continual relation learning via episodic memory activation and reconsolidation](https://md.research.elamur.ai/free/en/papers/han-2020-continual-relation-learning-episodic-memory/). In Proceedings of the Fifty-Eighth Annual Meeting of the Association for Computational Linguistics (ACL), pages 6429–6440.
6. Zhiqiang Hu, Xinyu Li, Xinyu Pan, Sijie Wen, and Jinsong Bao. 2025. A question answering system for assembly process of wind turbines based on multimodal knowledge graph and large language model. Journal of engineering design, 36(7-9):1093–1117. [find](https://scholar.google.com/scholar?q=Zhiqiang+Hu%2C+Xinyu+Li%2C+Xinyu+Pan%2C+Sijie+Wen%2C+and+Jinsong+Bao%2E+2025%2E+A+question+answering+system+for+assembly+process+of+wind+turbines+based+on+multimodal+knowledge+graph+and+large+language+model%2E+Jour)
7. Shizhou Huang, Bo Xu, Changqun Li, Jiabo Ye, and Xin Lin. 2024. Mner-mi: A multi-image dataset for multimodal named entity recognition in social media. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages… [find](https://scholar.google.com/scholar?q=Shizhou+Huang%2C+Bo+Xu%2C+Changqun+Li%2C+Jiabo+Ye%2C+and+Xin+Lin%2E+2024%2E+Mner%2Dmi%3A+A+multi%2Dimage+dataset+for+multimodal+named+entity+recognition+in+social+media%2E+In+Proceedings+of+the+2024+Joint+International+C)
8. Shubin Huang, Yi Cai, Li Yuan, and Jiexin Wang. 2025. A knowledge-enhanced network for joint multimodal entity-relation extraction. Information Processing & Management, 62(3):104033. [find](https://scholar.google.com/scholar?q=Shubin+Huang%2C+Yi+Cai%2C+Li+Yuan%2C+and+Jiexin+Wang%2E+2025%2E+A+knowledge%2Denhanced+network+for+joint+multimodal+entity%2Drelation+extraction%2E+Information+Processing+%26+Management%2C+62%283%29%3A104033%2E)
9. Muhammad Uzair Khattak, Hanoona Rasheed, Muhammad Maaz, Salman Khan, and Fahad Shahbaz Khan. 2023. Maple: Multi-modal prompt learning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 19113–19122. [find](https://scholar.google.com/scholar?q=Muhammad+Uzair+Khattak%2C+Hanoona+Rasheed%2C+Muhammad+Maaz%2C+Salman+Khan%2C+and+Fahad+Shahbaz+Khan%2E+2023%2E+Maple%3A+Multi%2Dmodal+prompt+learning%2E+In+IEEE%2FCVF+Conference+on+Computer+Vision+and+Pattern+Recognition)
10. James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, and 1 others. 2017. Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences (PNAS)… [find](https://scholar.google.com/scholar?q=James+Kirkpatrick%2C+Razvan+Pascanu%2C+Neil+Rabinowitz%2C+Joel+Veness%2C+Guillaume+Desjardins%2C+Andrei+A+Rusu%2C+Kieran+Milan%2C+John+Quan%2C+Tiago+Ramalho%2C+Agnieszka+Grabska%2DBarwinska%2C+and+1+others%2E+2017%2E+Overcomin)
11. Junlin Lee, Yequan Wang, Jing Li, and Min Zhang. 2024. Multimodal reasoning with multimodal knowledge graph. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 10767–10782. [find](https://scholar.google.com/scholar?q=Junlin+Lee%2C+Yequan+Wang%2C+Jing+Li%2C+and+Min+Zhang%2E+2024%2E+Multimodal+reasoning+with+multimodal+knowledge+graph%2E+In+Proceedings+of+the+62nd+Annual+Meeting+of+the+Association+for+Computational+Linguistics+)
12. Xiang Lisa Li and Percy Liang. 2021. Prefix-tuning: Optimizing continuous prompts for generation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 4582–… [find](https://scholar.google.com/scholar?q=Xiang+Lisa+Li+and+Percy+Liang%2E+2021%2E+Prefix%2Dtuning%3A+Optimizing+continuous+prompts+for+generation%2E+In+Proceedings+of+the+59th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+and+the+11t)
13. Yujie Li, Xin Yang, Hao Wang, Xiangkun Wang, and Tianrui Li. 2024. Learning to prompt knowledge transfer for open-world continual learning. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 13700–13708. [find](https://scholar.google.com/scholar?q=Yujie+Li%2C+Xin+Yang%2C+Hao+Wang%2C+Xiangkun+Wang%2C+and+Tianrui+Li%2E+2024%2E+Learning+to+prompt+knowledge+transfer+for+open%2Dworld+continual+learning%2E+In+Proceedings+of+the+AAAI+Conference+on+Artificial+Intellig)
14. Wanying Liang, Pasquale De Meo, Yong Tang, and Jia Zhu. 2024. A survey of multi-modal knowledge graphs: Technologies and trends. ACM Computing Surveys, 56(11):1–41. [find](https://scholar.google.com/scholar?q=Wanying+Liang%2C+Pasquale+De+Meo%2C+Yong+Tang%2C+and+Jia+Zhu%2E+2024%2E+A+survey+of+multi%2Dmodal+knowledge+graphs%3A+Technologies+and+trends%2E+ACM+Computing+Surveys%2C+56%2811%29%3A1%E2%80%9341%2E)
15. Luping Liu, Meiling Wang, Mozhi Zhang, Linbo Qing, and Xiaohai He. 2022. Uamner: uncertainty-aware multimodal named entity recognition in social media posts. Applied Intelligence, 52(4):4109–4125. [find](https://scholar.google.com/scholar?q=Luping+Liu%2C+Meiling+Wang%2C+Mozhi+Zhang%2C+Linbo+Qing%2C+and+Xiaohai+He%2E+2022%2E+Uamner%3A+uncertainty%2Daware+multimodal+named+entity+recognition+in+social+media+posts%2E+Applied+Intelligence%2C+52%284%29%3A4109%E2%80%934125%2E)
16. Peipei Liu, Gaosheng Wang, Hong Li, Jie Liu, Yimo Ren, Hongsong Zhu, and Limin Sun. 2024. Multi-granularity cross-modal representation learning for named entity recognition on social media. Information Processing & Management, 61(1):103546. [find](https://scholar.google.com/scholar?q=Peipei+Liu%2C+Gaosheng+Wang%2C+Hong+Li%2C+Jie+Liu%2C+Yimo+Ren%2C+Hongsong+Zhu%2C+and+Limin+Sun%2E+2024%2E+Multi%2Dgranularity+cross%2Dmodal+representation+learning+for+named+entity+recognition+on+social+media%2E+Informatio)
17. Xinyu Liu, Guanglu Sun, Jing Jin, Fei Lang, and Suxia Zhu. 2026a. Citr: Context-driven implicit triple reasoning for joint multimodal entity-relation extraction. Information Processing & Management, 63(2):104388. [find](https://scholar.google.com/scholar?q=Xinyu+Liu%2C+Guanglu+Sun%2C+Jing+Jin%2C+Fei+Lang%2C+and+Suxia+Zhu%2E+2026a%2E+Citr%3A+Context%2Ddriven+implicit+triple+reasoning+for+joint+multimodal+entity%2Drelation+extraction%2E+Information+Processing+%26+Management%2C+6)
18. Xinyu Liu, Guanglu Sun, Fei Lang, and Suxia Zhu. 2025. Mpcl: Multimodal prompt learning for continual relation extraction with type-aware inter-modality alignment. Information Fusion, page 104025. [find](https://scholar.google.com/scholar?q=Xinyu+Liu%2C+Guanglu+Sun%2C+Fei+Lang%2C+and+Suxia+Zhu%2E+2025%2E+Mpcl%3A+Multimodal+prompt+learning+for+continual+relation+extraction+with+type%2Daware+inter%2Dmodality+alignment%2E+Information+Fusion%2C+page+104025%2E)
19. Xinyu Liu, Guanglu Sun, Lili Liang, Fei Lang, and Suxia Zhu. 2026b. Hitimi: Hierarchical type-driven inter-modality interaction framework for multimodal named entity recognition. Neurocomputing, 664:132131. [find](https://scholar.google.com/scholar?q=Xinyu+Liu%2C+Guanglu+Sun%2C+Lili+Liang%2C+Fei+Lang%2C+and+Suxia+Zhu%2E+2026b%2E+Hitimi%3A+Hierarchical+type%2Ddriven+inter%2Dmodality+interaction+framework+for+multimodal+named+entity+recognition%2E+Neurocomputing%2C+664%3A1)
20. Arun Mallya and Svetlana Lazebnik. 2018. Packnet: Adding multiple tasks to a single network by iterative pruning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 7765– 7773. [find](https://scholar.google.com/scholar?q=Arun+Mallya+and+Svetlana+Lazebnik%2E+2018%2E+Packnet%3A+Adding+multiple+tasks+to+a+single+network+by+iterative+pruning%2E+In+IEEE%2FCVF+Conference+on+Computer+Vision+and+Pattern+Recognition+%28CVPR%29%2C+pages+7765%E2%80%93+)
21. Qi Qin, Han Peng, Wenpeng Hu, Dongyan Zhao, and Bing Liu. 2021. Bns: building network structures dynamically for continual learning. In Advances in Neural Information Processing Systems (NeurIPS), volume 34, pages 20608–20620. [find](https://scholar.google.com/scholar?q=Qi+Qin%2C+Han+Peng%2C+Wenpeng+Hu%2C+Dongyan+Zhao%2C+and+Bing+Liu%2E+2021%2E+Bns%3A+building+network+structures+dynamically+for+continual+learning%2E+In+Advances+in+Neural+Information+Processing+Systems+%28NeurIPS%29%2C+vol)
22. Reza Shokri and Vitaly Shmatikov. 2015. Privacy-preserving deep learning. In Proceedings of the Twenty-Second ACM SIGSAC conference on computer and communications security (ACM SIGSAC), pages 1310–1321. [find](https://scholar.google.com/scholar?q=Reza+Shokri+and+Vitaly+Shmatikov%2E+2015%2E+Privacy%2Dpreserving+deep+learning%2E+In+Proceedings+of+the+Twenty%2DSecond+ACM+SIGSAC+conference+on+computer+and+communications+security+%28ACM+SIGSAC%29%2C+pages+1310%E2%80%93132)
23. James Seale Smith, Leonid Karlinsky, Vyshnavi Gutta, Paola Cascante-Bonilla, Donghyun Kim, Assaf Arbelle, Rameswar Panda, Rogerio Feris, and Zsolt Kira. 2023. Coda-prompt: Continual decomposed attention-based prompting for rehearsal-free continual learning. In IEEE/CVF Conference on Computer Vision… [find](https://scholar.google.com/scholar?q=James+Seale+Smith%2C+Leonid+Karlinsky%2C+Vyshnavi+Gutta%2C+Paola+Cascante%2DBonilla%2C+Donghyun+Kim%2C+Assaf+Arbelle%2C+Rameswar+Panda%2C+Rogerio+Feris%2C+and+Zsolt+Kira%2E+2023%2E+Coda%2Dprompt%3A+Continual+decomposed+attenti)
24. Lin Sun, Jiquan Wang, Kai Zhang, Yindu Su, and Fang-sheng Weng. 2021. Rpbert: a text-image relation propagation-based bert model for multimodal ner. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pages 13860–13868. [find](https://scholar.google.com/scholar?q=Lin+Sun%2C+Jiquan+Wang%2C+Kai+Zhang%2C+Yindu+Su%2C+and+Fang%2Dsheng+Weng%2E+2021%2E+Rpbert%3A+a+text%2Dimage+relation+propagation%2Dbased+bert+model+for+multimodal+ner%2E+In+Proceedings+of+the+AAAI+conference+on+artificial)
25. Hong Wang, Wenhan Xiong, Mo Yu, Xiaoxiao Guo, Shiyu Chang, and William Yang Wang. 2019. Sentence embedding alignment for lifelong relation extraction. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NA… [find](https://scholar.google.com/scholar?q=Hong+Wang%2C+Wenhan+Xiong%2C+Mo+Yu%2C+Xiaoxiao+Guo%2C+Shiyu+Chang%2C+and+William+Yang+Wang%2E+2019%2E+Sentence+embedding+alignment+for+lifelong+relation+extraction%2E+In+Proceedings+of+the+2019+Conference+of+the+Nort)
26. Jie Wang, Yan Yang, Keyu Liu, Zhiping Zhu, and Xiaorong Liu. 2023a. M3s: Scene graph driven multi-granularity multi-task learning for multi-modal ner. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 31:111–120. [find](https://scholar.google.com/scholar?q=Jie+Wang%2C+Yan+Yang%2C+Keyu+Liu%2C+Zhiping+Zhu%2C+and+Xiaorong+Liu%2E+2023a%2E+M3s%3A+Scene+graph+driven+multi%2Dgranularity+multi%2Dtask+learning+for+multi%2Dmodal+ner%2E+IEEE%2FACM+Transactions+on+Audio%2C+Speech%2C+and+Langu)
27. Xinyi Wang, Zitao Wang, and Wei Hu. 2023b. Serial contrastive knowledge distillation for continual few-shot relation extraction. In Findings of the Association for Computational Linguistics (ACL Findings), pages 12693–12706. [find](https://scholar.google.com/scholar?q=Xinyi+Wang%2C+Zitao+Wang%2C+and+Wei+Hu%2E+2023b%2E+Serial+contrastive+knowledge+distillation+for+continual+few%2Dshot+relation+extraction%2E+In+Findings+of+the+Association+for+Computational+Linguistics+%28ACL+Findi)
28. Zhiyuan Wang, Xiaoyang Qu, Jing Xiao, Bokui Chen, and Jianzong Wang. 2024. Incprompt: Task-aware incremental prompting for rehearsal-free class-incremental learning. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 7240–7244. [find](https://scholar.google.com/scholar?q=Zhiyuan+Wang%2C+Xiaoyang+Qu%2C+Jing+Xiao%2C+Bokui+Chen%2C+and+Jianzong+Wang%2E+2024%2E+Incprompt%3A+Task%2Daware+incremental+prompting+for+rehearsal%2Dfree+class%2Dincremental+learning%2E+In+IEEE+International+Conference+o)
29. Zifeng Wang, Zizhao Zhang, Chen-Yu Lee, Han Zhang, Ruoxi Sun, Xiaoqi Ren, Guolong Su, Vincent Perot, Jennifer Dy, and Tomas Pfister. 2022. Learning to prompt for continual learning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 139–149. [find](https://scholar.google.com/scholar?q=Zifeng+Wang%2C+Zizhao+Zhang%2C+Chen%2DYu+Lee%2C+Han+Zhang%2C+Ruoxi+Sun%2C+Xiaoqi+Ren%2C+Guolong+Su%2C+Vincent+Perot%2C+Jennifer+Dy%2C+and+Tomas+Pfister%2E+2022%2E+Learning+to+prompt+for+continual+learning%2E+In+IEEE%2FCVF+Confer)
30. Zhiwei Wu, Changmeng Zheng, Yi Cai, Junying Chen, Ho-fung Leung, and Qing Li. 2020. Multimodal representation with embedded visual guiding objects for named entity recognition in social media posts. In Proceedings of the 28th ACM International Conference on Multimedia, pages 1038–1046. ACM. [find](https://scholar.google.com/scholar?q=Zhiwei+Wu%2C+Changmeng+Zheng%2C+Yi+Cai%2C+Junying+Chen%2C+Ho%2Dfung+Leung%2C+and+Qing+Li%2E+2020%2E+Multimodal+representation+with+embedded+visual+guiding+objects+for+named+entity+recognition+in+social+media+posts%2E+I)
31. Dianzhi Yu, Xinni Zhang, Yankai Chen, Aiwei Liu, Yifei Zhang, Philip S Yu, and Irwin King. 2024. Recent advances of multimodal continual learning: A comprehensive survey. arXiv. [find](https://scholar.google.com/scholar?q=Dianzhi+Yu%2C+Xinni+Zhang%2C+Yankai+Chen%2C+Aiwei+Liu%2C+Yifei+Zhang%2C+Philip+S+Yu%2C+and+Irwin+King%2E+2024%2E+Recent+advances+of+multimodal+continual+learning%3A+A+comprehensive+survey%2E+arXiv%2E)
32. Jianfei Yu, Jing Jiang, Li Yang, and Rui Xia. 2020. [Improving multimodal named entity recognition via entity span detection with unified multimodal transformer](https://md.research.elamur.ai/free/en/papers/yu-2020-improving-multimodal-named-entity-recognition/). In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 3342—-3352. ACL.
33. Li Yuan, Yi Cai, Jin Wang, and Qing Li. 2023. Joint multimodal entity-relation extraction based on edge-enhanced graph alignment network and word-pair relation tagging. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), volume 37, pages 11051–11059. [find](https://scholar.google.com/scholar?q=Li+Yuan%2C+Yi+Cai%2C+Jin+Wang%2C+and+Qing+Li%2E+2023%2E+Joint+multimodal+entity%2Drelation+extraction+based+on+edge%2Denhanced+graph+alignment+network+and+word%2Dpair+relation+tagging%2E+In+Proceedings+of+the+AAAI+Conf)
34. Li Yuan, Yi Cai, Jingyu Xu, Qing Li, and Tao Wang. 2025. A fine-grained network for joint multimodal entity-relation extraction. IEEE Transactions on Knowledge and Data Engineering, 37(1):1–14. [find](https://scholar.google.com/scholar?q=Li+Yuan%2C+Yi+Cai%2C+Jingyu+Xu%2C+Qing+Li%2C+and+Tao+Wang%2E+2025%2E+A+fine%2Dgrained+network+for+joint+multimodal+entity%2Drelation+extraction%2E+IEEE+Transactions+on+Knowledge+and+Data+Engineering%2C+37%281%29%3A1%E2%80%9314%2E)
35. Dong Zhang, Suzhong Wei, Shoushan Li, Hanqian Wu, Qiaoming Zhu, and Guodong Zhou. 2021. Multimodal graph fusion for named entity recognition with targeted visual guidance. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pages 14347–14355. [find](https://scholar.google.com/scholar?q=Dong+Zhang%2C+Suzhong+Wei%2C+Shoushan+Li%2C+Hanqian+Wu%2C+Qiaoming+Zhu%2C+and+Guodong+Zhou%2E+2021%2E+Multimodal+graph+fusion+for+named+entity+recognition+with+targeted+visual+guidance%2E+In+Proceedings+of+the+AAAI+c)
36. Qi Zhang, Jinlan Fu, Xiaoyu Liu, and Xuanjing Huang. 2018. Adaptive co-attention network for named entity recognition in tweets. In Proceedings of the AAAI conference on artificial intelligence, volume 32, pages 5674–5681. [find](https://scholar.google.com/scholar?q=Qi+Zhang%2C+Jinlan+Fu%2C+Xiaoyu+Liu%2C+and+Xuanjing+Huang%2E+2018%2E+Adaptive+co%2Dattention+network+for+named+entity+recognition+in+tweets%2E+In+Proceedings+of+the+AAAI+conference+on+artificial+intelligence%2C+volum)
37. Zhiheng Zhang, Daojian Zeng, and Xue Bai. 2024. Improving continual few-shot relation extraction Split T10 [find](https://scholar.google.com/scholar?q=Zhiheng+Zhang%2C+Daojian+Zeng%2C+and+Xue+Bai%2E+2024%2E+Improving+continual+few%2Dshot+relation+extraction+Split+T10)
38. Split Train Val Test 848 114 118 862 110 245 634 90 338 484 63 418 404 56 472 235 30 509 279 43 538 304 49 582 225 25 614 222 37 647 Train Val Test 1152 163 162 1087 135 321 913 133 443 706 100 556 639 86 647 *Table 6: Statistics of CMERJE under the 10-task continual setting.* *Table 7: Statistics o… [find](https://scholar.google.com/scholar?q=Split+Train+Val+Test+848+114+118+862+110+245+634+90+338+484+63+418+404+56+472+235+30+509+279+43+538+304+49+582+225+25+614+222+37+647+Train+Val+Test+1152+163+162+1087+135+321+913+133+443+706+100+556+63)

*Updated 1 November 2026*