---
title: "Learning on Imbalanced Noisy Data via Debiased Sample"
description: "They propose DeCo, an active-learning framework that pairs small language models (SLMs) with LLMs. 54 references."
authors: ["Bo Yuan", "Yulin Chen", "Yin Zhang"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: ACL 2026"
source: "https://aclanthology.org/2026.findings-acl.1526/"
doi: "10.18653/v1/2026.findings-acl.1526"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/yuan-2026-learning-imbalanced-noisy-data-debiased/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/yuan-2026-learning-imbalanced-noisy-data-debiased/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/39/) / Learning on Imbalanced Noisy Data via Debiased Sample Selection and LLM-Driven Annotation

# Learning on Imbalanced Noisy Data via Debiased Sample Selection and LLM-Driven Annotation

**Authors:** [Bo Yuan](https://md.research.elamur.ai/free/en/authors/bo-yuan/), [Yulin Chen](https://md.research.elamur.ai/free/en/authors/yulin-chen/) and [Yin Zhang](https://md.research.elamur.ai/free/en/authors/yin-zhang/) · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.1526/) · [PDF](https://aclanthology.org/2026.findings-acl.1526.pdf) · [DOI 10.18653/v1/2026.findings-acl.1526](https://doi.org/10.18653/v1/2026.findings-acl.1526) · [OpenAlex](https://openalex.org/W7166833920)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Text classification data gathered through web crawling or crowdsourcing often has wrong labels, and real collections are usually class-imbalanced too. The authors show that common small-loss sample selection, which uses one fixed global threshold, fails in this setting. Tail-class samples have high losses and get discarded (selection bias), and self-training lets the model reinforce its own errors (training bias). They propose DeCo, an active-learning framework that pairs small language models (SLMs) with LLMs. The SLM side has two parts:
- A Multiple Expert Model (MEM) adds several expert layers to the classifier, so samples are selected on layers separate from the one being trained.
- A dynamic class-wise threshold, based on momentum-smoothed confidence and set per class, decides which samples count as clean.

Clean examples become in-context demonstrations for an LLM, which relabels the suspected noisy ones. The corrected labels feed back into SLM training, and each subset is trained with its own loss. On synthetic and real-world noisy benchmarks, DeCo beats existing LNL methods without needing human re-annotation.

## Key points
- The SLM splits the data into a clean set, a hard set and a noisy set. Only the noisy set is sent to the LLM (GPT-3.5-Turbo; GPT-4-0613 is also mentioned) for ICL-based relabeling.
- The per-sample dynamic threshold follows τ(t;x) = λ·p(t;x) + (1−λ)·τ(t−1;x), where p(t;x) is the sample's maximum confidence at epoch t. The threshold therefore rises as the model memorizes more.
- On R8 with 40% asymmetric noise, DeCo outperforms BERT, CoTeaching, CL, CR, NPC, SelfMix and DyGen, and comes close to training on ground-truth labels. SelfMix gradually drops class 2 and never picks clean class-7 samples, while DeCo covers every class.
- On Trec with 20% asymmetric noise, only 264 of 1108 noisy-set labels are correct before LLM querying. After relabeling at epoch 3, label accuracy in the noisy set is 83.84%, and it reaches 99.59% by epoch 6.
- The main stated limitation is dependence on LLM annotation quality, which may be insufficient in very difficult or unusual domains.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Zhejiang University](https://md.research.elamur.ai/free/en/universities/zhejiang-university/) — University, Hangzhou, China · 224 works · 13,587 citations
- [National University of Defense Technology](https://md.research.elamur.ai/free/en/universities/national-university-of-defense-technology/) — University, Changsha, China · 20 works · 1,339 citations

📚 Shelves (2): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works

🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,894 works

## Cite

Cite as: Bo Yuan, Yulin Chen and Yin Zhang. 2026. Learning on Imbalanced Noisy Data via Debiased Sample Selection and LLM-Driven Annotation. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{yuan2026learning,
  title = {{Learning on Imbalanced Noisy Data via Debiased Sample Selection and LLM-Driven Annotation}},
  author = {Bo Yuan, Yulin Chen and Yin Zhang},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.1526},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.1526}
}
```

- [← previous Learning Nested Named Entity Recognition from Flat Annotations](https://md.research.elamur.ai/free/en/papers/rozhkov-2026-learning-nested-named-entity-recognition/)
- [next → Learning Process Interaction Through Simplex ISL Transducers](https://md.research.elamur.ai/free/en/papers/wang-2026-learning-process-interaction-through-simplex/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/39/)

## References

54 references, 9 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Görkem Algan and Ilkay Ulusoy. 2020. Label noise types and their effects on deep learning. CoRR, abs/2003.10471. — [arXiv:2003.10471](https://arxiv.org/abs/2003.10471) [find](https://scholar.google.com/scholar?q=G%C3%B6rkem+Algan+and+Ilkay+Ulusoy%2E+2020%2E+Label+noise+types+and+their+effects+on+deep+learning%2E+CoRR%2C+abs%2F2003%2E10471%2E+%E2%80%94+%5BarXiv%3A2003%2E10471%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2003%2E10471%29)
2. Abhijeet Awasthi, Sabyasachi Ghosh, Rasna Goyal, and Sunita Sarawagi. 2020. Learning from rules generalizing labeled exemplars. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net. [find](https://scholar.google.com/scholar?q=Abhijeet+Awasthi%2C+Sabyasachi+Ghosh%2C+Rasna+Goyal%2C+and+Sunita+Sarawagi%2E+2020%2E+Learning+from+rules+generalizing+labeled+exemplars%2E+In+8th+International+Conference+on+Learning+Representations%2C+ICLR+2020%2C+)
3. HeeSun Bae, Seungjae Shin, Byeonghu Na, JoonHo Jang, Kyungwoo Song, and Il-Chul Moon. 2022. From noisy prediction to true label: Noisy prediction calibration via generative model. In International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA, volume 162 of Pro… [find](https://scholar.google.com/scholar?q=HeeSun+Bae%2C+Seungjae+Shin%2C+Byeonghu+Na%2C+JoonHo+Jang%2C+Kyungwoo+Song%2C+and+Il%2DChul+Moon%2E+2022%2E+From+noisy+prediction+to+true+label%3A+Noisy+prediction+calibration+via+generative+model%2E+In+International+Con)
4. Ruichu Cai, Zhenjie Zhang, Anthony K. H. Tung, Chenyun Dai, and Zhifeng Hao. 2014. A general framework of hierarchical clustering and its applications. Inf. Sci., 272:29–48. [find](https://scholar.google.com/scholar?q=Ruichu+Cai%2C+Zhenjie+Zhang%2C+Anthony+K%2E+H%2E+Tung%2C+Chenyun+Dai%2C+and+Zhifeng+Hao%2E+2014%2E+A+general+framework+of+hierarchical+clustering+and+its+applications%2E+Inf%2E+Sci%2E%2C+272%3A29%E2%80%9348%2E)
5. Duo Chai, Wei Wu, Qinghong Han, Fei Wu, and Jiwei Li. 2020. Description based text classification with reinforcement learning. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event, volume 119 of Proceedings of Machine Learning Research, p… [find](https://scholar.google.com/scholar?q=Duo+Chai%2C+Wei+Wu%2C+Qinghong+Han%2C+Fei+Wu%2C+and+Jiwei+Li%2E+2020%2E+Description+based+text+classification+with+reinforcement+learning%2E+In+Proceedings+of+the+37th+International+Conference+on+Machine+Learning%2C+)
6. Pengfei Chen, Benben Liao, Guangyong Chen, and Shengyu Zhang. 2019. Understanding and utilizing deep neural networks trained with noisy labels. In Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA, volume 97 of Proceedings of… [find](https://scholar.google.com/scholar?q=Pengfei+Chen%2C+Benben+Liao%2C+Guangyong+Chen%2C+and+Shengyu+Zhang%2E+2019%2E+Understanding+and+utilizing+deep+neural+networks+trained+with+noisy+labels%2E+In+Proceedings+of+the+36th+International+Conference+on+M)
7. PMLR. Chen Cheng, Xinzhi Yu, Haodong Wen, Jingsong Sun, Guanzhang Yue, Yihao Zhang, and Zeming Wei. 2024. Exploring the robustness of in-context learning with noisy labels. CoRR, abs/2404.18191. — [arXiv:2404.18191](https://arxiv.org/abs/2404.18191) [find](https://scholar.google.com/scholar?q=PMLR%2E+Chen+Cheng%2C+Xinzhi+Yu%2C+Haodong+Wen%2C+Jingsong+Sun%2C+Guanzhang+Yue%2C+Yihao+Zhang%2C+and+Zeming+Wei%2E+2024%2E+Exploring+the+robustness+of+in%2Dcontext+learning+with+noisy+labels%2E+CoRR%2C+abs%2F2404%2E18191%2E+%E2%80%94+%5Bar)
8. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. [BERT: pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,…
9. Yu Fei, Yifan Hou, Zeming Chen, and Antoine Bosselut. 2023. [Mitigating label biases for in-context learning](https://md.research.elamur.ai/free/en/papers/fei-2023-mitigating-label-biases-context-learning/). In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023, pages 14014–14031. Association…
10. Hongfu Gao, Feipeng Zhang, Wenyu Jiang, Jun Shu, Feng Zheng, and Hongxin Wei. 2024. On the noise robustness of in-context learning for text generation. Preprint, arXiv:2405.17264. — [arXiv:2405.17264](https://arxiv.org/abs/2405.17264) [find](https://scholar.google.com/scholar?q=Hongfu+Gao%2C+Feipeng+Zhang%2C+Wenyu+Jiang%2C+Jun+Shu%2C+Feng+Zheng%2C+and+Hongxin+Wei%2E+2024%2E+On+the+noise+robustness+of+in%2Dcontext+learning+for+text+generation%2E+Preprint%2C+arXiv%3A2405%2E17264%2E+%E2%80%94+%5BarXiv%3A2405%2E17264%5D)
11. Jiahui Gao, Renjie Pi, Yong Lin, Hang Xu, Jiacheng Ye, Zhiyong Wu, Weizhong Zhang, Xiaodan Liang, Zhenguo Li, and Lingpeng Kong. 2023a. Self-guided noise-free data generation for efficient zero-shot learning. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rw… [find](https://scholar.google.com/scholar?q=Jiahui+Gao%2C+Renjie+Pi%2C+Yong+Lin%2C+Hang+Xu%2C+Jiacheng+Ye%2C+Zhiyong+Wu%2C+Weizhong+Zhang%2C+Xiaodan+Liang%2C+Zhenguo+Li%2C+and+Lingpeng+Kong%2E+2023a%2E+Self%2Dguided+noise%2Dfree+data+generation+for+efficient+zero%2Dshot+l)
12. OpenReview.net. Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, Qianyu Guo, Meng Wang, and Haofen Wang. 2023b. [Retrieval-augmented generation for large language models: A survey](https://md.research.elamur.ai/free/en/papers/gao-2023-retrieval-augmented-generation-large-language/). CoRR, abs/2312.10997.
13. Aritra Ghosh, Himanshu Kumar, and P. S. Sastry. 2017. Robust loss functions under label noise for deep neural networks. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, February 4-9, 2017, San Francisco, California, USA, pages 1919– 1925. [find](https://scholar.google.com/scholar?q=Aritra+Ghosh%2C+Himanshu+Kumar%2C+and+P%2E+S%2E+Sastry%2E+2017%2E+Robust+loss+functions+under+label+noise+for+deep+neural+networks%2E+In+Proceedings+of+the+Thirty%2DFirst+AAAI+Conference+on+Artificial+Intelligence%2C+F)
14. AAAI Press. Fabrizio Gilardi, Meysam Alizadeh, and Maël Kubli. 2023. [Chatgpt outperforms crowd-workers for text-annotation tasks](https://md.research.elamur.ai/free/en/papers/gilardi-2023-chatgpt-outperforms-crowd-workers-text/). CoRR, abs/2303.15056.
15. Antonio Gulli. 2005. The anatomy of a news search engine. In Proceedings of the 14th international conference on World Wide Web, WWW 2005, Chiba, Japan, May 10-14, 2005 - Special interest tracks and posters, pages 880–881. [find](https://scholar.google.com/scholar?q=Antonio+Gulli%2E+2005%2E+The+anatomy+of+a+news+search+engine%2E+In+Proceedings+of+the+14th+international+conference+on+World+Wide+Web%2C+WWW+2005%2C+Chiba%2C+Japan%2C+May+10%2D14%2C+2005+%2D+Special+interest+tracks+and+p)
16. ACM. Bo Han, Quanming Yao, Xingrui Yu, Gang Niu, Miao Xu, Weihua Hu, Ivor W. Tsang, and Masashi Sugiyama. 2018. Co-teaching: Robust training of deep neural networks with extremely noisy labels. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processin… [find](https://scholar.google.com/scholar?q=ACM%2E+Bo+Han%2C+Quanming+Yao%2C+Xingrui+Yu%2C+Gang+Niu%2C+Miao+Xu%2C+Weihua+Hu%2C+Ivor+W%2E+Tsang%2C+and+Masashi+Sugiyama%2E+2018%2E+Co%2Dteaching%3A+Robust+training+of+deep+neural+networks+with+extremely+noisy+labels%2E+In+Adv)
17. Iris Hendrickx, Su Nam Kim, Zornitsa Kozareva, Preslav Nakov, Diarmuid Ó Séaghdha, Sebastian Padó, Marco Pennacchiotti, Lorenza Romano, and Stan Szpakowicz. 2010. [Semeval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals](https://md.research.elamur.ai/free/en/papers/hendrickx-2010-semeval-2010-task-8-multi/). In Proceedings of the 5th International Wo…
18. Yingsong Huang, Bing Bai, Shengwei Zhao, Kun Bai, and Fei Wang. 2022. Uncertainty-aware learning against label noise on imbalanced datasets. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 202… [find](https://scholar.google.com/scholar?q=Yingsong+Huang%2C+Bing+Bai%2C+Shengwei+Zhao%2C+Kun+Bai%2C+and+Fei+Wang%2E+2022%2E+Uncertainty%2Daware+learning+against+label+noise+on+imbalanced+datasets%2E+In+Thirty%2DSixth+AAAI+Conference+on+Artificial+Intelligence%2C)
19. Shenwang Jiang, Jianan Li, Ying Wang, Bo Huang, Zhang Zhang, and Tingfa Xu. 2022. Delving into sample loss curve to embrace noisy and imbalanced data. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence… [find](https://scholar.google.com/scholar?q=Shenwang+Jiang%2C+Jianan+Li%2C+Ying+Wang%2C+Bo+Huang%2C+Zhang+Zhang%2C+and+Tingfa+Xu%2E+2022%2E+Delving+into+sample+loss+curve+to+embrace+noisy+and+imbalanced+data%2E+In+Thirty%2DSixth+AAAI+Conference+on+Artificial+Int)
20. Diederik P. Kingma and Jimmy Ba. 2015. [Adam: A method for stochastic optimization](https://md.research.elamur.ai/free/en/papers/kingma-2014-adam-method-stochastic-optimization/). In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings.
21. Jannik Kossen, Tom Rainforth, and Yarin Gal. 2023. In-context learning in large language models learns label relationships but is not conventional learning. CoRR, abs/2307.12375. — [arXiv:2307.12375](https://arxiv.org/abs/2307.12375) [find](https://scholar.google.com/scholar?q=Jannik+Kossen%2C+Tom+Rainforth%2C+and+Yarin+Gal%2E+2023%2E+In%2Dcontext+learning+in+large+language+models+learns+label+relationships+but+is+not+conventional+learning%2E+CoRR%2C+abs%2F2307%2E12375%2E+%E2%80%94+%5BarXiv%3A2307%2E12375%5D%28)
22. Martin Krallinger, Obdulia Rabal, Saber A Akhondi, Martın Pérez Pérez, Jesús Santamaría, Gael Pérez Rodríguez, Georgios Tsatsaronis, Ander Intxaurrondo, José Antonio López, Umesh Nandal, et al. 2017. Overview of the biocreative vi chemical-protein interaction track. In Proceedings of the sixth BioCr… [find](https://scholar.google.com/scholar?q=Martin+Krallinger%2C+Obdulia+Rabal%2C+Saber+A+Akhondi%2C+Mart%C4%B1n+P%C3%A9rez+P%C3%A9rez%2C+Jes%C3%BAs+Santamar%C3%ADa%2C+Gael+P%C3%A9rez+Rodr%C3%ADguez%2C+Georgios+Tsatsaronis%2C+Ander+Intxaurrondo%2C+Jos%C3%A9+Antonio+L%C3%B3pez%2C+Umesh+Nandal%2C+et+al%2E+2017%2E+)
23. Ken Lang. 1995. Newsweeder: Learning to filter netnews. In Machine Learning, Proceedings of the Twelfth International Conference on Machine Learning, Tahoe City, California, USA, July 9-12, 1995, pages 331–339. Morgan Kaufmann. [find](https://scholar.google.com/scholar?q=Ken+Lang%2E+1995%2E+Newsweeder%3A+Learning+to+filter+netnews%2E+In+Machine+Learning%2C+Proceedings+of+the+Twelfth+International+Conference+on+Machine+Learning%2C+Tahoe+City%2C+California%2C+USA%2C+July+9%2D12%2C+1995%2C+page)
24. David D. Lewis. 1992. An evaluation of phrasal and clustered representations on a text categorization task. In Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Copenhagen, Denmark, June 21-24, 1992, pages 37–50. ACM. [find](https://scholar.google.com/scholar?q=David+D%2E+Lewis%2E+1992%2E+An+evaluation+of+phrasal+and+clustered+representations+on+a+text+categorization+task%2E+In+Proceedings+of+the+15th+Annual+International+ACM+SIGIR+Conference+on+Research+and+Develop)
25. Junnan Li, Richard Socher, and Steven C. H. Hoi. 2020. Dividemix: Learning with noisy labels as semi-supervised learning. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net. [find](https://scholar.google.com/scholar?q=Junnan+Li%2C+Richard+Socher%2C+and+Steven+C%2E+H%2E+Hoi%2E+2020%2E+Dividemix%3A+Learning+with+noisy+labels+as+semi%2Dsupervised+learning%2E+In+8th+International+Conference+on+Learning+Representations%2C+ICLR+2020%2C+Addis+)
26. Wen Li, Limin Wang, Wei Li, Eirikur Agustsson, and Luc Van Gool. 2017. Webvision database: Visual learning and understanding from web data. CoRR, abs/1708.02862. — [arXiv:1708.02862](https://arxiv.org/abs/1708.02862) [find](https://scholar.google.com/scholar?q=Wen+Li%2C+Limin+Wang%2C+Wei+Li%2C+Eirikur+Agustsson%2C+and+Luc+Van+Gool%2E+2017%2E+Webvision+database%3A+Visual+learning+and+understanding+from+web+data%2E+CoRR%2C+abs%2F1708%2E02862%2E+%E2%80%94+%5BarXiv%3A1708%2E02862%5D%28https%3A%2F%2Farxiv%2Eorg)
27. Xin Li and Dan Roth. 2002. [Learning question classifiers](https://md.research.elamur.ai/free/en/papers/li-2002-learning-question-classifiers/). In 19th International Conference on Computational Linguistics, COLING 2002, Howard International House and Academia Sinica, Taipei, Taiwan, August 24 - September 1, 2002.
28. Yifan Li, Hu Han, Shiguang Shan, and Xilin Chen. 2023. DISC: learning from noisy labels via dynamic instance-specific selection and correction. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, Vancouver, BC, Canada, June 17-24, 2023, pages 24070–24079. IEEE. [find](https://scholar.google.com/scholar?q=Yifan+Li%2C+Hu+Han%2C+Shiguang+Shan%2C+and+Xilin+Chen%2E+2023%2E+DISC%3A+learning+from+noisy+labels+via+dynamic+instance%2Dspecific+selection+and+correction%2E+In+IEEE%2FCVF+Conference+on+Computer+Vision+and+Pattern+Re)
29. Huafeng Liu, Mengmeng Sheng, Zeren Sun, Yazhou Yao, Xian-Sheng Hua, and Heng Tao Shen. 2024. Learning with imbalanced noisy data by preventing bias in sample selection. IEEE Trans. Multim., 26:7426–7437. [find](https://scholar.google.com/scholar?q=Huafeng+Liu%2C+Mengmeng+Sheng%2C+Zeren+Sun%2C+Yazhou+Yao%2C+Xian%2DSheng+Hua%2C+and+Heng+Tao+Shen%2E+2024%2E+Learning+with+imbalanced+noisy+data+by+preventing+bias+in+sample+selection%2E+IEEE+Trans%2E+Multim%2E%2C+26%3A7426%E2%80%9374)
30. Danqing Luo, Chen Zhang, Yan Zhang, and Haizhou Li. 2024. Crosstune: Black-box few-shot classification with label enhancement. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, LREC/COLING 2024, 20-25 May, 2024, Torino, Italy,… [find](https://scholar.google.com/scholar?q=Danqing+Luo%2C+Chen+Zhang%2C+Yan+Zhang%2C+and+Haizhou+Li%2E+2024%2E+Crosstune%3A+Black%2Dbox+few%2Dshot+classification+with+label+enhancement%2E+In+Proceedings+of+the+2024+Joint+International+Conference+on+Computationa)
31. Xingjun Ma, Hanxun Huang, Yisen Wang, Simone Romano, Sarah M. Erfani, and James Bailey. 2020. Normalized loss functions for deep learning with noisy labels. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event, volume 119 of Proceedings o… [find](https://scholar.google.com/scholar?q=Xingjun+Ma%2C+Hanxun+Huang%2C+Yisen+Wang%2C+Simone+Romano%2C+Sarah+M%2E+Erfani%2C+and+James+Bailey%2E+2020%2E+Normalized+loss+functions+for+deep+learning+with+noisy+labels%2E+In+Proceedings+of+the+37th+International+Co)
32. Curtis G. Northcutt, Lu Jiang, and Isaac L. Chuang. 2021. Confident learning: Estimating uncertainty in dataset labels. J. Artif. Intell. Res., 70:1373–1411. [find](https://scholar.google.com/scholar?q=Curtis+G%2E+Northcutt%2C+Lu+Jiang%2C+and+Isaac+L%2E+Chuang%2E+2021%2E+Confident+learning%3A+Estimating+uncertainty+in+dataset+labels%2E+J%2E+Artif%2E+Intell%2E+Res%2E%2C+70%3A1373%E2%80%931411%2E)
33. Bo Pang and Lillian Lee. 2005. [Seeing stars: Exploiting class relationships for sentiment categorization with respect to rating scales](https://md.research.elamur.ai/free/en/papers/pang-2005-seeing-stars-exploiting-class-relationships/). Cornell University -arXiv,Cornell University - arXiv.
34. Dan Qiao, Chenchen Dai, Yuyang Ding, Juntao Li, Qiang Chen, Wenliang Chen, and Min Zhang. 2022. Selfmix: Robust learning against textual label noise with self-mixup training. In Proceedings of the 29th International Conference on Computational Linguistics, COLING 2022, Gyeongju, Republic of Korea, O… [find](https://scholar.google.com/scholar?q=Dan+Qiao%2C+Chenchen+Dai%2C+Yuyang+Ding%2C+Juntao+Li%2C+Qiang+Chen%2C+Wenliang+Chen%2C+and+Min+Zhang%2E+2022%2E+Selfmix%3A+Robust+learning+against+textual+label+noise+with+self%2Dmixup+training%2E+In+Proceedings+of+the+29t)
35. Mengye Ren, Wenyuan Zeng, Bin Yang, and Raquel Urtasun. 2018. Learning to reweight examples for robust deep learning. In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsmässan, Stockholm, Sweden, July 10-15, 2018, volume 80 of Proceedings of Machine Learnin… [find](https://scholar.google.com/scholar?q=Mengye+Ren%2C+Wenyuan+Zeng%2C+Bin+Yang%2C+and+Raquel+Urtasun%2E+2018%2E+Learning+to+reweight+examples+for+robust+deep+learning%2E+In+Proceedings+of+the+35th+International+Conference+on+Machine+Learning%2C+ICML+2018)
36. PMLR. Lior Rokach. 2010. Ensemble-based classifiers. Artificial Intelligence Review, page 1–39. [find](https://scholar.google.com/scholar?q=PMLR%2E+Lior+Rokach%2E+2010%2E+Ensemble%2Dbased+classifiers%2E+Artificial+Intelligence+Review%2C+page+1%E2%80%9339%2E)
37. Jun Shu, Qi Xie, Lixuan Yi, Qian Zhao, Sanping Zhou, Zongben Xu, and Deyu Meng. 2019. Meta-weightnet: Learning an explicit mapping for sample weighting. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-… [find](https://scholar.google.com/scholar?q=Jun+Shu%2C+Qi+Xie%2C+Lixuan+Yi%2C+Qian+Zhao%2C+Sanping+Zhou%2C+Zongben+Xu%2C+and+Deyu+Meng%2E+2019%2E+Meta%2Dweightnet%3A+Learning+an+explicit+mapping+for+sample+weighting%2E+In+Advances+in+Neural+Information+Processing+Sy)
38. Antti Tarvainen and Harri Valpola. 2017. Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 20… [find](https://scholar.google.com/scholar?q=Antti+Tarvainen+and+Harri+Valpola%2E+2017%2E+Mean+teachers+are+better+role+models%3A+Weight%2Daveraged+consistency+targets+improve+semi%2Dsupervised+deep+learning+results%2E+In+Advances+in+Neural+Information+Proc)
39. Brendan van Rooyen, Aditya Krishna Menon, and Robert C. Williamson. 2015. Learning with symmetric label noise: The importance of being unhinged. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, December 7-12, 2015, Montreal, Qu… [find](https://scholar.google.com/scholar?q=Brendan+van+Rooyen%2C+Aditya+Krishna+Menon%2C+and+Robert+C%2E+Williamson%2E+2015%2E+Learning+with+symmetric+label+noise%3A+The+importance+of+being+unhinged%2E+In+Advances+in+Neural+Information+Processing+Systems+28)
40. Song Wang, Zhen Tan, Ruocheng Guo, and Jundong Li. 2023. Noise-robust fine-tuning of pretrained language models via external guidance. In Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023, pages 12528–12540. Association for Computational Linguistic… [find](https://scholar.google.com/scholar?q=Song+Wang%2C+Zhen+Tan%2C+Ruocheng+Guo%2C+and+Jundong+Li%2E+2023%2E+Noise%2Drobust+fine%2Dtuning+of+pretrained+language+models+via+external+guidance%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+EMN)
41. Qi Wei, Lei Feng, Haobo Wang, and Bo An. 2024. Debiased sample selection for combating noisy labels. CoRR, abs/2401.13360. — [arXiv:2401.13360](https://arxiv.org/abs/2401.13360) [find](https://scholar.google.com/scholar?q=Qi+Wei%2C+Lei+Feng%2C+Haobo+Wang%2C+and+Bo+An%2E+2024%2E+Debiased+sample+selection+for+combating+noisy+labels%2E+CoRR%2C+abs%2F2401%2E13360%2E+%E2%80%94+%5BarXiv%3A2401%2E13360%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2401%2E13360%29)
42. Ruixuan Xiao, Yiwen Dong, Junbo Zhao, Runze Wu, Minmin Lin, Gang Chen, and Haobo Wang. 2023. Freeal: Towards human-free active learning in the era of large language models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10… [find](https://scholar.google.com/scholar?q=Ruixuan+Xiao%2C+Yiwen+Dong%2C+Junbo+Zhao%2C+Runze+Wu%2C+Minmin+Lin%2C+Gang+Chen%2C+and+Haobo+Wang%2E+2023%2E+Freeal%3A+Towards+human%2Dfree+active+learning+in+the+era+of+large+language+models%2E+In+Proceedings+of+the+2023+)
43. Yilun Xu, Peng Cao, Yuqing Kong, and Yizhou Wang. 2019. L_dmi: A novel information-theoretic loss function for training deep nets robust to label noise. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-… [find](https://scholar.google.com/scholar?q=Yilun+Xu%2C+Peng+Cao%2C+Yuqing+Kong%2C+and+Yizhou+Wang%2E+2019%2E+L%5Fdmi%3A+A+novel+information%2Dtheoretic+loss+function+for+training+deep+nets+robust+to+label+noise%2E+In+Advances+in+Neural+Information+Processing+Sy)
44. Yan Yan, Rómer Rosales, Glenn Fung, Subramanian Ramanathan, and Jennifer G. Dy. 2014. Learning from multiple annotators with varying expertise. Mach. Learn., 95(3):291–327. [find](https://scholar.google.com/scholar?q=Yan+Yan%2C+R%C3%B3mer+Rosales%2C+Glenn+Fung%2C+Subramanian+Ramanathan%2C+and+Jennifer+G%2E+Dy%2E+2014%2E+Learning+from+multiple+annotators+with+varying+expertise%2E+Mach%2E+Learn%2E%2C+95%283%29%3A291%E2%80%93327%2E)
45. Taraneh Younesian, Zilong Zhao, Amirmasoud Ghiassi, Robert Birke, and Lydia Y. Chen. 2021. Qactor: Active learning on noisy labels. In Asian Conference on Machine Learning, ACML 2021, 17-19 November 2021, Virtual Event, volume 157 of Proceedings of Machine Learning Research, pages 548–563. PMLR. [find](https://scholar.google.com/scholar?q=Taraneh+Younesian%2C+Zilong+Zhao%2C+Amirmasoud+Ghiassi%2C+Robert+Birke%2C+and+Lydia+Y%2E+Chen%2E+2021%2E+Qactor%3A+Active+learning+on+noisy+labels%2E+In+Asian+Conference+on+Machine+Learning%2C+ACML+2021%2C+17%2D19+November+2)
46. Hongyi Zhang, Moustapha Cissé, Yann N. Dauphin, and David Lopez-Paz. 2018. [mixup: Beyond empirical risk minimization](https://md.research.elamur.ai/free/en/papers/zhang-2017-mixup-empirical-risk-minimization/). In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview.net.
47. Yivan Zhang, Gang Niu, and Masashi Sugiyama. 2021. Learning noise transition matrix from only noisy labels via total variation regularization. In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, volume 139 of Proceedings of Machine Lear… [find](https://scholar.google.com/scholar?q=Yivan+Zhang%2C+Gang+Niu%2C+and+Masashi+Sugiyama%2E+2021%2E+Learning+noise+transition+matrix+from+only+noisy+labels+via+total+variation+regularization%2E+In+Proceedings+of+the+38th+International+Conference+on+Ma)
48. Zhilu Zhang and Mert R. Sabuncu. 2018. Generalized cross entropy loss for training deep neural networks with noisy labels. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8, 2018, Montréal, Canada, pag… [find](https://scholar.google.com/scholar?q=Zhilu+Zhang+and+Mert+R%2E+Sabuncu%2E+2018%2E+Generalized+cross+entropy+loss+for+training+deep+neural+networks+with+noisy+labels%2E+In+Advances+in+Neural+Information+Processing+Systems+31%3A+Annual+Conference+on)
49. Liyue Zhao, Gita Sukthankar, and Rahul Sukthankar. 2011. Incremental relabeling for active learning with noisy crowdsourced annotations. In PASSAT/Social-Com 2011, Privacy, Security, Risk and Trust (PAS-SAT), 2011 IEEE Third International Conference on and 2011 IEEE Third International Conference on… [find](https://scholar.google.com/scholar?q=Liyue+Zhao%2C+Gita+Sukthankar%2C+and+Rahul+Sukthankar%2E+2011%2E+Incremental+relabeling+for+active+learning+with+noisy+crowdsourced+annotations%2E+In+PASSAT%2FSocial%2DCom+2011%2C+Privacy%2C+Security%2C+Risk+and+Trust+%28P)
50. Wenxuan Zhou and Muhao Chen. 2021. Learning from noisy labels for entity-centric information extraction. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021, pages 5381–5392. Associ… [find](https://scholar.google.com/scholar?q=Wenxuan+Zhou+and+Muhao+Chen%2E+2021%2E+Learning+from+noisy+labels+for+entity%2Dcentric+information+extraction%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+EMNL)
51. Wenxuan Zhou, Hongtao Lin, Bill Yuchen Lin, Ziqi Wang, Junyi Du, Leonardo Neves, and Xiang Ren. 2020. NERO: A neural rule grounding framework for label-efficient relation extraction. In WWW ’20: The Web Conference 2020, Taipei, Taiwan, April 20-24, 2020, pages 2166–2176. ACM / IW3C2. [find](https://scholar.google.com/scholar?q=Wenxuan+Zhou%2C+Hongtao+Lin%2C+Bill+Yuchen+Lin%2C+Ziqi+Wang%2C+Junyi+Du%2C+Leonardo+Neves%2C+and+Xiang+Ren%2E+2020%2E+NERO%3A+A+neural+rule+grounding+framework+for+label%2Defficient+relation+extraction%2E+In+WWW+%E2%80%9920%3A+The+W)
52. Dawei Zhu, Michael A. Hedderich, Fangzhou Zhai, David Ifeoluwa Adelani, and Dietrich Klakow. 2022. Is BERT robust to label noise? A study on learning with noisy labels in text classification. In Proceedings of the Third Workshop on Insights from Negative Results in NLP, Insights@ACL 2022, Dublin, Ir… [find](https://scholar.google.com/scholar?q=Dawei+Zhu%2C+Michael+A%2E+Hedderich%2C+Fangzhou+Zhai%2C+David+Ifeoluwa+Adelani%2C+and+Dietrich+Klakow%2E+2022%2E+Is+BERT+robust+to+label+noise%3F+A+study+on+learning+with+noisy+labels+in+text+classification%2E+In+Proce)
53. Yuchen Zhuang, Yue Yu, Lingkai Kong, Xiang Chen, and Chao Zhang. 2023. Dygen: Learning from noisy labels via dynamics-enhanced generative modeling. CoRR, abs/2305.19395. — [arXiv:2305.19395](https://arxiv.org/abs/2305.19395) [find](https://scholar.google.com/scholar?q=Yuchen+Zhuang%2C+Yue+Yu%2C+Lingkai+Kong%2C+Xiang+Chen%2C+and+Chao+Zhang%2E+2023%2E+Dygen%3A+Learning+from+noisy+labels+via+dynamics%2Denhanced+generative+modeling%2E+CoRR%2C+abs%2F2305%2E19395%2E+%E2%80%94+%5BarXiv%3A2305%2E19395%5D%28https%3A%2F%2Fa)
54. The loss distribution of clean samples and noisy samples, whether in the head class or tail class, dynamically evolves during the training process; • Both tail class samples and noisy samples exhibit large losses; [find](https://scholar.google.com/scholar?q=The+loss+distribution+of+clean+samples+and+noisy+samples%2C+whether+in+the+head+class+or+tail+class%2C+dynamically+evolves+during+the+training+process%3B+%E2%80%A2+Both+tail+class+samples+and+noisy+samples+exhibit+)

*Updated 2 November 2026*