--- title: "SpellGCN — paper by Cheng et al. (2020) — summary and ideas" description: "The authors propose SpellGCN, which builds two graphs over characters from an open-source confusion set (Wu et… Cited by 51 papers here." authors: ["Xingyi Cheng", "Weidi Xu", "Kunlong Chen", "Shaohua Jiang", "Feng Wang", "Taifeng Wang", "Wei Chu", "Yuan Qi"] year: 2020 venue: "Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics" source: "https://aclanthology.org/2020.acl-main.81/" doi: "10.18653/v1/2020.acl-main.81" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/cheng-2020-spellgcn-incorporating-phonological-visual-similarities/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/cheng-2020-spellgcn-incorporating-phonological-visual-similarities/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/page/3/) / SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check # SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check **Authors:** Xingyi Cheng, [Weidi Xu](https://md.research.elamur.ai/free/en/authors/weidi-xu/), Kunlong Chen, Shaohua Jiang, [Feng Wang](https://md.research.elamur.ai/free/en/authors/feng-wang/), Taifeng Wang, Wei Chu and [Yuan Qi](https://md.research.elamur.ai/free/en/authors/yuan-qi/) · **Year:** 2020 · **Venue:** [Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2020](https://md.research.elamur.ai/free/en/venues/acl/2020/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2020.acl-main.81/) · [PDF](https://aclanthology.org/2020.acl-main.81.pdf) · [DOI 10.18653/v1/2020.acl-main.81](https://doi.org/10.18653/v1/2020.acl-main.81) · [OpenAlex](https://openalex.org/W3035309733) **Citations:** 148 citations (OpenAlex, 2026-10-14) · 51 in our library, of the 141,840 papers whose bibliographies we read ## Summary Chinese Spelling Check (CSC) means finding and fixing misused characters in Chinese text. Many such errors involve characters that sound or look alike but differ completely in meaning. Earlier systems used confusion sets only to narrow down candidate replacements. They did not model how similar characters relate to one another. The authors propose SpellGCN, which builds two graphs over characters from an open-source confusion set (Wu et al., 2013): one for pronunciation and one for shape. A lightweight GCN with no nonlinearity runs over these graphs, starting from BERT character embeddings. Attention merges the outputs of the two graphs. The resulting vectors serve as character classifiers applied to BERT's contextual representations, so the whole system trains end to end. On three human-annotated benchmarks (SIGHAN 2013, 2014 and 2015), the authors report clear gains over BERT alone and over previous models. Case studies show that SpellGCN picks corrections matching the phonetic or visual form, whereas plain BERT often picks fitting but unrelated characters. The approach shows how symbolic similarity knowledge can be built into a pretrained model's output space. ## Key points - Motivation: earlier work (Liu et al., 2010) estimates that roughly 83% of Chinese spelling errors involve phonological similarity and 48% involve visual similarity. - The graphs cover up to about 5K characters. Adding a ReLU after the graph convolution hurt performance, so it was dropped to stay in BERT's embedding space. - Ablation on SIGHAN 2013 (10K training samples, character-level C-F) compared ways to combine the two graphs: - baseline without SpellGCN: 67.0 - sum pooling: 66.3 - mean pooling: 67.5 - attentive combination with β=3 (best): 68.2 - Performance improves with up to 3 SpellGCN layers and declines with more, which the authors attribute to over-smoothing. - False positive rate is slightly lower than BERT's: 14.1% vs 15.3% on SIGHAN 14, and 13.2% vs 13.6% on SIGHAN 15. Code and data are released at github.com/ACL2020SpellGCN/SpellGCN. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Ant Group](https://md.research.elamur.ai/free/en/companies/ant-group/) — Company, Hangzhou, China · 5 works · 633 citations 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works 🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 1,343 works ## Cite Cite as: Xingyi Cheng, Weidi Xu, Kunlong Chen, Shaohua Jiang, Feng Wang, Taifeng Wang, Wei Chu and Yuan Qi. 2020. SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{cheng2020spellgcn, title = {{SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check}}, author = {Xingyi Cheng, Weidi Xu, Kunlong Chen, Shaohua Jiang, Feng Wang, Taifeng Wang, Wei Chu and Yuan Qi}, booktitle = {Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics}, year = {2020}, doi = {10.18653/v1/2020.acl-main.81}, url = {https://doi.org/10.18653/v1/2020.acl-main.81} } ``` - [← previous A Corpus of Turkish Offensive Language on Social Media](https://md.research.elamur.ai/free/en/papers/coltekin-2020-corpus-turkish-offensive-language-social/) - [next → We Can Detect Your Bias: Predicting the Political Ideology of News Articles](https://md.research.elamur.ai/free/en/papers/baly-2020-we-can-detect-your-bias/) - [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/page/3/) *Updated 24 October 2026*