--- title: "Synthetic Text Detection in the Age of Large Language Models:" description: "LLM output is now hard to tell apart from human writing. 90% accuracy. 7 references. Two families of detectors compete to identify it." authors: ["Adaku Uchendu"] year: 2026 venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)" source: "https://aclanthology.org/2026.acl-industry.9/" doi: "10.18653/v1/2026.acl-industry.9" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/uchendu-2026-synthetic-text-detection-age-large/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/uchendu-2026-synthetic-text-detection-age-large/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/51/) / Synthetic Text Detection in the Age of Large Language Models: Watermark vs. Automatic Detection # Synthetic Text Detection in the Age of Large Language Models: Watermark vs. Automatic Detection **Authors:** [Adaku Uchendu](https://md.research.elamur.ai/free/en/authors/adaku-uchendu/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.acl-industry.9/) · [PDF](https://aclanthology.org/2026.acl-industry.9.pdf) · [DOI 10.18653/v1/2026.acl-industry.9](https://doi.org/10.18653/v1/2026.acl-industry.9) · [OpenAlex](https://openalex.org/W7166856353) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary LLM output is now hard to tell apart from human writing. Two families of detectors compete to identify it. Watermarking embeds a key-dependent signal during generation, while post-hoc automatic detectors rely on statistical and stylistic cues. This Industry Track paper asks which family works better and under what conditions. The author generates short texts (motivational quotes, under 100 words) and long fiction (over 450 words) with six Qwen2.5 sizes from 1.5B to 72B. Each prompt yields an unwatermarked output plus outputs from six watermarking schemes run through MarkLLM. Text quality is checked with reference-based and reference-free metrics. The watermark detectors are compared against two zero-shot automatic detectors, MAGE and Binoculars, on clean texts and on texts altered by character-, word- and sentence-level obfuscation. No approach wins in every setting. Automatic detection is stronger on short texts, watermarks hold up better against misspellings, and homoglyph substitution defeats nearly every detector. The practical lesson is to pick a detector based on expected text length and likely attacks. ## Key points - **Setup:** six Qwen2.5 models (1.5B, 3B, 7B, 14B, 32B, 72B). Watermarks: KGW, UPV, SWEET, EWD, TS, Unbiased. Automatic detectors: MAGE (Longformer-based) and Binoculars (Falcon perplexity-based). - **Data:** 1066 motivational-quote prompts and 1035 fiction-story instructions. Each model produces 7 versions per prompt (one unwatermarked, six watermarked). - **Clean texts:** MAGE exceeds 90% accuracy on both short and long texts. Binoculars is weaker on long texts, and both automatic detectors beat watermark detection on short texts. - **Attacks:** - Homoglyph substitution is the most damaging; even the best detector, MAGE, reaches only about 10–40%. TS only looks robust because it labels almost everything as watermarked. - Under the misspelling attack, KGW, SWEET, EWD and TS keep high accuracy. - Under Mistral-based paraphrasing, only MAGE stays above 90%. - **Model size:** no Qwen2.5 size was consistently easier or harder to detect across all detectors. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [MIT Lincoln Laboratory](https://md.research.elamur.ai/free/en/labs/mit-lincoln-laboratory/) — Research institute, Lexington, United States · 4 works 📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 3,486 works ## Cite Cite as: Adaku Uchendu. 2026. Synthetic Text Detection in the Age of Large Language Models: Watermark vs. Automatic Detection. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{uchendu2026synthetic, title = {{Synthetic Text Detection in the Age of Large Language Models: Watermark vs. Automatic Detection}}, author = {Adaku Uchendu}, booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)}, year = {2026}, doi = {10.18653/v1/2026.acl-industry.9}, url = {https://doi.org/10.18653/v1/2026.acl-industry.9} } ``` - [← previous Synthetic Instruction Generation for Low-Resource Nordic Languages: Viability and Limitations in LLM Instruction-Tuning](https://md.research.elamur.ai/free/en/papers/stenlund-2026-synthetic-instruction-generation-low-resource/) - [next → SynthFix: Adaptive Neuro-Symbolic Code Vulnerability Repair](https://md.research.elamur.ai/free/en/papers/zhang-2026-synthfix-adaptive-neuro-symbolic-code/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/51/) ## References 7 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. George Alexandru Adam, Alexander Cui, Edwin Thomas, Emily Napier, Nazar Shmatko, Jacob Schnell, Jacob Junqi Tian, Alekhya Dronavalli, Edward Tian, and Dongwon Lee. 2026. Gptzero: Robust detection of llm-generated texts. Preprint, arXiv:2602.13042. — [arXiv:2602.13042](https://arxiv.org/abs/2602.13042) [find](https://scholar.google.com/scholar?q=George+Alexandru+Adam%2C+Alexander+Cui%2C+Edwin+Thomas%2C+Emily+Napier%2C+Nazar+Shmatko%2C+Jacob+Schnell%2C+Jacob+Junqi+Tian%2C+Alekhya+Dronavalli%2C+Edward+Tian%2C+and+Dongwon+Lee%2E+2026%2E+Gptzero%3A+Robust+detection+of+l) 2. Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Mérouane Debbah, Étienne Goffinet, Daniel Hesslow, Julien Launay, Quentin Malartic, and 1 others. 2023. [The falcon series of open language models](https://md.research.elamur.ai/free/en/papers/almazrouei-2023-falcon-series-open-language-models/). arXiv preprint arXiv:2311.16867. 3. Kenneth Alperin, Rohan Leekha, Adaku Uchendu, Trang Nguyen, Srilakshmi Medarametla, Carlos Levya Capote, Seth Aycock, and Charlie Dagli. 2025. Masks and mimicry: Strategic obfuscation and impersonation attacks on authorship verification. In Proceedings of the 5th International Conference on Natural… [find](https://scholar.google.com/scholar?q=Kenneth+Alperin%2C+Rohan+Leekha%2C+Adaku+Uchendu%2C+Trang+Nguyen%2C+Srilakshmi+Medarametla%2C+Carlos+Levya+Capote%2C+Seth+Aycock%2C+and+Charlie+Dagli%2E+2025%2E+Masks+and+mimicry%3A+Strategic+obfuscation+and+impersonatio) 4. Iz Beltagy, Matthew E Peters, and Arman Cohan. 2020. [Longformer: The long-document transformer](https://md.research.elamur.ai/free/en/papers/beltagy-2020-longformer-long-document-transformer/). arXiv preprint arXiv:2004.05150. 5. Shuyang Cai and Wanyun Cui. 2023. Evade chatgpt detectors via a single space. Preprint, arXiv:2307.02599. — [arXiv:2307.02599](https://arxiv.org/abs/2307.02599) [find](https://scholar.google.com/scholar?q=Shuyang+Cai+and+Wanyun+Cui%2E+2023%2E+Evade+chatgpt+detectors+via+a+single+space%2E+Preprint%2C+arXiv%3A2307%2E02599%2E+%E2%80%94+%5BarXiv%3A2307%2E02599%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2307%2E02599%29) 6. Dialects and Languages: We only focus on standard English for our study, however, it will be beneficial to observe the performance of these detectors and obfuscators on other English dialects. Furthermore, we can explore different languages and their variants as well. [find](https://scholar.google.com/scholar?q=Dialects+and+Languages%3A+We+only+focus+on+standard+English+for+our+study%2C+however%2C+it+will+be+beneficial+to+observe+the+performance+of+these+detectors+and+obfuscators+on+other+English+dialects%2E+Further) 7. Miranda Christ, Sam Gunn, and Or Zamir. 2024. Undetectable watermarks for language models. In The Thirty Seventh Annual Conference on Learning Theory, pages 1125–1139. PMLR. [find](https://scholar.google.com/scholar?q=Miranda+Christ%2C+Sam+Gunn%2C+and+Or+Zamir%2E+2024%2E+Undetectable+watermarks+for+language+models%2E+In+The+Thirty+Seventh+Annual+Conference+on+Learning+Theory%2C+pages+1125%E2%80%931139%2E+PMLR%2E) *Updated 1 November 2026*