---
title: "DetectGPT: Zero-Shot Machine-Generated Text — Mitchell 2023"
description: "LLMs now write fluent prose, and people can barely tell it apart from human writing."
authors: ["Eric Mitchell", "Yoonho Lee", "Alexander Khazatsky", "Christopher D. Manning", "Chelsea Finn"]
year: 2023
venue: "arXiv:2301.11305"
source: "https://arxiv.org/abs/2301.11305"
doi: "10.48550/arxiv.2301.11305"
arxiv: "2301.11305"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/mitchell-2023-detectgpt-zero-shot-machine-generated/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/mitchell-2023-detectgpt-zero-shot-machine-generated/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/page/2/) / DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature

# DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature

**Authors:** [Eric Mitchell](https://md.research.elamur.ai/free/en/authors/eric-mitchell/), Yoonho Lee, Alexander Khazatsky, [Christopher D. Manning](https://md.research.elamur.ai/free/en/authors/christopher-d-manning/), [Chelsea Finn](https://md.research.elamur.ai/free/en/authors/chelsea-finn/) · **Year:** 2023 · **Venue:** arXiv:2301.11305 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2301.11305) · [PDF](https://arxiv.org/pdf/2301.11305) · [DOI 10.48550/arxiv.2301.11305](https://doi.org/10.48550/arxiv.2301.11305) · [arXiv 2301.11305](https://arxiv.org/abs/2301.11305) · [OpenAlex](https://openalex.org/W4318351452)

**Citations:** 150 citations (openalex-snapshot · 2026-10-14) · [323](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
LLMs now write fluent prose, and people can barely tell it apart from human writing. That makes detection important for education and journalism. This Stanford paper (ICML 2023) introduces DetectGPT, a zero-shot detector. It needs no trained classifier, no collected dataset of real or fake passages, and no watermark. The method rests on a geometric observation. Text sampled from a model tends to sit where the model's log probability function curves downward, so slightly edited versions of it usually score lower. Edits of human-written text show no such consistent drop. To use this, DetectGPT masks spans of a passage and refills them with an off-the-shelf mask-filling model such as T5. It then compares the source model's log probability for the original with the average score of these perturbed versions, normalized by their spread. A large gap points to machine origin. Across several LLMs and datasets, the method beats earlier zero-shot baselines. For fake news articles from GPT-NeoX-20B, it raises AUROC from 0.81 to 0.95. Because nothing is trained, it can be applied to a newly released model right away.

## Key points
- **Criterion:** The "perturbation discrepancy" is the original passage's log probability minus the mean log probability of its perturbed versions. It approximates the trace of the Hessian, which measures local curvature.
- **Headline result:** On GPT-NeoX (20B) news generations, AUROC rises from 0.81 (best zero-shot baseline, average log probability) to 0.95. Gains exceed 0.1 AUROC for several source models. Evaluation data include XSum, SQuAD, WritingPrompts and PubMedQA.
- **Practical settings:** Accuracy improves up to about 100 perturbations and then levels off. A discrepancy threshold of about 0.1 separates GPT-Neo-2.7B text from human text across domains. mT5 replaces T5 for non-English text.
- **Limitations:** The method assumes white-box access to the model's log probabilities, which can cost money through APIs and is not available for ChatGPT. It is more compute-heavy than baselines because every perturbation must be scored. Performance drops when mask-fillers rewrite a domain poorly, as with PubMedQA.
- **Resources:** Code and data are at ericmitchell.ai/detectgpt. The authors suggest combining the method with watermarking and scoring with ensembles of models in black-box settings.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/) · [AI & machine learning](https://md.research.elamur.ai/free/en/shelves/ai/)

## Cited by

Cited by

323 papers of our library cite it (of the 140673 whose bibliographies we read); 13 of them have a page here, 310 not yet.

- [Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature](https://md.research.elamur.ai/free/en/papers/bao-2023-fast-detectgpt-efficient-zero-shot/)
- [TrustLLM: Trustworthiness in Large Language Models](https://md.research.elamur.ai/free/en/papers/huang-2024-trustllm-trustworthiness-large-language-models/)
- [Challenges and Applications of Large Language Models](https://md.research.elamur.ai/free/en/papers/kaddour-2023-challenges-applications-large-language-models/)
- [Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense](https://md.research.elamur.ai/free/en/papers/krishna-2023-paraphrasing-evades-detectors-ai-generated/)
- [GPT detectors are biased against non-native English writers](https://md.research.elamur.ai/free/en/papers/liang-2023-gpt-detectors-biased-against-non/)
- [Does DetectGPT Fully Utilize Perturbation? Bridging Selective Perturbation to Fine-tuned Contrastive Learning Detector would be Better](https://md.research.elamur.ai/free/en/papers/liu-2024-does-detectgpt-fully-utilize-perturbation/)
- [Corpus and Baselines for Distinguishing Authentic, AI-Generated, and AI-Enhanced Resumes](https://md.research.elamur.ai/free/en/papers/loizidou-2026-corpus-baselines-distinguishing-authentic-ai/)
- [When Translations Surprise: Human Awareness of Predictability in Translations](https://md.research.elamur.ai/free/en/papers/romero-2026-when-translations-surprise-human-awareness/)
- [Can AI-Generated Text be Reliably Detected?](https://md.research.elamur.ai/free/en/papers/sadasivan-2023-ai-generated-text-reliably-detected/)
- [SearchLLM: Detecting LLM Paraphrased Text by Measuring the Similarity with Regeneration of the Candidate Source via Search Engine](https://md.research.elamur.ai/free/en/papers/son-2026-searchllm-detecting-llm-paraphrased-text/)
- [Spotlights and Blindspots: Evaluating Machine-Generated Text Detection](https://md.research.elamur.ai/free/en/papers/stowe-2026-spotlights-blindspots-evaluating-machine-generated/)
- [Śmigiel Dataset: Laying Foundations for Investigating Machine-Generated Text Detection in Polish](https://md.research.elamur.ai/free/en/papers/strebeyko-2026-smigiel-dataset-laying-foundations-investigating/)
- [The Mark Fades: Adaptive Evolutionary Paraphrase-based Attack against LLM Watermarks](https://md.research.elamur.ai/free/en/papers/zhao-2026-mark-fades-adaptive-evolutionary-paraphrase/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{mitchell2023detectgpt,
  title = {{DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature}},
  author = {Mitchell, Eric and Lee, Yoonho and Khazatsky, Alexander and Manning, Christopher D. and Finn, Chelsea},
  year = {2023},
  doi = {10.48550/arxiv.2301.11305},
  eprint = {2301.11305},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2301.11305}
}
```

- [← previous Designing the LECOR Learner Corpus for Romanian](https://md.research.elamur.ai/free/en/papers/barbu-2023-designing-lecor-learner-corpus-romanian/)
- [next → Detecting Language Model Attacks with Perplexity](https://md.research.elamur.ai/free/en/papers/alon-2023-detecting-language-model-attacks-perplexity/)
- [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/page/2/)

## References

38 references, 11 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. G., Yin, P., Duke, T., Levskaya, A., Ghemawat, S., Dev, S., Michalewski, H., Garcia, X., Misra, V., Robinson, K., Fedus, L., Zhou, D., Ippolito, D., Luan, D., Lim, H., Zoph, B., Spiridonov, A., Sepassi, R., Dohan, D., Agrawal, S., Omernick, M., Dai, A. M., Pillai, T. S., Pellat, M., Lewkowycz, A., M… [find](https://scholar.google.com/scholar?q=G%2E%2C+Yin%2C+P%2E%2C+Duke%2C+T%2E%2C+Levskaya%2C+A%2E%2C+Ghemawat%2C+S%2E%2C+Dev%2C+S%2E%2C+Michalewski%2C+H%2E%2C+Garcia%2C+X%2E%2C+Misra%2C+V%2E%2C+Robinson%2C+K%2E%2C+Fedus%2C+L%2E%2C+Zhou%2C+D%2E%2C+Ippolito%2C+D%2E%2C+Luan%2C+D%2E%2C+Lim%2C+H%2E%2C+Zoph%2C+B%2E%2C+Spiridonov%2C+A%2E%2C+Sepass)
2. Aaronson, S. My Projects at OpenAI, Nov 2022. URL [https://scottaaronson.blog/?p=6823](https://scottaaronson.blog/?p=6823). [↗](https://scottaaronson.blog/?p=6823)
3. Bakhtin, A., Gross, S., Ott, M., Deng, Y., Ranzato, M., and Szlam, A. Real or fake? Learning to discriminate machine from human generated text. arXiv, 2019. URL http://arxiv.org/abs/1906.03351. — [arXiv:1906.03351](https://arxiv.org/abs/1906.03351) [↗](http://arxiv.org/abs/1906.03351)
4. Black, S., Gao, L., Wang, P., Leahy, C., and Biderman, S. GPT-Neo: Large Scale Autoregressive Language Modeling with Mesh-Tensorflow, March 2021. URL https://doi.org/10.5281/zenodo.5297715. — [doi:10.5281/zenodo.5297715](https://doi.org/10.5281/zenodo.5297715) [↗](https://doi.org/10.5281/zenodo.5297715)
5. Christian, J. CNET secretly used AI on articles that didn’t disclose that fact, staff say. [https://web.archive.org/web/20230124063916/https://futurism.com/cnet-ai-articles-label](https://web.archive.org/web/20230124063916/https://futurism.com/cnet-ai-articles-label), 2023. Accessed: 2023-01-25. [↗](https://web.archive.org/web/20230124063916/https://futurism.com/cnet-ai-articles-label)
6. Black, S., Biderman, S., Hallahan, E., Anthony, Q., Gao, L., Golding, L., He, H., Leahy, C., McDonell, K., Phang, J., Pieler, M., Prashanth, U. S., Purohit, S., Reynolds, L., Tow, J., Wang, B., and Weinbach, S. GPT-NeoX-20B: An open-source autoregressive language model. In Proceedings of the ACL Wor… [find](https://scholar.google.com/scholar?q=Black%2C+S%2E%2C+Biderman%2C+S%2E%2C+Hallahan%2C+E%2E%2C+Anthony%2C+Q%2E%2C+Gao%2C+L%2E%2C+Golding%2C+L%2E%2C+He%2C+H%2E%2C+Leahy%2C+C%2E%2C+McDonell%2C+K%2E%2C+Phang%2C+J%2E%2C+Pieler%2C+M%2E%2C+Prashanth%2C+U%2E+S%2E%2C+Purohit%2C+S%2E%2C+Reynolds%2C+L%2E%2C+Tow%2C+J%2E%2C+Wang%2C+B%2E%2C+and+We) [our card](https://md.research.elamur.ai/free/en/papers/black-2022-gpt-neox-20b-open-source/)
7. Bojar, O. r., Chatterjee, R., Federmann, C., Graham, Y., Haddow, B., Huck, M., Jimeno Yepes, A., Koehn, P., Logacheva, V., Monz, C., Negri, M., Neveol, A., Neves, M., Popel, M., Post, M., Rubino, R., Scarton, C., Specia, L., Turchi, M., Verspoor, K., and Zampieri, M. Findings of the 2016 conference… [find](https://scholar.google.com/scholar?q=Bojar%2C+O%2E+r%2E%2C+Chatterjee%2C+R%2E%2C+Federmann%2C+C%2E%2C+Graham%2C+Y%2E%2C+Haddow%2C+B%2E%2C+Huck%2C+M%2E%2C+Jimeno+Yepes%2C+A%2E%2C+Koehn%2C+P%2E%2C+Logacheva%2C+V%2E%2C+Monz%2C+C%2E%2C+Negri%2C+M%2E%2C+Neveol%2C+A%2E%2C+Neves%2C+M%2E%2C+Popel%2C+M%2E%2C+Post%2C+M%2E%2C+Rubino%2C+R%2E%2C+) [our card](https://md.research.elamur.ai/free/en/papers/bojar-2016-findings-2016-conference-machine-translation/)
8. Christiano, P. F., Leike, J., Brown, T., Martic, M., Legg, S., and Amodei, D. Deep reinforcement learning from human preferences. In Guyon, I., Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (eds.), Advances in Neural Information Processing Systems, volume 30.… [find](https://scholar.google.com/scholar?q=Christiano%2C+P%2E+F%2E%2C+Leike%2C+J%2E%2C+Brown%2C+T%2E%2C+Martic%2C+M%2E%2C+Legg%2C+S%2E%2C+and+Amodei%2C+D%2E+Deep+reinforcement+learning+from+human+preferences%2E+In+Guyon%2C+I%2E%2C+Luxburg%2C+U%2E+V%2E%2C+Bengio%2C+S%2E%2C+Wallach%2C+H%2E%2C+Fergus%2C+R%2E%2C+Vis)
9. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and… [find](https://scholar.google.com/scholar?q=Devlin%2C+J%2E%2C+Chang%2C+M%2E%2DW%2E%2C+Lee%2C+K%2E%2C+and+Toutanova%2C+K%2E+BERT%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+In+Proceedings+of+the+2019+Conference+of+the+North+American+Chapt)
10. Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Dolhansky, B., Bitton, J.,… [find](https://scholar.google.com/scholar?q=Brown%2C+T%2E%2C+Mann%2C+B%2E%2C+Ryder%2C+N%2E%2C+Subbiah%2C+M%2E%2C+Kaplan%2C+J%2E+D%2E%2C+Dhariwal%2C+P%2E%2C+Neelakantan%2C+A%2E%2C+Shyam%2C+P%2E%2C+Sastry%2C+G%2E%2C+Askell%2C+A%2E%2C+Agarwal%2C+S%2E%2C+Herbert%2DVoss%2C+A%2E%2C+Krueger%2C+G%2E%2C+Henighan%2C+T%2E%2C+Child%2C+R%2E%2C+Rames)
11. Gehrmann, S., Strobelt, H., and Rush, A. GLTR: Statistical detection and visualization of generated text. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 111–116, Florence, Italy, July 2019. Association for Computational Linguist… [find](https://scholar.google.com/scholar?q=Gehrmann%2C+S%2E%2C+Strobelt%2C+H%2E%2C+and+Rush%2C+A%2E+GLTR%3A+Statistical+detection+and+visualization+of+generated+text%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%3A+Sy) [our card](https://md.research.elamur.ai/free/en/papers/krishna-2023-paraphrasing-evades-detectors-ai-generated/)
12. Liang, W., Yuksekgonul, M., Mao, Y., Wu, E., and Zou, J. Gpt detectors are biased against non-native english writers. arXiv preprint arXiv:2304.02819, 2023. [find](https://scholar.google.com/scholar?q=Liang%2C+W%2E%2C+Yuksekgonul%2C+M%2E%2C+Mao%2C+Y%2E%2C+Wu%2C+E%2E%2C+and+Zou%2C+J%2E+Gpt+detectors+are+biased+against+non%2Dnative+english+writers%2E+arXiv+preprint+arXiv%3A2304%2E02819%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/liang-2023-gpt-detectors-biased-against-non/)
13. Lin, S., Hilton, J., and Evans, O. TruthfulQA: Measuring how models mimic human falsehoods. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 3214– 3252, Dublin, Ireland, May 2022. Association for Computational Linguistics. doi: 1… [find](https://scholar.google.com/scholar?q=Lin%2C+S%2E%2C+Hilton%2C+J%2E%2C+and+Evans%2C+O%2E+TruthfulQA%3A+Measuring+how+models+mimic+human+falsehoods%2E+In+Proceedings+of+the+60th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+Long+P) [our card](https://md.research.elamur.ai/free/en/papers/lin-2022-truthfulqa-measuring-how-models-mimic/)
14. Guarnera, L., Giudice, O., and Battiato, S. Deepfake detection by analyzing convolutional traces. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, June 2020. [find](https://scholar.google.com/scholar?q=Guarnera%2C+L%2E%2C+Giudice%2C+O%2E%2C+and+Battiato%2C+S%2E+Deepfake+detection+by+analyzing+convolutional+traces%2E+In+Proceedings+of+the+IEEE%2FCVF+Conference+on+Computer+Vision+and+Pattern+Recognition+%28CVPR%29+Workshops%2C)
15. Güera, D. and Delp, E. J. Deepfake video detection using recurrent neural networks. In 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6, 2018. doi: 10.1109/AVSS.2018.8639163. — [doi:10.1109/avss.2018.8639163](https://doi.org/10.1109/avss.2018.8639163) [find](https://scholar.google.com/scholar?q=Gu%CC%88era%2C+D%2E+and+Delp%2C+E%2E+J%2E+Deepfake+video+detection+using+recurrent+neural+networks%2E+In+2018+15th+IEEE+International+Conference+on+Advanced+Video+and+Signal+Based+Surveillance+%28AVSS%29%2C+pp%2E+1%E2%80%936%2C+2018%2E+d)
16. Hutchinson, M. A stochastic estimator of the trace of the influence matrix for laplacian smoothing splines. Communications in Statistics - Simulation and Computation, 19(2):433–450, 1990. doi: 10.1080/ 03610919008812866. URL https://doi.org/10. 1080/03610919008812866. [find](https://scholar.google.com/scholar?q=Hutchinson%2C+M%2E+A+stochastic+estimator+of+the+trace+of+the+influence+matrix+for+laplacian+smoothing+splines%2E+Communications+in+Statistics+%2D+Simulation+and+Computation%2C+19%282%29%3A433%E2%80%93450%2C+1990%2E+doi%3A+10%2E1080)
17. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692, 2019. [find](https://scholar.google.com/scholar?q=Liu%2C+Y%2E%2C+Ott%2C+M%2E%2C+Goyal%2C+N%2E%2C+Du%2C+J%2E%2C+Joshi%2C+M%2E%2C+Chen%2C+D%2E%2C+Levy%2C+O%2E%2C+Lewis%2C+M%2E%2C+Zettlemoyer%2C+L%2E%2C+and+Stoyanov%2C+V%2E+Roberta%3A+A+robustly+optimized+bert+pretraining+approach%2E+arXiv+preprint+arXiv%3A1907%2E1169)
18. Mireshghallah, F., Mattern, J., Gao, S., Shokri, R., and Berg-Kirkpatrick, T. Smaller language models are better black-box machine-generated text detectors. arXiv preprint arXiv:2305.09859, 2023. — [arXiv:2305.09859](https://arxiv.org/abs/2305.09859) [find](https://scholar.google.com/scholar?q=Mireshghallah%2C+F%2E%2C+Mattern%2C+J%2E%2C+Gao%2C+S%2E%2C+Shokri%2C+R%2E%2C+and+Berg%2DKirkpatrick%2C+T%2E+Smaller+language+models+are+better+black%2Dbox+machine%2Dgenerated+text+detectors%2E+arXiv+preprint+arXiv%3A2305%2E09859%2C+2023%2E+%E2%80%94+%5Ba)
19. Narayan, S., Cohen, S. B., and Lapata, M. Don’t give me the details, just the summary! Topic-aware convolutional neural networks for extreme summarization. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, 2018. [find](https://scholar.google.com/scholar?q=Narayan%2C+S%2E%2C+Cohen%2C+S%2E+B%2E%2C+and+Lapata%2C+M%2E+Don%E2%80%99t+give+me+the+details%2C+just+the+summary%21+Topic%2Daware+convolutional+neural+networks+for+extreme+summarization%2E+In+Proceedings+of+the+2018+Conference+on+Emp)
20. Ippolito, D., Duckworth, D., Callison-Burch, C., and Eck, D. Automatic detection of generated text is easiest when humans are fooled. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 1808–1822, Online, July 2020. Association for Computational Linguistic… [find](https://scholar.google.com/scholar?q=Ippolito%2C+D%2E%2C+Duckworth%2C+D%2E%2C+Callison%2DBurch%2C+C%2E%2C+and+Eck%2C+D%2E+Automatic+detection+of+generated+text+is+easiest+when+humans+are+fooled%2E+In+Proceedings+of+the+58th+Annual+Meeting+of+the+Association+for+C) [our card](https://md.research.elamur.ai/free/en/papers/ippolito-2019-automatic-detection-generated-text-easiest/)
21. OpenAI. Chatgpt: Optimizing language models for dialogue. [http://web.archive.org/web/](http://web.archive.org/web/) 20230109000707/https://openai.com/ blog/chatgpt/, 2022. Accessed: 2023-01-10. [↗](http://web.archive.org/web/)
22. Jawahar, G., Abdul-Mageed, M., and Lakshmanan, L. V. S. Automatic detection of machine generated text: A critical survey. In International Conference on Computational Linguistics, 2020. [find](https://scholar.google.com/scholar?q=Jawahar%2C+G%2E%2C+Abdul%2DMageed%2C+M%2E%2C+and+Lakshmanan%2C+L%2E+V%2E+S%2E+Automatic+detection+of+machine+generated+text%3A+A+critical+survey%2E+In+International+Conference+on+Computational+Linguistics%2C+2020%2E)
23. Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., and Sutskever, I. Language models are unsupervised multitask learners, 2019. URL [https://d4mucfpksywv.cloudfront.net/](https://d4mucfpksywv.cloudfront.net/) better-language-models/language_ models_are_unsupervised_multitask_ learners.pdf. [↗](https://d4mucfpksywv.cloudfront.net/)
24. Jin, Q., Dhingra, B., Liu, Z., Cohen, W., and Lu, X. Pub-MedQA: A dataset for biomedical research question answering. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp… [find](https://scholar.google.com/scholar?q=Jin%2C+Q%2E%2C+Dhingra%2C+B%2E%2C+Liu%2C+Z%2E%2C+Cohen%2C+W%2E%2C+and+Lu%2C+X%2E+Pub%2DMedQA%3A+A+dataset+for+biomedical+research+question+answering%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language+Pro) [our card](https://md.research.elamur.ai/free/en/papers/jin-2019-pubmedqa-dataset-biomedical-research-question/)
25. Kirchenbauer, J., Geiping, J., Wen, Y., Katz, J., Miers, I., and Goldstein, T. A watermark for large language models, 2023. URL https://arxiv.org/abs/2301. 10226. [↗](https://arxiv.org/abs/2301) [our card](https://md.research.elamur.ai/free/en/papers/kirchenbauer-2023-watermark-large-language-models/)
26. Krishna, K., Song, Y., Karpinska, M., Wieting, J., and Iyyer, M. Paraphrasing evades detectors of ai-generated Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., and Liu, P. J. Exploring the limits of transfer learning with a unified text-to-text transformer. Jo… [find](https://scholar.google.com/scholar?q=Krishna%2C+K%2E%2C+Song%2C+Y%2E%2C+Karpinska%2C+M%2E%2C+Wieting%2C+J%2E%2C+and+Iyyer%2C+M%2E+Paraphrasing+evades+detectors+of+ai%2Dgenerated+Raffel%2C+C%2E%2C+Shazeer%2C+N%2E%2C+Roberts%2C+A%2E%2C+Lee%2C+K%2E%2C+Narang%2C+S%2E%2C+Matena%2C+M%2E%2C+Zhou%2C+Y%2E%2C+Li%2C+W%2E%2C+)
27. Rajpurkar, P., Zhang, J., Lopyrev, K., and Liang, P. SQuAD: 100,000+ questions for machine comprehension of text. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 2383– 2392, Austin, Texas, November 2016. Association for Computational Linguistics. doi: 1… [find](https://scholar.google.com/scholar?q=Rajpurkar%2C+P%2E%2C+Zhang%2C+J%2E%2C+Lopyrev%2C+K%2E%2C+and+Liang%2C+P%2E+SQuAD%3A+100%2C000%2B+questions+for+machine+comprehension+of+text%2E+In+Proceedings+of+the+2016+Conference+on+Empirical+Methods+in+Natural+Language+Process) [our card](https://md.research.elamur.ai/free/en/papers/rajpurkar-2016-squad-100-000-questions-machine/)
28. Roose, K. and Newton, C. ChatGPT transforms a classroom and is ‘M3GAN’ real? Hard Fork, a New York Times Podcast, 2022. URL [https://www.nytimes.com/2023/01/13/podcasts/](https://www.nytimes.com/2023/01/13/podcasts/) hard-fork-chatgpt-teachers-gen-z-cameras-m3gan. html. [↗](https://www.nytimes.com/2023/01/13/podcasts/)
29. Sadasivan, V. S., Kumar, A., Balasubramanian, S., Wang, W., and Feizi, S. Can ai-generated text be reliably detected? arXiv preprint arXiv:2303.11156, 2023. [find](https://scholar.google.com/scholar?q=Sadasivan%2C+V%2E+S%2E%2C+Kumar%2C+A%2E%2C+Balasubramanian%2C+S%2E%2C+Wang%2C+W%2E%2C+and+Feizi%2C+S%2E+Can+ai%2Dgenerated+text+be+reliably+detected%3F+arXiv+preprint+arXiv%3A2303%2E11156%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/sadasivan-2023-ai-generated-text-reliably-detected/)
30. Solaiman, I., Brundage, M., Clark, J., Askell, A., Herbert-Voss, A., Wu, J., Radford, A., and Wang, J. Release strategies and the social impacts of language models, 2019. URL [https://arxiv.org/ftp/arxiv/](https://arxiv.org/ftp/arxiv/) papers/1908/1908.09203.pdf. [↗](https://arxiv.org/ftp/arxiv/)
31. Uchendu, A., Le, T., Shu, K., and Lee, D. Authorship attribution for neural text generation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 8384–8395, Online, November 2020. Association for Computational Linguistics. doi: 10.18653/v1/2020.emnlp… [find](https://scholar.google.com/scholar?q=Uchendu%2C+A%2E%2C+Le%2C+T%2E%2C+Shu%2C+K%2E%2C+and+Lee%2C+D%2E+Authorship+attribution+for+neural+text+generation%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28EMNLP%29%2C+pp%2E+8384)
32. Wang, B. and Komatsuzaki, A. GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model. [https://github.com/kingoflolz/](https://github.com/kingoflolz/) mesh-transformer-jax, May 2021. [↗](https://github.com/kingoflolz/)
33. Zellers, R., Holtzman, A., Rashkin, H., Bisk, Y., Farhadi, A., Roesner, F., and Choi, Y. Defending against neural fake news. In Neural Information Processing Systems, 2019. [find](https://scholar.google.com/scholar?q=Zellers%2C+R%2E%2C+Holtzman%2C+A%2E%2C+Rashkin%2C+H%2E%2C+Bisk%2C+Y%2E%2C+Farhadi%2C+A%2E%2C+Roesner%2C+F%2E%2C+and+Choi%2C+Y%2E+Defending+against+neural+fake+news%2E+In+Neural+Information+Processing+Systems%2C+2019%2E) [our card](https://md.research.elamur.ai/free/en/papers/zellers-2019-defending-against-neural-fake-news/)
34. Zhang, S., Roller, S., Goyal, N., Artetxe, M., Chen, M., Chen, S., Dewan, C., Diab, M., Li, X., Lin, X. V., Mihaylov, T., Ott, M., Shleifer, S., Shuster, K., Simig, D., Koura, P. S., Sridhar, A., Wang, T., and Zettlemoyer, L. Opt: Open pre-trained transformer language models, 2022. URL https://arxiv… [find](https://scholar.google.com/scholar?q=Zhang%2C+S%2E%2C+Roller%2C+S%2E%2C+Goyal%2C+N%2E%2C+Artetxe%2C+M%2E%2C+Chen%2C+M%2E%2C+Chen%2C+S%2E%2C+Dewan%2C+C%2E%2C+Diab%2C+M%2E%2C+Li%2C+X%2E%2C+Lin%2C+X%2E+V%2E%2C+Mihaylov%2C+T%2E%2C+Ott%2C+M%2E%2C+Shleifer%2C+S%2E%2C+Shuster%2C+K%2E%2C+Simig%2C+D%2E%2C+Koura%2C+P%2E+S%2E%2C+Sridhar%2C+A%2E%2C+Wang)
35. Zhao, H., Zhou, W., Chen, D., Wei, T., Zhang, W., and Yu, N. Multi-attentional deepfake detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 2185–2194, 2021. [find](https://scholar.google.com/scholar?q=Zhao%2C+H%2E%2C+Zhou%2C+W%2E%2C+Chen%2C+D%2E%2C+Wei%2C+T%2E%2C+Zhang%2C+W%2E%2C+and+Yu%2C+N%2E+Multi%2Dattentional+deepfake+detection%2E+In+Proceedings+of+the+IEEE%2FCVF+conference+on+computer+vision+and+pattern+recognition%2C+pp%2E+2185%E2%80%932194%2C+)
36. Zi, B., Chang, M., Chen, J., Ma, X., and Jiang, Y.-G. Wild-deepfake: A challenging real-world dataset for deepfake detection. In Proceedings of the 28th ACM international conference on multimedia, pp. 2382–2390, 2020. [find](https://scholar.google.com/scholar?q=Zi%2C+B%2E%2C+Chang%2C+M%2E%2C+Chen%2C+J%2E%2C+Ma%2C+X%2E%2C+and+Jiang%2C+Y%2E%2DG%2E+Wild%2Ddeepfake%3A+A+challenging+real%2Dworld+dataset+for+deepfake+detection%2E+In+Proceedings+of+the+28th+ACM+international+conference+on+multimedia%2C+pp%2E)
37. Ziegler, D. M., Stiennon, N., Wu, J., Brown, T. B., Radford, A., Amodei, D., Christiano, P., and Irving, G. Fine-tuning language models from human preferences, 2020. [find](https://scholar.google.com/scholar?q=Ziegler%2C+D%2E+M%2E%2C+Stiennon%2C+N%2E%2C+Wu%2C+J%2E%2C+Brown%2C+T%2E+B%2E%2C+Radford%2C+A%2E%2C+Amodei%2C+D%2E%2C+Christiano%2C+P%2E%2C+and+Irving%2C+G%2E+Fine%2Dtuning+language+models+from+human+preferences%2C+2020%2E)
38. A. Complete Results for Top-p and Top-k Decoding [find](https://scholar.google.com/scholar?q=A%2E+Complete+Results+for+Top%2Dp+and+Top%2Dk+Decoding)