---
title: "Workshop on Trustworthy NLP 2023 — accepted papers"
description: "Workshop on Trustworthy NLP 2023 — accepted papers: 2 papers in the Elamur Research library (Toronto, Canada), with our summaries…"
canonical: "https://research.elamur.ai/free/en/venues/trustnlp/2023/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/venues/trustnlp/2023/)

[home](https://md.research.elamur.ai/free/en/) / [venues](https://md.research.elamur.ai/free/en/venues/) / [Workshop on Trustworthy NLP](https://md.research.elamur.ai/free/en/venues/trustnlp/) / 2023

# Workshop on Trustworthy NLP 2023 — accepted papers

Workshop on Trustworthy NLP 2023 is the 2023 edition of the Workshop on Trustworthy NLP, held in Toronto, Canada, July 2023 (publisher: Association for Computational Linguistics). The ACL Anthology lists 28 papers of it; our library holds 2 with our summaries. Below: the most cited papers, every accepted paper, and ours with their topics, authors and institutions.

📍 Toronto, [Canada](https://md.research.elamur.ai/free/en/countries/canada/) · 🗓 July 2023

[**28** papers in the proceedings](#all) · [**2** works in our library](https://md.research.elamur.ai/free/en/venues/trustnlp/2023/#works) · [**107** citations of these works](https://md.research.elamur.ai/free/en/venues/trustnlp/2023/#works)

## Most cited papers

By their OpenAlex citations; a paper with our summary links to its page here, the others to the original.

1. **[Can we trust the evaluation on ChatGPT?](https://md.research.elamur.ai/free/en/papers/aiyappa-2023-can-we-trust-evaluation-chatgpt/)**Rachith Aiyappa, Jisun An, Haewoon Kwak et al.*68 citations · our summary*
2. **[Privacy- and Utility-Preserving NLP with Anonymized data: A case study of Pseudonymization ↗](https://aclanthology.org/2023.trustnlp-1.20/)**Oleksandr Yermilov, Vipul Raheja, Artem Chernodub*30 citations*
3. **[Detecting Personal Information in Training Corpora: an Analysis ↗](https://aclanthology.org/2023.trustnlp-1.18/)**Nishant Subramani, Sasha Luccioni, Jesse Dodge et al.*20 citations*
4. **[Training Data Extraction From Pre-trained Language Models: A Survey ↗](https://aclanthology.org/2023.trustnlp-1.23/)**Shotaro Ishihara*19 citations*
5. **[Automated Ableism: An Exploration of Explicit Disability Biases in Sentiment and Toxicity Analysis Models ↗](https://aclanthology.org/2023.trustnlp-1.3/)**Pranav Narayanan Venkit, Mukund Srinath, Shomir Wilson*15 citations*
6. **[Distinguishing Fact from Fiction: A Benchmark Dataset for Identifying Machine-Generated Scientific Papers in the LLM Era. ↗](https://aclanthology.org/2023.trustnlp-1.17/)**Edoardo Mosca, Mohamed Hesham Ibrahim Abdalla, Paolo Basso et al.*14 citations*
7. **[Improving Factuality of Abstractive Summarization via Contrastive Reward Learning ↗](https://aclanthology.org/2023.trustnlp-1.6/)**I-chun Chern, Zhiruo Wang, Sanjan Das et al.*11 citations*
8. **[Strength in Numbers: Estimating Confidence of Large Language Models by Prompt Agreement ↗](https://aclanthology.org/2023.trustnlp-1.28/)**Gwenyth Portillo Wightman, Alexandra Delucia, Mark Dredze*10 citations*
9. **[Reliability Check: An Analysis of GPT-3's Response to Sensitive Topics and Prompt Wording ↗](https://aclanthology.org/2023.trustnlp-1.8/)**Aisha Khatun, Daniel Brown*9 citations*
10. **[GPTs Don't Keep Secrets: Searching for Backdoor Watermark Triggers in Autoregressive Language Models ↗](https://aclanthology.org/2023.trustnlp-1.21/)**Evan Lucas, Timothy Havens*7 citations*

## All accepted papers (28)

The most cited first; 2 with our summary link to their page here, the others to the original.

1. **[Can we trust the evaluation on ChatGPT?](https://md.research.elamur.ai/free/en/papers/aiyappa-2023-can-we-trust-evaluation-chatgpt/)**Rachith Aiyappa, Jisun An, Haewoon Kwak et al.*68 citations · our summary*
2. **[Privacy- and Utility-Preserving NLP with Anonymized data: A case study of Pseudonymization ↗](https://aclanthology.org/2023.trustnlp-1.20/)**Oleksandr Yermilov, Vipul Raheja, Artem Chernodub*30 citations*
3. **[Detecting Personal Information in Training Corpora: an Analysis ↗](https://aclanthology.org/2023.trustnlp-1.18/)**Nishant Subramani, Sasha Luccioni, Jesse Dodge et al.*20 citations*
4. **[Training Data Extraction From Pre-trained Language Models: A Survey ↗](https://aclanthology.org/2023.trustnlp-1.23/)**Shotaro Ishihara*19 citations*
5. **[Automated Ableism: An Exploration of Explicit Disability Biases in Sentiment and Toxicity Analysis Models ↗](https://aclanthology.org/2023.trustnlp-1.3/)**Pranav Narayanan Venkit, Mukund Srinath, Shomir Wilson*15 citations*
6. **[Distinguishing Fact from Fiction: A Benchmark Dataset for Identifying Machine-Generated Scientific Papers in the LLM Era. ↗](https://aclanthology.org/2023.trustnlp-1.17/)**Edoardo Mosca, Mohamed Hesham Ibrahim Abdalla, Paolo Basso et al.*14 citations*
7. **[Improving Factuality of Abstractive Summarization via Contrastive Reward Learning ↗](https://aclanthology.org/2023.trustnlp-1.6/)**I-chun Chern, Zhiruo Wang, Sanjan Das et al.*11 citations*
8. **[Strength in Numbers: Estimating Confidence of Large Language Models by Prompt Agreement ↗](https://aclanthology.org/2023.trustnlp-1.28/)**Gwenyth Portillo Wightman, Alexandra Delucia, Mark Dredze*10 citations*
9. **[Reliability Check: An Analysis of GPT-3's Response to Sensitive Topics and Prompt Wording ↗](https://aclanthology.org/2023.trustnlp-1.8/)**Aisha Khatun, Daniel Brown*9 citations*
10. **[GPTs Don't Keep Secrets: Searching for Backdoor Watermark Triggers in Autoregressive Language Models ↗](https://aclanthology.org/2023.trustnlp-1.21/)**Evan Lucas, Timothy Havens*7 citations*
11. **[Guiding Text-to-Text Privatization by Syntax ↗](https://aclanthology.org/2023.trustnlp-1.14/)**Stefan Arnold, Dilara Yesilbas, Sven Weinzierl*6 citations*
12. **[IMBERT: Making BERT Immune to Insertion-based Backdoor Attacks ↗](https://aclanthology.org/2023.trustnlp-1.25/)**Xuanli He, Jun Wang, Benjamin Rubinstein et al.*6 citations*
13. **[Expanding Scope: Adapting English Adversarial Attacks to Chinese ↗](https://aclanthology.org/2023.trustnlp-1.24/)**Hanyu Liu, Chengyuan Cai, Yanjun Qi*5 citations*
14. **[Pay Attention to the Robustness of Chinese Minority Language Models! Syllable-level Textual Adversarial Attack on Tibetan Script ↗](https://aclanthology.org/2023.trustnlp-1.4/)**Xi Cao, Dolma Dawa, Nuo Qun et al.*5 citations*
15. **[A Keyword Based Approach to Understanding the Overpenalization of Marginalized Groups by English Marginal Abuse Models on Twitter](https://md.research.elamur.ai/free/en/papers/yee-2023-keyword-based-approach-understanding-overpenalization/)**Kyra Yee, Alice Schoenauer Sebag, Olivia Redfield et al.*4 citations · our summary*
16. **[Towards Faithful Explanations for Text Classification with Robustness Improvement and Explanation Guided Training ↗](https://aclanthology.org/2023.trustnlp-1.1/)**Dongfang Li, Baotian Hu, Qingcai Chen et al.*4 citations*
17. **[An Empirical Study of Metrics to Measure Representational Harms in Pre-Trained Language Models](https://md.research.elamur.ai/free/en/papers/hosseini-2023-empirical-study-metrics-measure-representational/)**Saghar Hosseini, Hamid Palangi, Ahmed Hassan Awadallah*3 citations · our summary*
18. **[DEPTH+: An Enhanced Depth Metric for Wikipedia Corpora Quality ↗](https://aclanthology.org/2023.trustnlp-1.16/)**Saied Alshahrani, Norah Alshahrani, Jeanna Matthews*3 citations*
19. **[Make Text Unlearnable: Exploiting Effective Patterns to Protect Personal Data ↗](https://aclanthology.org/2023.trustnlp-1.22/)**Xinzhe Li, Ming Liu*3 citations*
20. **[Driving Context into Text-to-Text Privatization ↗](https://aclanthology.org/2023.trustnlp-1.2/)**Stefan Arnold, Dilara Yesilbas, Sven Weinzierl*2 citations*
21. **[Enabling Classifiers to Make Judgements Explicitly Aligned with Human Values ↗](https://aclanthology.org/2023.trustnlp-1.27/)**Yejin Bang, Tiezheng Yu, Andrea Madotto et al.*2 citations*
22. **[Enhancing textual counterfactual explanation intelligibility through Counterfactual Feature Importance ↗](https://aclanthology.org/2023.trustnlp-1.19/)**Milan Bhan, Jean-noel Vittaut, Nicolas Chesneau et al.*2 citations*
23. **[On The Real-world Performance of Machine Translation: Exploring Social Media Post-authors' Perspectives ↗](https://aclanthology.org/2023.trustnlp-1.26/)**Ananya Gupta, Jae Takeuchi, Bart Knijnenburg*2 citations*
24. **[Are fairness metric scores enough to assess discrimination biases in machine learning? ↗](https://aclanthology.org/2023.trustnlp-1.15/)**Fanny Jourdan, Laurent Risser, Jean-michel Loubes et al.*1 citation*
25. **[Debunking Biases in Attention ↗](https://aclanthology.org/2023.trustnlp-1.13/)**Shijing Chen, Usman Naseem, Imran Razzak*1 citation*

[See all 28 papers in Workshop on Trustworthy NLP 2023 — accepted papers →](https://md.research.elamur.ai/free/en/venues/trustnlp/2023/papers/)

## Papers with our summary in our library (2)

The most cited first (OpenAlex citations plus our library's).

1. **[Can we trust the evaluation on ChatGPT?](https://md.research.elamur.ai/free/en/papers/aiyappa-2023-can-we-trust-evaluation-chatgpt/) [Workshop on Trustworthy NLP](https://md.research.elamur.ai/free/en/venues/trustnlp/)**Rachith Aiyappa, Jisun An, Haewoon Kwak, et al.*2023 · 103 citations*
2. **[A Keyword Based Approach to Understanding the Overpenalization of Marginalized Groups by English Marginal Abuse Models on Twitter](https://md.research.elamur.ai/free/en/papers/yee-2023-keyword-based-approach-understanding-overpenalization/) [Workshop on Trustworthy NLP](https://md.research.elamur.ai/free/en/venues/trustnlp/)**Kyra Yee, Alice Schoenauer Sebag, Olivia Redfield, et al.*2023 · 4 citations*

## Top topics

Topics of its works in our library, with the number of works on each.

[Evaluation & benchmarks (1)](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [English (1)](https://md.research.elamur.ai/free/en/topics/english/)

## Fields

[Computer Science (2)](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Social Sciences (2)](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · [Arts and Humanities (1)](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/)

## Top authors

Authors with a page who published here most often: their works here, and the citations of those works.

[🧑‍🔬**Haewoon Kwak**1 work here · 103 citations](https://md.research.elamur.ai/free/en/authors/haewoon-kwak/) · [🧑‍🔬**Jisun An**1 work here · 103 citations](https://md.research.elamur.ai/free/en/authors/jisun-an/) · [🧑‍🔬**Emily Sheng**1 work here · 4 citations](https://md.research.elamur.ai/free/en/authors/emily-sheng/) · [🧑‍🔬**Kyra Yee**1 work here · 4 citations](https://md.research.elamur.ai/free/en/authors/kyra-yee/) · [🧑‍🔬**Matthias Eck**1 work here · 4 citations](https://md.research.elamur.ai/free/en/authors/matthias-eck/) · [🧑‍🔬**Olivia Redfield**1 work here · 4 citations](https://md.research.elamur.ai/free/en/authors/olivia-redfield/)

## Top institutions

Institutions on the bylines of its works here, by the number of works.

[🎓**Indiana University Bloomington** Bloomington · United States 1 work here](https://md.research.elamur.ai/free/en/universities/indiana-university-bloomington/) · [🎓**Indiana University** Bloomington · United States 1 work here](https://md.research.elamur.ai/free/en/universities/indiana-university/)

Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library.

- [next → Workshop on Trustworthy NLP 2026](https://md.research.elamur.ai/free/en/venues/trustnlp/2026/)
- [↑ back to Workshop on Trustworthy NLP](https://md.research.elamur.ai/free/en/venues/trustnlp/)