---
title: "BlackboxNLP Workshop on Analyzing and Interpreting Neural"
description: "BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP 2021 — accepted papers: 1 paper in the Elamur Research…"
canonical: "https://research.elamur.ai/free/en/venues/blackboxnlp/2021/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/venues/blackboxnlp/2021/)

[home](https://md.research.elamur.ai/free/en/) / [venues](https://md.research.elamur.ai/free/en/venues/) / [BlackboxNLP Workshop on Analyzing and…](https://md.research.elamur.ai/free/en/venues/blackboxnlp/) / 2021

# BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP 2021 — accepted papers

BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP 2021 is the 2021 edition of the BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, held in Punta Cana, Dominican Republic, November 2021 (publisher: Association for Computational Linguistics). The ACL Anthology lists 43 papers of it; our library holds 1 with our summaries. Below: the most cited papers, every accepted paper, and ours with their topics, authors and institutions.

[**43** papers in the proceedings](#all) · [**1** work in our library](https://md.research.elamur.ai/free/en/venues/blackboxnlp/2021/#works) · [**11** citations of these works](https://md.research.elamur.ai/free/en/venues/blackboxnlp/2021/#works)**Punta Cana, Dominican Republic** where it was held**November 2021** when

## Most cited papers

By their OpenAlex citations; a paper with our summary links to its page here, the others to the original.

1. **[Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers ↗](https://aclanthology.org/2021.blackboxnlp-1.42/)**Jason Phang, Haokun Liu, Samuel R. Bowman*22 citations*
2. **[Perturbing Inputs for Fragile Interpretations in Deep Natural Language Processing ↗](https://aclanthology.org/2021.blackboxnlp-1.33/)**Sanchit Sinha, Hanjie Chen, Arshdeep Sekhon et al.*20 citations*
3. **[To what extent do human explanations of model behavior align with actual model behavior? ↗](https://aclanthology.org/2021.blackboxnlp-1.1/)**Grusha Prasad, Yixin Nie, Mohit Bansal et al.*18 citations*
4. **[Enhancing Interpretable Clauses Semantically using Pretrained Word Representation ↗](https://aclanthology.org/2021.blackboxnlp-1.19/)**Rohan Kumar Yadav, Lei Jiao, Ole-Christoffer Granmo et al.*17 citations*
5. **[Probing Language Models for Understanding of Temporal Expressions ↗](https://aclanthology.org/2021.blackboxnlp-1.31/)**Shivin Thukral, Kunal Kukreja, Christian Kavouras*17 citations*
6. **[Can Transformers Jump Around Right in Natural Language? Assessing Performance Transfer from SCAN ↗](https://aclanthology.org/2021.blackboxnlp-1.9/)**Rahma Chaabouni, Roberto Dessì, Eugene Kharitonov*15 citations*
7. **[Analyzing BERT's Knowledge of Hypernymy via Prompting ↗](https://aclanthology.org/2021.blackboxnlp-1.20/)**Michael Hanna, David Mareček*14 citations*
8. **[Do Language Models Know the Way to Rome? ↗](https://aclanthology.org/2021.blackboxnlp-1.40/)**Bastien Liétard, Mostafa Abdou, Anders Søgaard*14 citations*
9. **[A howling success or a working sea? Testing what BERT knows about metaphors ↗](https://aclanthology.org/2021.blackboxnlp-1.13/)**Paolo Pedinotti, Eliana Di Palma, Ludovica Cerini et al.*13 citations*
10. **[ALL Dolphins Are Intelligent and SOME Are Friendly: Probing BERT for Nouns' Semantic Properties and their Prototypicality ↗](https://aclanthology.org/2021.blackboxnlp-1.7/)**Marianna Apidianaki, Aina Garí Soler*13 citations*

## All accepted papers (43)

The most cited first; 1 with our summary link to their page here, the others to the original.

1. **[Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers ↗](https://aclanthology.org/2021.blackboxnlp-1.42/)**Jason Phang, Haokun Liu, Samuel R. Bowman*22 citations*
2. **[Perturbing Inputs for Fragile Interpretations in Deep Natural Language Processing ↗](https://aclanthology.org/2021.blackboxnlp-1.33/)**Sanchit Sinha, Hanjie Chen, Arshdeep Sekhon et al.*20 citations*
3. **[To what extent do human explanations of model behavior align with actual model behavior? ↗](https://aclanthology.org/2021.blackboxnlp-1.1/)**Grusha Prasad, Yixin Nie, Mohit Bansal et al.*18 citations*
4. **[Enhancing Interpretable Clauses Semantically using Pretrained Word Representation ↗](https://aclanthology.org/2021.blackboxnlp-1.19/)**Rohan Kumar Yadav, Lei Jiao, Ole-Christoffer Granmo et al.*17 citations*
5. **[Probing Language Models for Understanding of Temporal Expressions ↗](https://aclanthology.org/2021.blackboxnlp-1.31/)**Shivin Thukral, Kunal Kukreja, Christian Kavouras*17 citations*
6. **[Can Transformers Jump Around Right in Natural Language? Assessing Performance Transfer from SCAN ↗](https://aclanthology.org/2021.blackboxnlp-1.9/)**Rahma Chaabouni, Roberto Dessì, Eugene Kharitonov*15 citations*
7. **[Analyzing BERT's Knowledge of Hypernymy via Prompting ↗](https://aclanthology.org/2021.blackboxnlp-1.20/)**Michael Hanna, David Mareček*14 citations*
8. **[Do Language Models Know the Way to Rome? ↗](https://aclanthology.org/2021.blackboxnlp-1.40/)**Bastien Liétard, Mostafa Abdou, Anders Søgaard*14 citations*
9. **[A howling success or a working sea? Testing what BERT knows about metaphors ↗](https://aclanthology.org/2021.blackboxnlp-1.13/)**Paolo Pedinotti, Eliana Di Palma, Ludovica Cerini et al.*13 citations*
10. **[ALL Dolphins Are Intelligent and SOME Are Friendly: Probing BERT for Nouns' Semantic Properties and their Prototypicality ↗](https://aclanthology.org/2021.blackboxnlp-1.7/)**Marianna Apidianaki, Aina Garí Soler*13 citations*
11. **[How Does BERT Rerank Passages? An Attribution Analysis with Information Bottlenecks ↗](https://aclanthology.org/2021.blackboxnlp-1.39/)**Zhiying Jiang, Raphael Tang, Ji Xin et al.*11 citations*
12. **[The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generation ↗](https://aclanthology.org/2021.blackboxnlp-1.4/)**Laura Aina, Tal Linzen*11 citations*
13. **[Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations ↗](https://aclanthology.org/2021.blackboxnlp-1.29/)**Mohsen Fayyaz, Ehsan Aghazadeh, Ali Modarressi et al.*10 citations*
14. **[Investigating Negation in Pre-trained Vision-and-language Models ↗](https://aclanthology.org/2021.blackboxnlp-1.27/)**Radina Dobreva, Frank Keller*9 citations*
15. **[On the Language-specificity of Multilingual BERT and the Impact of Fine-tuning ↗](https://aclanthology.org/2021.blackboxnlp-1.15/)**Marc Tanti, Lonneke van der Plas, Claudia Borg et al.*9 citations*
16. **[Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratings](https://md.research.elamur.ai/free/en/papers/schuff-2021-does-external-knowledge-help-explainable/)**Hendrik Schuff, Hsiu-Yu Yang, Heike Adel et al.*8 citations · our summary*
17. **[Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it? ↗](https://aclanthology.org/2021.blackboxnlp-1.10/)**Tobias Norlund, Lovisa Hagström, Richard Johansson*8 citations*
18. **[Not all parameters are born equal: Attention is mostly what you need ↗](https://aclanthology.org/2021.blackboxnlp-1.28/)**Nikolay Bogoychev*7 citations*
19. **[Relating Neural Text Degeneration to Exposure Bias ↗](https://aclanthology.org/2021.blackboxnlp-1.16/)**Ting-Rui Chiang, Yun-Nung Chen*7 citations*
20. **[BERT Has Uncommon Sense: Similarity Ranking for Word Sense BERTology ↗](https://aclanthology.org/2021.blackboxnlp-1.43/)**Luke Gessler, Nathan Schneider*6 citations*
21. **[How Length Prediction Influence the Performance of Non-Autoregressive Translation? ↗](https://aclanthology.org/2021.blackboxnlp-1.14/)**Minghan Wang, Guo Jiaxin, Yuxia Wang et al.*6 citations*
22. **[Screening Gender Transfer in Neural Machine Translation ↗](https://aclanthology.org/2021.blackboxnlp-1.24/)**Guillaume Wisniewski, Lichao Zhu, Nicolas Ballier et al.*6 citations*
23. **[Assessing the Generalization Capacity of Pre-trained Language Models through Japanese Adversarial Natural Language Inference ↗](https://aclanthology.org/2021.blackboxnlp-1.26/)**Hitomi Yanaka, Koji Mineshima*5 citations*
24. **[How Familiar Does That Sound? Cross-Lingual Representational Similarity Analysis of Acoustic Word Embeddings ↗](https://aclanthology.org/2021.blackboxnlp-1.32/)**Badr Abdullah, Iuliia Zaitova, Tania Avgustinova et al.*5 citations*
25. **[Learning Mathematical Properties of Integers ↗](https://aclanthology.org/2021.blackboxnlp-1.30/)**Maria Ryskina, Kevin Knight*5 citations*

[See all 43 papers in BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP 2021 — accepted papers →](https://md.research.elamur.ai/free/en/venues/blackboxnlp/2021/papers/)

## Papers with our summary in our library (1)

The most cited first (OpenAlex citations plus our library's).

1. **[Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratings](https://md.research.elamur.ai/free/en/papers/schuff-2021-does-external-knowledge-help-explainable/) [BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP](https://md.research.elamur.ai/free/en/venues/blackboxnlp/)**Hendrik Schuff, Hsiu-Yu Yang, Heike Adel, et al.*2021 · 11 citations*

## Top topics

Topics of its works in our library, with the number of works on each.

[Evaluation & benchmarks (1)](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [Reasoning (1)](https://md.research.elamur.ai/free/en/topics/reasoning/)

## Fields

[Arts and Humanities (1)](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science (1)](https://md.research.elamur.ai/free/en/shelves/computer-science/)

## Top authors

Authors with a page who published here most often: their works here, and the citations of those works.

[🧑‍🔬**Heike Adel**1 work here · 11 citations](https://md.research.elamur.ai/free/en/authors/heike-adel/) · [🧑‍🔬**Hendrik Schuff**1 work here · 11 citations](https://md.research.elamur.ai/free/en/authors/hendrik-schuff/) · [🧑‍🔬**Hsiu-Yu Yang**1 work here · 11 citations](https://md.research.elamur.ai/free/en/authors/hsiu-yu-yang/) · [🧑‍🔬**Ngoc Thang Vu**1 work here · 11 citations](https://md.research.elamur.ai/free/en/authors/ngoc-thang-vu/)

## Top institutions

Institutions on the bylines of its works here, by the number of works.

[🎓**University of Stuttgart** Stuttgart · Germany 1 work here](https://md.research.elamur.ai/free/en/universities/university-of-stuttgart/) · [🏢**Robert Bosch** Stuttgart · Germany 1 work here](https://md.research.elamur.ai/free/en/companies/robert-bosch-germany/)

Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library.

- [← previous BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP 2020](https://md.research.elamur.ai/free/en/venues/blackboxnlp/2020/)
- [next → BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP 2022](https://md.research.elamur.ai/free/en/venues/blackboxnlp/2022/)
- [↑ back to BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP](https://md.research.elamur.ai/free/en/venues/blackboxnlp/)