--- title: "Interpreto: An Explainability Library for Transformers (2026)" description: "The authors present Interpreto, an MIT-licensed Python library for HuggingFace models, from BERT-style encoders to LLMs. 3 references." authors: ["Antonin Poché", "Thomas Mullor", "Gabriele Sarti", "Frédéric Boisnard", "Corentin Friedrich", "Charlotte Claye", "Francois Hoofd", "Raphael Bernas", "Nicholas Asher", "Celine Hudelot", "Fanny Jourdan"] year: 2026 venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)" source: "https://aclanthology.org/2026.acl-demo.1/" doi: "10.18653/v1/2026.acl-demo.1" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/poche-2026-interpreto-explainability-library-transformers/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/poche-2026-interpreto-explainability-library-transformers/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/33/) / Interpreto: An Explainability Library for Transformers # Interpreto: An Explainability Library for Transformers **Authors:** Antonin Poché, Thomas Mullor, [Gabriele Sarti](https://md.research.elamur.ai/free/en/authors/gabriele-sarti/), Frédéric Boisnard, Corentin Friedrich, Charlotte Claye, Francois Hoofd, Raphael Bernas, [Nicholas Asher](https://md.research.elamur.ai/free/en/authors/nicholas-asher/), [Celine Hudelot](https://md.research.elamur.ai/free/en/authors/celine-hudelot/) and [Fanny Jourdan](https://md.research.elamur.ai/free/en/authors/fanny-jourdan/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.acl-demo.1/) · [PDF](https://aclanthology.org/2026.acl-demo.1.pdf) · [DOI 10.18653/v1/2026.acl-demo.1](https://doi.org/10.18653/v1/2026.acl-demo.1) · [OpenAlex](https://openalex.org/W7166819489) **Citations:** 0 citations (OpenAlex, 2026-10-14) ## Summary Explaining how Transformer language models reach their outputs matters for debugging, detecting bias and safety work. Existing tools are fragmented, though. Some handle only attributions, others cover only one stage of concept analysis, and many support a single task or lack documentation and metrics. The authors present Interpreto, an MIT-licensed Python library for HuggingFace models, from BERT-style encoders to LLMs. It offers one interface for both classification and text generation, split into two modules. The attributions module scores how much input tokens, words or sentences contribute to a prediction. It uses perturbation- and gradient-based methods and adds faithfulness metrics and visualization. The concepts module covers the full workflow. It splits a model via nnsight to gather activations, learns concepts (largely through overcomplete), labels them (for example with an LLM), and estimates their effect on outputs. Correctness is checked with unit tests, sanity checks on hand-built models, and tests across many architectures. A demo gallery with runnable snippets accompanies the release. The library's value lies in making recent interpretability research easier to apply and benchmark from a single package. ## Key points - **Attributions module:** provides 10 methods (e.g., LIME, KernelSHAP, Occlusion) and 2 evaluation metrics, with granularity control. It supports SequenceClassification and CausalLM models. - **Concepts module:** offers 15 concept-learning options (e.g., Semi-NMF, SAEs), 3 interpretation methods, concept-importance estimation and 7 metrics (e.g., ConSim, Stability). It also supports MaskedLM and Seq2SeqLM. - **Testing and requirements:** tested on more than 15 architectures. Requires Python 3.10–3.13, torch ≥ 2.0, transformers ≥ 4.22 and nnsight ≥ 0.5.1. Installed via `uv pip install interpreto`. - **Demo gallery:** covers 6 models. The classifiers are DistilBERT/IMDB, BERT/emotion and RoBERTa/AG-News. The generators are GPT-2, Qwen3-0.6B and Llama 3.1 8B. - **Example cost:** learning 20 Semi-NMF concepts on Qwen3-0.6B from 100 AG-News samples, then labeling them with GPT-4.1-nano, takes under 3 minutes on an RTX 3080. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Institut de Recherche en Informatique de Toulouse](https://md.research.elamur.ai/free/en/labs/institut-de-recherche-en-informatique-de-toulouse/) — Research institute, Toulouse, France · 35 works · 1,872 citations - [CentraleSupélec](https://md.research.elamur.ai/free/en/labs/centralesupelec/) — Research institute, Gif-sur-Yvette, France · 10 works · 1,330 citations - [Mathématiques et Informatique pour la Complexité et les Systèmes](https://md.research.elamur.ai/free/en/labs/mathematiques-et-informatique-pour-la-complexite-et-les-systemes/) — Research institute, Gif-sur-Yvette, France · 3 works · 262 citations - [IRT Saint Exupéry](https://md.research.elamur.ai/free/en/labs/irt-saint-exupery/) — Research institute, Toulouse, France · 2 works · 34 citations 📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works 🧭 Topics (1): [🔬 Interpretability](https://md.research.elamur.ai/free/en/topics/interpretability/) · 130 works ## Cite Cite as: Antonin Poché, Thomas Mullor, Gabriele Sarti, Frédéric Boisnard, Corentin Friedrich, Charlotte Claye, Francois Hoofd, Raphael Bernas, Nicholas Asher, Celine Hudelot and Fanny Jourdan. 2026. Interpreto: An Explainability Library for Transformers. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{poche2026interpreto, title = {{Interpreto: An Explainability Library for Transformers}}, author = {Antonin Poché, Thomas Mullor, Gabriele Sarti, Frédéric Boisnard, Corentin Friedrich, Charlotte Claye, Francois Hoofd, Raphael Bernas, Nicholas Asher, Celine Hudelot and Fanny Jourdan}, booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)}, year = {2026}, doi = {10.18653/v1/2026.acl-demo.1}, url = {https://doi.org/10.18653/v1/2026.acl-demo.1} } ``` - [← previous Interpretable Semantic Gradients in SSD: A PCA Sweep Approach and a Case Study on AI Discourse](https://md.research.elamur.ai/free/en/papers/plisiecki-2026-interpretable-semantic-gradients-ssd-pca/) - [next → IntrAgent: An LLM Agent for Content-Grounded Information Retrieval through Literature Review](https://md.research.elamur.ai/free/en/papers/ma-2026-intragent-llm-agent-content-grounded/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/33/) ## References 3 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Guillaume Alain and Yoshua Bengio. 2016. Understanding intermediate layers using linear classifier probes. In Proceedings of the International Conference on Learning Representations (ICLR). [find](https://scholar.google.com/scholar?q=Guillaume+Alain+and+Yoshua+Bengio%2E+2016%2E+Understanding+intermediate+layers+using+linear+classifier+probes%2E+In+Proceedings+of+the+International+Conference+on+Learning+Representations+%28ICLR%29%2E) 2. Outlook (later). We plan to extend library coverage to ViT (Vision Transformer) to later aim for multi-modal transformer support. Out of scope. We do not plan to include circuit-level MI methods, data attribution, or feature visualization; the library will remain centered on HuggingFace model workfl… — [The Falcon Series of Open Language Models](https://md.research.elamur.ai/free/en/papers/almazrouei-2023-falcon-series-open-language-models/) 3. Ethical statement Giuseppe Attanasio, Eliana Pastor, Chiara Di Bonaventura, and Debora Nozza. 2023. ferret: a framework for benchmarking explainers on transformers. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL). [find](https://scholar.google.com/scholar?q=Ethical+statement+Giuseppe+Attanasio%2C+Eliana+Pastor%2C+Chiara+Di+Bonaventura%2C+and+Debora+Nozza%2E+2023%2E+ferret%3A+a+framework+for+benchmarking+explainers+on+transformers%2E+In+Proceedings+of+the+Annual+Meetin) *Updated 1 November 2026*