---
title: "From Isolation to Entanglement — paper by Mueller et al. (2026)"
description: "They build a synthetic English dataset with a probabilistic context-free grammar (PCFG). 73 references."
authors: ["Aaron Mueller", "Andrew Lee", "Shruti Joshi", "Ekdeep Singh Lubana", "Dhanya Sridhar", "Patrik Reizinger"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.782/"
doi: "10.18653/v1/2026.acl-long.782"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/mueller-2026-isolation-entanglement-when-do-interpretability/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/mueller-2026-isolation-entanglement-when-do-interpretability/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/30/) / From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?

# From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?

**Authors:** [Aaron Mueller](https://md.research.elamur.ai/free/en/authors/aaron-mueller/), Andrew Lee, Shruti Joshi, [Ekdeep Singh Lubana](https://md.research.elamur.ai/free/en/authors/ekdeep-singh-lubana/), Dhanya Sridhar and Patrik Reizinger · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.782/) · [PDF](https://aclanthology.org/2026.acl-long.782.pdf) · [DOI 10.18653/v1/2026.acl-long.782](https://doi.org/10.18653/v1/2026.acl-long.782) · [OpenAlex](https://openalex.org/W7166827055)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Interpretability research usually judges featurizers such as sparse autoencoders (SAEs) and probes one concept at a time, implicitly assuming that concepts are independent. The authors ask whether representations that look disentangled actually let each concept be controlled on its own. They build a synthetic English dataset with a probabilistic context-free grammar (PCFG). Every sentence carries four ground-truth labels: voice, tense, sentiment and domain. The co-occurrence of chosen concept values can be raised through upsampling. Several SAE variants and sparse linear probes are applied to frozen Pythia-70M and Gemma-2-2B activations. They are scored with correlational metrics from causal representation learning (MCC, DCI-ES) and then tested in steering experiments.

On correlational metrics the featurizers do well. Individual features mostly track a single concept, although one concept is often spread across many features. However, steering the strongest feature for one concept frequently shifts other concepts as well, even though feature pairs show almost no interaction effects. The lesson is that neither correlational scores nor non-overlapping subspaces guarantee selective control, so multi-concept, interventional evaluation is necessary.

## Key points
- **Dataset:** PCFG-generated, with 382,459 training and 1,007 test sentences.
  - Binary concepts: voice (active/passive) and tense (present/past).
  - Ordinal three-way concept: sentiment (positive/neutral/negative).
  - Unordered four-way concept: domain (news/science/fantasy/other).
  - Correlations between concept values, such as positive sentiment with science, are adjustable.
- **Featurizers compared:** ReLU SAEs (public ones from Marks et al. for Pythia), JumpReLU SAEs (Lieberum et al. for Gemma), Top-K, SpADE, and SSAEs trained on activation differences. Supervised sparse probes serve as a baseline.
- **Correlational results:** Identifiability failures arise mainly from feature splitting, where many features cover one concept, rather than from single features mixing concepts. Featurizers also improve on the model's raw neuron basis.
- **Steering results:** The authors propose metrics for steering entanglement. Selective steerability and feature disjointness (non-interacting effects) turn out to be distinct, and neither predicts the other. Non-overlapping circuits or subspaces may therefore be a weak proxy for mechanistic independence.
- **Limitations and availability:** The study covers only four categorical concepts on a narrow PCFG distribution. Data and code are on GitHub (aaronmueller/IdentifiableLanguage).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Harvard University](https://md.research.elamur.ai/free/en/universities/harvard-university/) — University, Cambridge, United States · 112 works · 42,023 citations
- [Mila - Quebec Artificial Intelligence Institute](https://md.research.elamur.ai/free/en/labs/mila-quebec-artificial-intelligence-institute/) — Research institute, Montreal, Canada · 54 works · 13,565 citations
- [University of Tübingen](https://md.research.elamur.ai/free/en/universities/university-of-tubingen/) — University, Tübingen, Germany · 75 works · 41,081 citations
- [Boston University](https://md.research.elamur.ai/free/en/universities/boston-university/) — University, Boston, United States · 26 works · 4,022 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (1): [🔬 Interpretability](https://md.research.elamur.ai/free/en/topics/interpretability/) · 130 works

## Cite

Cite as: Aaron Mueller, Andrew Lee, Shruti Joshi, Ekdeep Singh Lubana, Dhanya Sridhar and Patrik Reizinger. 2026. From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{mueller2026isolation,
  title = {{From Isolation to Entanglement: When Do Interpretability Methods Identify and Disentangle Known Concepts?}},
  author = {Aaron Mueller, Andrew Lee, Shruti Joshi, Ekdeep Singh Lubana, Dhanya Sridhar and Patrik Reizinger},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.782},
  url = {https://doi.org/10.18653/v1/2026.acl-long.782}
}
```

- [← previous From Insights to Impact: Actionable Interpretability for Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/sarti-2026-insights-impact-actionable-interpretability-neural/)
- [next → From Knowing to Teaching: Scaffolding Pedagogical Decisions for LLM Agent](https://md.research.elamur.ai/free/en/papers/wang-2026-knowing-teaching-scaffolding-pedagogical-decisions/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/30/)

## References

73 references, 6 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Kartik Ahuja, Jason S Hartford, and Yoshua Bengio. 2022. Weakly supervised representation learning with sparse perturbations. Advances in Neural Information Processing Systems, 35:15516–15528. [find](https://scholar.google.com/scholar?q=Kartik+Ahuja%2C+Jason+S+Hartford%2C+and+Yoshua+Bengio%2E+2022%2E+Weakly+supervised+representation+learning+with+sparse+perturbations%2E+Advances+in+Neural+Information+Processing+Systems%2C+35%3A15516%E2%80%9315528%2E)
2. Kartik Ahuja, Divyat Mahajan, Yixin Wang, and Yoshua Bengio. 2023a. Interventional causal representation learning. In International Conference on Machine Learning, pages 372–407. PMLR. [find](https://scholar.google.com/scholar?q=Kartik+Ahuja%2C+Divyat+Mahajan%2C+Yixin+Wang%2C+and+Yoshua+Bengio%2E+2023a%2E+Interventional+causal+representation+learning%2E+In+International+Conference+on+Machine+Learning%2C+pages+372%E2%80%93407%2E+PMLR%2E)
3. Kartik Ahuja, Amin Mansouri, and Yixin Wang. 2023b. Multi-Domain Causal Representation Learning via Weak Distributional Invariances. arXiv preprint. ArXiv:2310.02854 [cs, stat]. — [arXiv:2310.02854](https://arxiv.org/abs/2310.02854) [find](https://scholar.google.com/scholar?q=Kartik+Ahuja%2C+Amin+Mansouri%2C+and+Yixin+Wang%2E+2023b%2E+Multi%2DDomain+Causal+Representation+Learning+via+Weak+Distributional+Invariances%2E+arXiv+preprint%2E+ArXiv%3A2310%2E02854+%5Bcs%2C+stat%5D%2E+%E2%80%94+%5BarXiv%3A2310%2E02854%5D%28h)
4. Dana Arad, Aaron Mueller, and Yonatan Belinkov. 2025. [SAEs are good for steering – if you select the right features](https://md.research.elamur.ai/free/en/papers/arad-2025-saes-are-good-steering-if/). In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 10241–10259, Suzhou, China. Association for Computational Linguistics.
5. Andy Arditi, Oscar Balcells Obeso, Aaquib Syed, Daniel Paleka, Nina Rimsky, Wes Gurnee, and Neel Nanda. 2024. [Refusal in language models is mediated by a single direction](https://md.research.elamur.ai/free/en/papers/arditi-2024-refusal-language-models-mediated-single/). In The Thirty-eighth Annual Conference on Neural Information Processing Systems.
6. Stella Biderman, Hailey Schoelkopf, Quentin Anthony, Herbie Bradley, Kyle O’Brien, Eric Hallahan, Mohammad Aflah Khan, Shivanshu Purohit, USVSN Sai Prashanth, Edward Raff, Aviya Skowron, Lintang Sutawika, and Oskar Van Der Wal. 2023. Pythia: a suite for analyzing large language models across trainin… [find](https://scholar.google.com/scholar?q=Stella+Biderman%2C+Hailey+Schoelkopf%2C+Quentin+Anthony%2C+Herbie+Bradley%2C+Kyle+O%E2%80%99Brien%2C+Eric+Hallahan%2C+Mohammad+Aflah+Khan%2C+Shivanshu+Purohit%2C+USVSN+Sai+Prashanth%2C+Edward+Raff%2C+Aviya+Skowron%2C+Lintang+Sutaw)
7. Taylor L. Booth and Richarda . Thompson. 1973. Applying probability measures to abstract languages. IEEE Transactions on Computers, C-22:442–450. [find](https://scholar.google.com/scholar?q=Taylor+L%2E+Booth+and+Richarda+%2E+Thompson%2E+1973%2E+Applying+probability+measures+to+abstract+languages%2E+IEEE+Transactions+on+Computers%2C+C%2D22%3A442%E2%80%93450%2E)
8. Jack Brady, Julius von Kügelgen, Sebastien Lachapelle, Simon Buchholz, Thomas Kipf, and Wieland Brendel. 2025. Interaction asymmetry: A general principle for learning composable abstractions. In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Jack+Brady%2C+Julius+von+Ku%CC%88gelgen%2C+Sebastien+Lachapelle%2C+Simon+Buchholz%2C+Thomas+Kipf%2C+and+Wieland+Brendel%2E+2025%2E+Interaction+asymmetry%3A+A+general+principle+for+learning+composable+abstractions%2E+In+The+)
9. Johann Brehmer, Pim de Haan, Phillip Lippe, and Taco Cohen. 2022. Weakly supervised causal representation learning. arXiv preprint. ArXiv:2203.16437 [cs, stat]. — [arXiv:2203.16437](https://arxiv.org/abs/2203.16437) [find](https://scholar.google.com/scholar?q=Johann+Brehmer%2C+Pim+de+Haan%2C+Phillip+Lippe%2C+and+Taco+Cohen%2E+2022%2E+Weakly+supervised+causal+representation+learning%2E+arXiv+preprint%2E+ArXiv%3A2203%2E16437+%5Bcs%2C+stat%5D%2E+%E2%80%94+%5BarXiv%3A2203%2E16437%5D%28https%3A%2F%2Farxiv%2Eorg%2F)
10. Trenton Bricken, Adly Templeton, Joshua Batson, Brian Chen, Adam Jermyn, Tom Conerly, Nick Turner, Cem Anil, Carson Denison, Amanda Askell, Robert Lasenby, Yifan Wu, Shauna Kravec, Nicholas Schiefer, Tim Maxwell, Nicholas Joseph, Zac Hatfield-Dodds, Alex Tamkin, Karina Nguyen, and 6 others. 2023. To… [find](https://scholar.google.com/scholar?q=Trenton+Bricken%2C+Adly+Templeton%2C+Joshua+Batson%2C+Brian+Chen%2C+Adam+Jermyn%2C+Tom+Conerly%2C+Nick+Turner%2C+Cem+Anil%2C+Carson+Denison%2C+Amanda+Askell%2C+Robert+Lasenby%2C+Yifan+Wu%2C+Shauna+Kravec%2C+Nicholas+Schiefer%2C+)
11. Simon Buchholz, Goutham Rajendran, Elan Rosenfeld, Bryon Aragam, Bernhard Schölkopf, and Pradeep Ravikumar. 2023. Learning linear causal representations from interventions under general nonlinear mixing. In Advances in Neural Information Processing Systems 36 (NeurIPS 2023). [find](https://scholar.google.com/scholar?q=Simon+Buchholz%2C+Goutham+Rajendran%2C+Elan+Rosenfeld%2C+Bryon+Aragam%2C+Bernhard+Scho%CC%88lkopf%2C+and+Pradeep+Ravikumar%2E+2023%2E+Learning+linear+causal+representations+from+interventions+under+general+nonlinear+mix)
12. Valérie Costa, Thomas Fel, Ekdeep Singh Lubana, Bahareh Tolooshams, and Demba E. Ba. 2025. From flat to hierarchical: Extracting sparse representations with matching pursuit. In The Thirty-ninth Annual Conference on Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Vale%CC%81rie+Costa%2C+Thomas+Fel%2C+Ekdeep+Singh+Lubana%2C+Bahareh+Tolooshams%2C+and+Demba+E%2E+Ba%2E+2025%2E+From+flat+to+hierarchical%3A+Extracting+sparse+representations+with+matching+pursuit%2E+In+The+Thirty%2Dninth+Annu)
13. George Darmois. 1951. Analyse des liaisons de prob-abilité. In Proc. [find](https://scholar.google.com/scholar?q=George+Darmois%2E+1951%2E+Analyse+des+liaisons+de+prob%2Dabilite%CC%81%2E+In+Proc%2E)
14. Int. Stat. Conferences 1947, page 231. [find](https://scholar.google.com/scholar?q=Int%2E+Stat%2E+Conferences+1947%2C+page+231%2E)
15. Cian Eastwood, Armin Kekic, and Andrei Liviu Nicolicioiu. 2022. On the DCI Framework for Evaluating Disentangled Representations: Extensions and Connections to Identifiability. page 8. [find](https://scholar.google.com/scholar?q=Cian+Eastwood%2C+Armin+Kekic%2C+and+Andrei+Liviu+Nicolicioiu%2E+2022%2E+On+the+DCI+Framework+for+Evaluating+Disentangled+Representations%3A+Extensions+and+Connections+to+Identifiability%2E+page+8%2E)
16. Cian Eastwood, Andrei Liviu Nicolicioiu, Julius Von Kügelgen, Armin Kekić, Frederik Träuble, Andrea Dittadi, and Bernhard Schölkopf. 2023. DCI-ES: An extended disentanglement framework with connections to identifiability. In The Eleventh International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Cian+Eastwood%2C+Andrei+Liviu+Nicolicioiu%2C+Julius+Von+Ku%CC%88gelgen%2C+Armin+Kekic%CC%81%2C+Frederik+Tra%CC%88uble%2C+Andrea+Dittadi%2C+and+Bernhard+Scho%CC%88lkopf%2E+2023%2E+DCI%2DES%3A+An+extended+disentanglement+framework+with+connec)
17. Cian Eastwood and Christopher K. I. Williams. 2018. A framework for the quantitative evaluation of disentangled representations. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Cian+Eastwood+and+Christopher+K%2E+I%2E+Williams%2E+2018%2E+A+framework+for+the+quantitative+evaluation+of+disentangled+representations%2E+In+International+Conference+on+Learning+Representations%2E)
18. Joshua Engels, Eric J Michaud, Isaac Liao, Wes Gurnee, and Max Tegmark. 2025. Not all language model features are one-dimensionally linear. In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Joshua+Engels%2C+Eric+J+Michaud%2C+Isaac+Liao%2C+Wes+Gurnee%2C+and+Max+Tegmark%2E+2025%2E+Not+all+language+model+features+are+one%2Ddimensionally+linear%2E+In+The+Thirteenth+International+Conference+on+Learning+Repre)
19. Jose Gallego-Posada and Juan Ramirez. 2022. Cooper: a toolkit for Lagrangian-based constrained optimization. [https://github.com/cooper-org/cooper](https://github.com/cooper-org/cooper). [↗](https://github.com/cooper-org/cooper)
20. Leo Gao, Tom Dupre la Tour, Henk Tillman, Gabriel Goh, Rajan Troll, Alec Radford, Ilya Sutskever, Jan Leike, and Jeffrey Wu. 2025. Scaling and evaluating sparse autoencoders. In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Leo+Gao%2C+Tom+Dupre+la+Tour%2C+Henk+Tillman%2C+Gabriel+Goh%2C+Rajan+Troll%2C+Alec+Radford%2C+Ilya+Sutskever%2C+Jan+Leike%2C+and+Jeffrey+Wu%2E+2025%2E+Scaling+and+evaluating+sparse+autoencoders%2E+In+The+Thirteenth+Interna)
21. Atticus Geiger, Duligur Ibeling, Amir Zur, Maheep Chaudhary, Sonakshi Chauhan, Jing Huang, Aryaman Arora, Zhengxuan Wu, Noah Goodman, Christopher Potts, and Thomas Icard. 2025. Causal abstraction: A theoretical foundation for mechanistic interpretability. Journal of Machine Learning Research, 26(83)… [find](https://scholar.google.com/scholar?q=Atticus+Geiger%2C+Duligur+Ibeling%2C+Amir+Zur%2C+Maheep+Chaudhary%2C+Sonakshi+Chauhan%2C+Jing+Huang%2C+Aryaman+Arora%2C+Zhengxuan+Wu%2C+Noah+Goodman%2C+Christopher+Potts%2C+and+Thomas+Icard%2E+2025%2E+Causal+abstraction%3A+A+t)
22. Gauthier Gidel, Hugo Berard, Gaëtan Vignoud, Pascal Vincent, and Simon Lacoste-Julien. 2020. A variational inequality perspective on generative adversarial networks. Preprint, arXiv:1802.10551. — [arXiv:1802.10551](https://arxiv.org/abs/1802.10551) [find](https://scholar.google.com/scholar?q=Gauthier+Gidel%2C+Hugo+Berard%2C+Gae%CC%88tan+Vignoud%2C+Pascal+Vincent%2C+and+Simon+Lacoste%2DJulien%2E+2020%2E+A+variational+inequality+perspective+on+generative+adversarial+networks%2E+Preprint%2C+arXiv%3A1802%2E10551%2E+%E2%80%94+%5Bar)
23. Luigi Gresele, Paul K. Rubenstein, Arash Mehrjou, Francesco Locatello, and Bernhard Schölkopf. 2019. The Incomplete Rosetta Stone Problem: Identifiability Results for Multi-View Nonlinear ICA. arXiv:1905.06642 [cs, stat]. ArXiv: 1905.06642. — [arXiv:1905.06642](https://arxiv.org/abs/1905.06642) [find](https://scholar.google.com/scholar?q=Luigi+Gresele%2C+Paul+K%2E+Rubenstein%2C+Arash+Mehrjou%2C+Francesco+Locatello%2C+and+Bernhard+Scho%CC%88lkopf%2E+2019%2E+The+Incomplete+Rosetta+Stone+Problem%3A+Identifiability+Results+for+Multi%2DView+Nonlinear+ICA%2E+arXiv%3A)
24. Luigi Gresele, Julius von Kügelgen, Vincent Stimper, Bernhard Schölkopf, and Michel Besserve. 2021. Independent mechanism analysis, a new concept? arXiv:2106.05200 [cs, stat]. ArXiv: 2106.05200. — [arXiv:2106.05200](https://arxiv.org/abs/2106.05200) [find](https://scholar.google.com/scholar?q=Luigi+Gresele%2C+Julius+von+Ku%CC%88gelgen%2C+Vincent+Stimper%2C+Bernhard+Scho%CC%88lkopf%2C+and+Michel+Besserve%2E+2021%2E+Independent+mechanism+analysis%2C+a+new+concept%3F+arXiv%3A2106%2E05200+%5Bcs%2C+stat%5D%2E+ArXiv%3A+2106%2E05200%2E+%E2%80%94+%5B)
25. Wes Gurnee, Neel Nanda, Matthew Pauly, Katherine Harvey, Dmitrii Troitskii, and Dimitris Bertsimas. 2023. Finding neurons in a haystack: Case studies with sparse probing. Transactions on Machine Learning Research. [find](https://scholar.google.com/scholar?q=Wes+Gurnee%2C+Neel+Nanda%2C+Matthew+Pauly%2C+Katherine+Harvey%2C+Dmitrii+Troitskii%2C+and+Dimitris+Bertsimas%2E+2023%2E+Finding+neurons+in+a+haystack%3A+Case+studies+with+sparse+probing%2E+Transactions+on+Machine+Learn)
26. Irina Higgins, David Amos, David Pfau, Sebastien Racaniere, Loic Matthey, Danilo Rezende, and Alexander Lerchner. 2018. Towards a Definition of Disentangled Representations. arXiv:1812.02230 [cs, stat]. ArXiv: 1812.02230. — [arXiv:1812.02230](https://arxiv.org/abs/1812.02230) [find](https://scholar.google.com/scholar?q=Irina+Higgins%2C+David+Amos%2C+David+Pfau%2C+Sebastien+Racaniere%2C+Loic+Matthey%2C+Danilo+Rezende%2C+and+Alexander+Lerchner%2E+2018%2E+Towards+a+Definition+of+Disentangled+Representations%2E+arXiv%3A1812%2E02230+%5Bcs%2C+stat)
27. Sai Sumedh R. Hindupur, Ekdeep Singh Lubana, Thomas Fel, and Demba Ba. 2025. Projecting assumptions: The duality between sparse autoencoders and concept geometry. Preprint, arXiv:2503.01822. — [arXiv:2503.01822](https://arxiv.org/abs/2503.01822) [find](https://scholar.google.com/scholar?q=Sai+Sumedh+R%2E+Hindupur%2C+Ekdeep+Singh+Lubana%2C+Thomas+Fel%2C+and+Demba+Ba%2E+2025%2E+Projecting+assumptions%3A+The+duality+between+sparse+autoencoders+and+concept+geometry%2E+Preprint%2C+arXiv%3A2503%2E01822%2E+%E2%80%94+%5BarXiv%3A)
28. Kyle Hsu, Will Dorrell, James C. R. Whittington, Jiajun Wu, and Chelsea Finn. 2023. Disentanglement via Latent Quantization. arXiv preprint. ArXiv:2305.18378 [cs, stat]. — [arXiv:2305.18378](https://arxiv.org/abs/2305.18378) [find](https://scholar.google.com/scholar?q=Kyle+Hsu%2C+Will+Dorrell%2C+James+C%2E+R%2E+Whittington%2C+Jiajun+Wu%2C+and+Chelsea+Finn%2E+2023%2E+Disentanglement+via+Latent+Quantization%2E+arXiv+preprint%2E+ArXiv%3A2305%2E18378+%5Bcs%2C+stat%5D%2E+%E2%80%94+%5BarXiv%3A2305%2E18378%5D%28https%3A%2F%2Fa)
29. Jing Huang, Zhengxuan Wu, Christopher Potts, Mor Geva, and Atticus Geiger. 2024. RAVEL: Evaluating interpretability methods on disentangling language model representations. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 8669–… [find](https://scholar.google.com/scholar?q=Jing+Huang%2C+Zhengxuan+Wu%2C+Christopher+Potts%2C+Mor+Geva%2C+and+Atticus+Geiger%2E+2024%2E+RAVEL%3A+Evaluating+interpretability+methods+on+disentangling+language+model+representations%2E+In+Proceedings+of+the+62nd+)
30. Robert Huben, Hoagy Cunningham, Logan Riggs Smith, Aidan Ewart, and Lee Sharkey. 2024. Sparse autoencoders find highly interpretable features in language models. In The Twelfth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Robert+Huben%2C+Hoagy+Cunningham%2C+Logan+Riggs+Smith%2C+Aidan+Ewart%2C+and+Lee+Sharkey%2E+2024%2E+Sparse+autoencoders+find+highly+interpretable+features+in+language+models%2E+In+The+Twelfth+International+Conferenc)
31. Aapo Hyvarinen and Hiroshi Morioka. 2016. Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICA. arXiv:1605.06336 [cs, stat]. ArXiv: 1605.06336. — [arXiv:1605.06336](https://arxiv.org/abs/1605.06336) [find](https://scholar.google.com/scholar?q=Aapo+Hyvarinen+and+Hiroshi+Morioka%2E+2016%2E+Unsupervised+Feature+Extraction+by+Time%2DContrastive+Learning+and+Nonlinear+ICA%2E+arXiv%3A1605%2E06336+%5Bcs%2C+stat%5D%2E+ArXiv%3A+1605%2E06336%2E+%E2%80%94+%5BarXiv%3A1605%2E06336%5D%28https%3A%2F%2Fa)
32. Aapo Hyvarinen and Hiroshi Morioka. 2017. Nonlinear ICA of Temporally Dependent Stationary Sources. In Artificial Intelligence and Statistics, pages 460–469. PMLR. ISSN: 2640-3498. [find](https://scholar.google.com/scholar?q=Aapo+Hyvarinen+and+Hiroshi+Morioka%2E+2017%2E+Nonlinear+ICA+of+Temporally+Dependent+Stationary+Sources%2E+In+Artificial+Intelligence+and+Statistics%2C+pages+460%E2%80%93469%2E+PMLR%2E+ISSN%3A+2640%2D3498%2E)
33. Aapo Hyvarinen, Hiroaki Sasaki, and Richard E. Turner. 2019. Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learning. arXiv:1805.08651 [cs, stat]. ArXiv: 1805.08651. — [arXiv:1805.08651](https://arxiv.org/abs/1805.08651) [find](https://scholar.google.com/scholar?q=Aapo+Hyvarinen%2C+Hiroaki+Sasaki%2C+and+Richard+E%2E+Turner%2E+2019%2E+Nonlinear+ICA+Using+Auxiliary+Variables+and+Generalized+Contrastive+Learning%2E+arXiv%3A1805%2E08651+%5Bcs%2C+stat%5D%2E+ArXiv%3A+1805%2E08651%2E+%E2%80%94+%5BarXiv%3A1805)
34. Aapo Hyvärinen and Petteri Pajunen. 1999. Nonlinear independent component analysis: Existence and uniqueness results. Neural Networks, 12(3):429–439. [find](https://scholar.google.com/scholar?q=Aapo+Hyva%CC%88rinen+and+Petteri+Pajunen%2E+1999%2E+Nonlinear+independent+component+analysis%3A+Existence+and+uniqueness+results%2E+Neural+Networks%2C+12%283%29%3A429%E2%80%93439%2E)
35. Shruti Joshi, Andrea Dittadi, Sébastien Lachapelle, and Dhanya Sridhar. 2025. Identifiable Steering via Sparse Autoencoding of Multi-Concept Shifts. arXiv preprint. ArXiv:2502.12179 [cs]. — [arXiv:2502.12179](https://arxiv.org/abs/2502.12179) [find](https://scholar.google.com/scholar?q=Shruti+Joshi%2C+Andrea+Dittadi%2C+Se%CC%81bastien+Lachapelle%2C+and+Dhanya+Sridhar%2E+2025%2E+Identifiable+Steering+via+Sparse+Autoencoding+of+Multi%2DConcept+Shifts%2E+arXiv+preprint%2E+ArXiv%3A2502%2E12179+%5Bcs%5D%2E+%E2%80%94+%5BarXiv%3A25)
36. Shruti Joshi, Théo Saulus, Wieland Brendel, Philippe Brouillard, Dhanya Sridhar, and Patrik Reizinger. 2026. Who guards the guardians? The challenges of evaluating identifiability of learned representations. Preprint, arXiv:2602.24278. — [arXiv:2602.24278](https://arxiv.org/abs/2602.24278) [find](https://scholar.google.com/scholar?q=Shruti+Joshi%2C+The%CC%81o+Saulus%2C+Wieland+Brendel%2C+Philippe+Brouillard%2C+Dhanya+Sridhar%2C+and+Patrik+Reizinger%2E+2026%2E+Who+guards+the+guardians%3F+The+challenges+of+evaluating+identifiability+of+learned+represen)
37. Ilyes Khemakhem, Diederik Kingma, Ricardo Monti, and Aapo Hyvarinen. 2020a. Variational Autoencoders and Nonlinear ICA: A Unifying Framework. In International Conference on Artificial Intelligence and Statistics, pages 2207–2217. PMLR. ISSN: 2640-3498. [find](https://scholar.google.com/scholar?q=Ilyes+Khemakhem%2C+Diederik+Kingma%2C+Ricardo+Monti%2C+and+Aapo+Hyvarinen%2E+2020a%2E+Variational+Autoencoders+and+Nonlinear+ICA%3A+A+Unifying+Framework%2E+In+International+Conference+on+Artificial+Intelligence+and)
38. Ilyes Khemakhem, Ricardo Pio Monti, Diederik P. Kingma, and Aapo Hyvärinen. 2020b. ICE-BeeM: Identifiable Conditional Energy-Based Deep Models Based on Nonlinear ICA. arXiv:2002.11537 [cs, stat]. ArXiv: 2002.11537. — [arXiv:2002.11537](https://arxiv.org/abs/2002.11537) [find](https://scholar.google.com/scholar?q=Ilyes+Khemakhem%2C+Ricardo+Pio+Monti%2C+Diederik+P%2E+Kingma%2C+and+Aapo+Hyva%CC%88rinen%2E+2020b%2E+ICE%2DBeeM%3A+Identifiable+Conditional+Energy%2DBased+Deep+Models+Based+on+Nonlinear+ICA%2E+arXiv%3A2002%2E11537+%5Bcs%2C+stat%5D%2E+ArX)
39. Sebastien Lachapelle, Tristan Deleu, Divyat Mahajan, Ioannis Mitliagkas, Yoshua Bengio, Simon Lacoste-Julien, and Quentin Bertrand. 2023a. Synergies between Disentanglement and Sparsity: Generalization and Identifiability in Multi-Task Learning. In Proceedings of the 40th International Conference on… [find](https://scholar.google.com/scholar?q=Sebastien+Lachapelle%2C+Tristan+Deleu%2C+Divyat+Mahajan%2C+Ioannis+Mitliagkas%2C+Yoshua+Bengio%2C+Simon+Lacoste%2DJulien%2C+and+Quentin+Bertrand%2E+2023a%2E+Synergies+between+Disentanglement+and+Sparsity%3A+Generalizatio)
40. Sébastien Lachapelle, Pau Rodrı́guez López, Yash Sharma, Katie Everett, Rémi Le Priol, Alexandre Lacoste, and Simon Lacoste-Julien. 2021. Disentanglement via Mechanism Sparsity Regularization: A New Principle for Nonlinear ICA. arXiv:2107.10098 [cs, stat]. ArXiv: 2107.10098. — [arXiv:2107.10098](https://arxiv.org/abs/2107.10098) [find](https://scholar.google.com/scholar?q=Se%CC%81bastien+Lachapelle%2C+Pau+Rodr%C4%B1%CC%81guez+Lo%CC%81pez%2C+Yash+Sharma%2C+Katie+Everett%2C+Re%CC%81mi+Le+Priol%2C+Alexandre+Lacoste%2C+and+Simon+Lacoste%2DJulien%2E+2021%2E+Disentanglement+via+Mechanism+Sparsity+Regularization%3A+A+Ne)
41. Sébastien Lachapelle, Divyat Mahajan, Ioannis Mitliagkas, and Simon Lacoste-Julien. 2023b. Additive Decoders for Latent Variables Identification and Cartesian-Product Extrapolation. arXiv preprint. ArXiv:2307.02598 [cs, stat]. — [arXiv:2307.02598](https://arxiv.org/abs/2307.02598) [find](https://scholar.google.com/scholar?q=Se%CC%81bastien+Lachapelle%2C+Divyat+Mahajan%2C+Ioannis+Mitliagkas%2C+and+Simon+Lacoste%2DJulien%2E+2023b%2E+Additive+Decoders+for+Latent+Variables+Identification+and+Cartesian%2DProduct+Extrapolation%2E+arXiv+preprint%2E+A)
42. Elliot Layne, Jason Hartford, Sébastien Lachapelle, Mathieu Blanchette, and Dhanya Sridhar. 2025. Sparsity regularization via tree-structured environments for disentangled representations. Transactions on Machine Learning Research. [find](https://scholar.google.com/scholar?q=Elliot+Layne%2C+Jason+Hartford%2C+Se%CC%81bastien+Lachapelle%2C+Mathieu+Blanchette%2C+and+Dhanya+Sridhar%2E+2025%2E+Sparsity+regularization+via+tree%2Dstructured+environments+for+disentangled+representations%2E+Transactio)
43. Tom Lieberum, Senthooran Rajamanoharan, Arthur Conmy, Lewis Smith, Nicolas Sonnerat, Vikrant Varma, Janos Kramar, Anca Dragan, Rohin Shah, and Neel Nanda. 2024. Gemma scope: Open sparse autoencoders everywhere all at once on gemma 2. In Proceedings of the 7th BlackboxNLP Workshop: Analyzing and Inte… [find](https://scholar.google.com/scholar?q=Tom+Lieberum%2C+Senthooran+Rajamanoharan%2C+Arthur+Conmy%2C+Lewis+Smith%2C+Nicolas+Sonnerat%2C+Vikrant+Varma%2C+Janos+Kramar%2C+Anca+Dragan%2C+Rohin+Shah%2C+and+Neel+Nanda%2E+2024%2E+Gemma+scope%3A+Open+sparse+autoencoders+e)
44. Phillip Lippe, Sara Magliacane, Sindy Löwe, Yuki M. Asano, Taco Cohen, and Efstratios Gavves. 2022. CITRIS: Causal Identifiability from Temporal Intervened Sequences. arXiv preprint. Number: arXiv:2202.03169 arXiv:2202.03169 [cs, stat]. — [arXiv:2202.03169](https://arxiv.org/abs/2202.03169) [find](https://scholar.google.com/scholar?q=Phillip+Lippe%2C+Sara+Magliacane%2C+Sindy+Lo%CC%88we%2C+Yuki+M%2E+Asano%2C+Taco+Cohen%2C+and+Efstratios+Gavves%2E+2022%2E+CITRIS%3A+Causal+Identifiability+from+Temporal+Intervened+Sequences%2E+arXiv+preprint%2E+Number%3A+arXiv%3A22)
45. Phillip Lippe, Sara Magliacane, Sindy Löwe, Yuki M. Asano, Taco Cohen, and Efstratios Gavves. 2023. BISCUIT: Causal Representation Learning from Binary Interactions. arXiv preprint. ArXiv:2306.09643 [cs, stat]. — [arXiv:2306.09643](https://arxiv.org/abs/2306.09643) [find](https://scholar.google.com/scholar?q=Phillip+Lippe%2C+Sara+Magliacane%2C+Sindy+Lo%CC%88we%2C+Yuki+M%2E+Asano%2C+Taco+Cohen%2C+and+Efstratios+Gavves%2E+2023%2E+BISCUIT%3A+Causal+Representation+Learning+from+Binary+Interactions%2E+arXiv+preprint%2E+ArXiv%3A2306%2E09643+)
46. Francesco Locatello, Stefan Bauer, Mario Lucic, Gunnar Raetsch, Sylvain Gelly, Bernhard Schölkopf, and Olivier Bachem. 2019. Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations. In International Conference on Machine Learning, pages 4114–4124. PMLR. ISSN: 264… [find](https://scholar.google.com/scholar?q=Francesco+Locatello%2C+Stefan+Bauer%2C+Mario+Lucic%2C+Gunnar+Raetsch%2C+Sylvain+Gelly%2C+Bernhard+Scho%CC%88lkopf%2C+and+Olivier+Bachem%2E+2019%2E+Challenging+Common+Assumptions+in+the+Unsupervised+Learning+of+Disentangle)
47. Francesco Locatello, Ben Poole, Gunnar Rätsch, Bernhard Schölkopf, Olivier Bachem, and Michael Tschannen. 2020a. Weakly-Supervised Disentanglement Without Compromises. arXiv:2002.02886 [cs, stat]. ArXiv: 2002.02886. — [arXiv:2002.02886](https://arxiv.org/abs/2002.02886) [find](https://scholar.google.com/scholar?q=Francesco+Locatello%2C+Ben+Poole%2C+Gunnar+Ra%CC%88tsch%2C+Bernhard+Scho%CC%88lkopf%2C+Olivier+Bachem%2C+and+Michael+Tschannen%2E+2020a%2E+Weakly%2DSupervised+Disentanglement+Without+Compromises%2E+arXiv%3A2002%2E02886+%5Bcs%2C+stat%5D%2E+A)
48. Francesco Locatello, Michael Tschannen, Stefan Bauer, Gunnar Rätsch, Bernhard Schölkopf, and Olivier Bachem. 2020b. Disentangling Factors of Variation Using Few Labels. arXiv:1905.01258 [cs, stat]. ArXiv: 1905.01258. — [arXiv:1905.01258](https://arxiv.org/abs/1905.01258) [find](https://scholar.google.com/scholar?q=Francesco+Locatello%2C+Michael+Tschannen%2C+Stefan+Bauer%2C+Gunnar+Ra%CC%88tsch%2C+Bernhard+Scho%CC%88lkopf%2C+and+Olivier+Bachem%2E+2020b%2E+Disentangling+Factors+of+Variation+Using+Few+Labels%2E+arXiv%3A1905%2E01258+%5Bcs%2C+stat%5D%2E+)
49. Samuel Marks, Can Rager, Eric J Michaud, Yonatan Belinkov, David Bau, and Aaron Mueller. 2025. Sparse feature circuits: Discovering and editing interpretable causal graphs in language models. In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Samuel+Marks%2C+Can+Rager%2C+Eric+J+Michaud%2C+Yonatan+Belinkov%2C+David+Bau%2C+and+Aaron+Mueller%2E+2025%2E+Sparse+feature+circuits%3A+Discovering+and+editing+interpretable+causal+graphs+in+language+models%2E+In+The+T)
50. Samuel Marks and Max Tegmark. 2024. [The geometry of truth: Emergent linear structure in large language model representations of true/false datasets](https://md.research.elamur.ai/free/en/papers/marks-2023-geometry-truth-emergent-linear-structure/). In First Conference on Language Modeling.
51. Gemma E. Moran, Dhanya Sridhar, Yixin Wang, and David M. Blei. 2022. Identifiable Deep Generative Models via Sparse Decoding. Technical Report arXiv:2110.10804, arXiv. ArXiv:2110.10804 [cs, stat] type: article. [find](https://scholar.google.com/scholar?q=Gemma+E%2E+Moran%2C+Dhanya+Sridhar%2C+Yixin+Wang%2C+and+David+M%2E+Blei%2E+2022%2E+Identifiable+Deep+Generative+Models+via+Sparse+Decoding%2E+Technical+Report+arXiv%3A2110%2E10804%2C+arXiv%2E+ArXiv%3A2110%2E10804+%5Bcs%2C+stat%5D+type)
52. Aaron Mueller, Jannik Brinkmann, Millicent Li, Samuel Marks, Koyena Pal, Nikhil Prakash, Can Rager, Aruna Sankaranarayanan, Arnab Sen Sharma, Jiuding Sun, Eric Todd, David Bau, and Yonatan Belinkov. 2025a. [The quest for the right mediator: Surveying mechanistic interpretability for nlp through the l…](https://md.research.elamur.ai/free/en/papers/mueller-2026-quest-right-mediator-surveying-mechanistic/)
53. Aaron Mueller, Atticus Geiger, Sarah Wiegreffe, Dana Arad, Iván Arcuschin, Adam Belfki, Yik Siu Chan, Jaden Fried Fiotto-Kaufman, Tal Haklay, Michael Hanna, Jing Huang, Rohan Gupta, Yaniv Nikankin, Hadas Orgad, Nikhil Prakash, Anja Reusch, Aruna Sankaranarayanan, Shun Shao, Alessandro Stolfo, and 4… [find](https://scholar.google.com/scholar?q=Aaron+Mueller%2C+Atticus+Geiger%2C+Sarah+Wiegreffe%2C+Dana+Arad%2C+Iva%CC%81n+Arcuschin%2C+Adam+Belfki%2C+Yik+Siu+Chan%2C+Jaden+Fried+Fiotto%2DKaufman%2C+Tal+Haklay%2C+Michael+Hanna%2C+Jing+Huang%2C+Rohan+Gupta%2C+Yaniv+Nikankin%2C+H)
54. Bruno A. Olshausen and David J. Field. 1997. Sparse coding with an overcomplete basis set: A strategy employed by v1? Vision Research, 37(23):3311– 3325. [find](https://scholar.google.com/scholar?q=Bruno+A%2E+Olshausen+and+David+J%2E+Field%2E+1997%2E+Sparse+coding+with+an+overcomplete+basis+set%3A+A+strategy+employed+by+v1%3F+Vision+Research%2C+37%2823%29%3A3311%E2%80%93+3325%2E)
55. Judea Pearl. 2009. Causal inference in statistics: An overview. Statistics Surveys, 3(none). [find](https://scholar.google.com/scholar?q=Judea+Pearl%2E+2009%2E+Causal+inference+in+statistics%3A+An+overview%2E+Statistics+Surveys%2C+3%28none%29%2E)
56. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12:282… [find](https://scholar.google.com/scholar?q=F%2E+Pedregosa%2C+G%2E+Varoquaux%2C+A%2E+Gramfort%2C+V%2E+Michel%2C+B%2E+Thirion%2C+O%2E+Grisel%2C+M%2E+Blondel%2C+P%2E+Prettenhofer%2C+R%2E+Weiss%2C+V%2E+Dubourg%2C+J%2E+Vanderplas%2C+A%2E+Passos%2C+D%2E+Cournapeau%2C+M%2E+Brucher%2C+M%2E+Perrot%2C+and+E%2E+Duc)
57. Jonas Peters, Dominik Janzing, and Bernhard Schölkopf. 2018. Elements of causal inference: foundations and learning algorithms. Journal of Statistical Computation and Simulation, 88(16):3248–3248. [find](https://scholar.google.com/scholar?q=Jonas+Peters%2C+Dominik+Janzing%2C+and+Bernhard+Scho%CC%88lkopf%2E+2018%2E+Elements+of+causal+inference%3A+foundations+and+learning+algorithms%2E+Journal+of+Statistical+Computation+and+Simulation%2C+88%2816%29%3A3248%E2%80%933248%2E)
58. Patrik Reizinger, Luigi Gresele, Jack Brady, Julius von Kügelgen, Dominik Zietlow, Bernhard Schölkopf, Georg Martius, Wieland Brendel, and Michel Besserve. 2023a. Embrace the Gap: VAEs Perform Independent Mechanism Analysis. arXiv preprint. ArXiv:2206.02416 [cs, stat]. — [arXiv:2206.02416](https://arxiv.org/abs/2206.02416) [find](https://scholar.google.com/scholar?q=Patrik+Reizinger%2C+Luigi+Gresele%2C+Jack+Brady%2C+Julius+von+Ku%CC%88gelgen%2C+Dominik+Zietlow%2C+Bernhard+Scho%CC%88lkopf%2C+Georg+Martius%2C+Wieland+Brendel%2C+and+Michel+Besserve%2E+2023a%2E+Embrace+the+Gap%3A+VAEs+Perform+Indep)
59. Patrik Reizinger, Siyuan Guo, Ferenc Huszár, Bernhard Schölkopf, and Wieland Brendel. 2024. Identifiable Exchangeable Mechanisms for Causal Structure and Representation Learning. [find](https://scholar.google.com/scholar?q=Patrik+Reizinger%2C+Siyuan+Guo%2C+Ferenc+Husza%CC%81r%2C+Bernhard+Scho%CC%88lkopf%2C+and+Wieland+Brendel%2E+2024%2E+Identifiable+Exchangeable+Mechanisms+for+Causal+Structure+and+Representation+Learning%2E)
60. Patrik Reizinger, Yash Sharma, Matthias Bethge, Bernhard Schölkopf, Ferenc Huszár, and Wieland Brendel. 2023b. Jacobian-based Causal Discovery with Nonlinear ICA. Transactions on Machine Learning Research. [find](https://scholar.google.com/scholar?q=Patrik+Reizinger%2C+Yash+Sharma%2C+Matthias+Bethge%2C+Bernhard+Scho%CC%88lkopf%2C+Ferenc+Husza%CC%81r%2C+and+Wieland+Brendel%2E+2023b%2E+Jacobian%2Dbased+Causal+Discovery+with+Nonlinear+ICA%2E+Transactions+on+Machine+Learning+Re)
61. Bernhard Schölkopf, Francesco Locatello, Stefan Bauer, Nan Rosemary Ke, Nal Kalchbrenner, Anirudh Goyal, and Yoshua Bengio. 2021. Towards Causal Representation Learning. arXiv:2102.11107 [cs]. ArXiv: 2102.11107 version: 1. [find](https://scholar.google.com/scholar?q=Bernhard+Scho%CC%88lkopf%2C+Francesco+Locatello%2C+Stefan+Bauer%2C+Nan+Rosemary+Ke%2C+Nal+Kalchbrenner%2C+Anirudh+Goyal%2C+and+Yoshua+Bengio%2E+2021%2E+Towards+Causal+Representation+Learning%2E+arXiv%3A2102%2E11107+%5Bcs%5D%2E+ArXiv%3A)
62. Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2014. [Deep inside convolutional networks: Visualising image classification models and saliency maps](https://md.research.elamur.ai/free/en/papers/simonyan-2013-deep-inside-convolutional-networks-visualising/). Preprint, arXiv:1312.6034.
63. Nishant Subramani, Nivedita Suresh, and Matthew Peters. 2022. [Extracting latent steering vectors from pretrained language models](https://md.research.elamur.ai/free/en/papers/subramani-2022-extracting-latent-steering-vectors-pretrained/). In Findings of the Association for Computational Linguistics: ACL 2022, pages 566–581, Dublin, Ireland. Association for Computational Linguistics.
64. Raphael Suter, Djordje Miladinovic, Bernhard Schölkopf, and Stefan Bauer. 2019. Robustly disentangled causal mechanisms: Validating deep representations for interventional robustness. In International Conference on Machine Learning, pages 6056–6065. PMLR. [find](https://scholar.google.com/scholar?q=Raphael+Suter%2C+Djordje+Miladinovic%2C+Bernhard+Scho%CC%88lkopf%2C+and+Stefan+Bauer%2E+2019%2E+Robustly+disentangled+causal+mechanisms%3A+Validating+deep+representations+for+interventional+robustness%2E+In+Internationa)
65. Gemma Team, Thomas Mesnard, Cassidy Hardin, Robert Dadashi, Surya Bhupatiraju, Shreya Pathak, Laurent Sifre, Morgane Rivière, Mihir Sanjay Kale, Juliette Love, Pouya Tafti, Léonard Hussenot, Pier Giuseppe Sessa, Aakanksha Chowdhery, Adam Roberts, Aditya Barua, Alex Botev, Alex Castro-Ros, Ambrose… [find](https://scholar.google.com/scholar?q=Gemma+Team%2C+Thomas+Mesnard%2C+Cassidy+Hardin%2C+Robert+Dadashi%2C+Surya+Bhupatiraju%2C+Shreya+Pathak%2C+Laurent+Sifre%2C+Morgane+Rivie%CC%80re%2C+Mihir+Sanjay+Kale%2C+Juliette+Love%2C+Pouya+Tafti%2C+Le%CC%81onard+Hussenot%2C+Pier+Gi)
66. Julius von Kügelgen. 2024. Identifiable Causal Representation Learning: Unsupervised, Multi-View, and Multi-Environment. [find](https://scholar.google.com/scholar?q=Julius+von+Ku%CC%88gelgen%2E+2024%2E+Identifiable+Causal+Representation+Learning%3A+Unsupervised%2C+Multi%2DView%2C+and+Multi%2DEnvironment%2E)
67. Julius von Kügelgen, Michel Besserve, Liang Wendong, Luigi Gresele, Armin Kekić, Elias Bareinboim, David M. Blei, and Bernhard Schölkopf. 2023. Nonparametric Identifiability of Causal Representations from Unknown Interventions. arXiv preprint. ArXiv:2306.00542 [cs, stat]. [find](https://scholar.google.com/scholar?q=Julius+von+Ku%CC%88gelgen%2C+Michel+Besserve%2C+Liang+Wendong%2C+Luigi+Gresele%2C+Armin+Kekic%CC%81%2C+Elias+Bareinboim%2C+David+M%2E+Blei%2C+and+Bernhard+Scho%CC%88lkopf%2E+2023%2E+Nonparametric+Identifiability+of+Causal+Representatio)
68. Julius von Kügelgen, Yash Sharma, Luigi Gresele, Wieland Brendel, Bernhard Schölkopf, Michel Besserve, and Francesco Locatello. 2021. Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style. ArXiv: 2106.04619. — [arXiv:2106.04619](https://arxiv.org/abs/2106.04619) [find](https://scholar.google.com/scholar?q=Julius+von+Ku%CC%88gelgen%2C+Yash+Sharma%2C+Luigi+Gresele%2C+Wieland+Brendel%2C+Bernhard+Scho%CC%88lkopf%2C+Michel+Besserve%2C+and+Francesco+Locatello%2E+2021%2E+Self%2DSupervised+Learning+with+Data+Augmentations+Provably+Isolat)
69. Liang Wendong, Armin Kekić, Julius von Kügelgen, Simon Buchholz, Michel Besserve, Luigi Gresele, and Bernhard Schölkopf. 2023. Causal Component Analysis. arXiv preprint. ArXiv:2305.17225 [cs, stat]. — [arXiv:2305.17225](https://arxiv.org/abs/2305.17225) [find](https://scholar.google.com/scholar?q=Liang+Wendong%2C+Armin+Kekic%CC%81%2C+Julius+von+Ku%CC%88gelgen%2C+Simon+Buchholz%2C+Michel+Besserve%2C+Luigi+Gresele%2C+and+Bernhard+Scho%CC%88lkopf%2E+2023%2E+Causal+Component+Analysis%2E+arXiv+preprint%2E+ArXiv%3A2305%2E17225+%5Bcs%2C+stat%5D)
70. Thaddäus Wiedemer, Prasanna Mayilvahanan, Matthias Bethge, and Wieland Brendel. 2023. Compositional Generalization from First Principles. arXiv preprint. ArXiv:2307.05596 [cs, stat]. — [arXiv:2307.05596](https://arxiv.org/abs/2307.05596) [find](https://scholar.google.com/scholar?q=Thadda%CC%88us+Wiedemer%2C+Prasanna+Mayilvahanan%2C+Matthias+Bethge%2C+and+Wieland+Brendel%2E+2023%2E+Compositional+Generalization+from+First+Principles%2E+arXiv+preprint%2E+ArXiv%3A2307%2E05596+%5Bcs%2C+stat%5D%2E+%E2%80%94+%5BarXiv%3A2307%2E05)
71. Zhengxuan Wu, Aryaman Arora, Atticus Geiger, Zheng Wang, Jing Huang, Dan Jurafsky, Christopher D Manning, and Christopher Potts. 2025. AxBench: Steering LLMs? even simple baselines outperform sparse autoencoders. In Forty-second International Conference on Machine Learning. [find](https://scholar.google.com/scholar?q=Zhengxuan+Wu%2C+Aryaman+Arora%2C+Atticus+Geiger%2C+Zheng+Wang%2C+Jing+Huang%2C+Dan+Jurafsky%2C+Christopher+D+Manning%2C+and+Christopher+Potts%2E+2025%2E+AxBench%3A+Steering+LLMs%3F+even+simple+baselines+outperform+sparse+a)
72. Jiaqi Zhang, Chandler Squires, Kristjan Greenewald, Akash Srivastava, Karthikeyan Shanmugam, and Caroline Uhler. 2023. Identifiability Guarantees for Causal Disentanglement from Soft Interventions. arXiv preprint. ArXiv:2307.06250 [cs, math, stat]. — [arXiv:2307.06250](https://arxiv.org/abs/2307.06250) [find](https://scholar.google.com/scholar?q=Jiaqi+Zhang%2C+Chandler+Squires%2C+Kristjan+Greenewald%2C+Akash+Srivastava%2C+Karthikeyan+Shanmugam%2C+and+Caroline+Uhler%2E+2023%2E+Identifiability+Guarantees+for+Causal+Disentanglement+from+Soft+Interventions%2E+ar)
73. Zuheng, Xu, Moksh Jain, Ali Denton, Shawn Whitfield, Aniket Didolkar, Berton Earnshaw, and Jason Hartford. 2024. Automated discovery of pairwise interactions from unstructured data. Preprint, arXiv:2409.07594. — [arXiv:2409.07594](https://arxiv.org/abs/2409.07594) [find](https://scholar.google.com/scholar?q=Zuheng%2C+Xu%2C+Moksh+Jain%2C+Ali+Denton%2C+Shawn+Whitfield%2C+Aniket+Didolkar%2C+Berton+Earnshaw%2C+and+Jason+Hartford%2E+2024%2E+Automated+discovery+of+pairwise+interactions+from+unstructured+data%2E+Preprint%2C+arXiv%3A24)

*Updated 1 November 2026*