Complexity Reduction, Explainability, and Interpretability (KEI)
-
- Young Academy
- WIN Research Projects
- Reducing complexity
- Complexity Reduction, Explainability, and Interpretability (KEI)
In Search of Explainable and Interpretable Machine Learning Through Philosophy and Physics
Machine learning (ML) algorithms are increasingly permeating our daily lives and public sphere. They make predictions, but why they arrive at certain decisions rather than others often remains difficult to understand; in a sense, they are“opaque.” In our project, we aim to understand how this opacity arises and how it might be retroactively resolved. To this end, we intend to interpret the nature of the (implicit) abstractions generated by ML itself, drawing on insights from physics and other theories of complexity. Our working hypothesis is that the complexity of ML and the difficulty of understanding certain components of the learning process together give rise to the problem of opacity. In this sense, a solution requires not simply “more understanding” or “less complexity,” but a meaningful reduction of complexity. By this we mean adequate abstractions and non-trivial simplifications that ensure a well-founded approach to understanding . In our project, we will develop tools to analyze the complexity of ML algorithms in new ways and to identify meaningful reductions from the perspective of many-body physics and philosophy .
WIN Fellows
Peer-reviewed publications
Bordt, S.;Raidl, E.; von Luxburg, U. (2025): Position: Rethinking Explainable Machine Learning as Applied Statistics, Proceedings of the 42nd International Conference on Machine Learning, PMLR 267: 81130–81142.
Peer-reviewed publications
Klopotek, M. (2026a): “Fluctuations in Dynamical Environments: Redefining Computation,” a book chapter in*Yearbook for Philosophy of Complex Systems* (2nd ed.) [Eds.: Fraisopi, F. and Saratxaga, Arantzazu].
Raidl, E. (2026): Logics and Semantics for “because,”Journal of Logic, Language, and Information, (2nd revision).
Non-peer-reviewed publications
Wetzel, S., …,Klopotek, M., et al. (2025). Interpretable Machine Learning in Physics: A Review, arXiv:2503.23616.
Stein, J. andRaidl, E. (2026): How Complexity Contributes to Learning Opacity in Machine Learning, pp. 1–32, arXiv:2606.24953
Weinmann, M. andKlopotek, M. (2026a): Interpreting the learning dynamics of autoencoders: Transient scaling and emerging concepts of the Ising model, pp. 1–59, arXiv preprintarxiv:2607.10285.
Organized Conferences
Research Frontiers Workshop on Scientific Machine Learning: Navigating the Bermuda Triangle of Knowledge Infusion, Explainability, and Scientific Discovery (A. Guthke,M. Klopotek,E. Raidl, A. Totounferoush) (October 7–10, 2025, Stuttgart). Partially funded by the HAdW project.
Organoid Intelligence Workshop (A. Wernick, M. Klopotek & D. Kronenberg-Versteeg),Stem Cells in Neuroscience Conference (February 26, 2026, Tübingen).
Presentations (including speeches and posters)
Bordt, S.*;Raidl, E.; von Luxburg, U. (2025): Position Paper: Rethinking Explainable Machine Learning as Applied Statistics (42nd International Conference on Machine Learning, ICML 2025, Vancouver, July 13–19, 2025).
Egenlauf, P*., Březinová, I., Andergassen, S., andKlopotek, M. (2026b): Neural ODEs for Reduced-Order Quantum Many-Body Dynamics: Assessing Memory Effects (32nd Meeting of the Condensed Matter Division, European Physical Society (CMD), September 20–25, 2026, Graz Center of Physics, Austria).
Egenlauf, P*., Březinová, I., Andergassen, S., andKlopotek, M. (2026b) [poster]: Neural ODEs for Reduced-Order Quantum Many-Body Dynamics: Assessing Memory Effects (Roccella Conference on Inference and AI - ROCKIN' AI, August 31–September 5, 2026, Roccella Jonica, Italy)
Egenlauf, P*., Kröninger, H., Kung, A., andKlopotek, M. (2026b): From Phase Space Fluctuations to Predictive Power: Entropy Production as a Metric for Swarm Reservoir Computing (Spring Meetings of the German Physical Society (DPG): Condensed Matter Section, March 8–14, 2026, March 9, 2026, Dresden).
Gaimann, M. U. andKlopotek, M.* (2026c): “Performing Inference with Physical Response: Reservoir Computing with Active Matter Substrates” (Spring Meetings of the German Physical Society (DPG): Condensed Matter Section, March 8–14, 2026, March 9, 2026, Dresden).
Gaimann, M. U.* andKlopotek, M. (2026d): Reservoir Computing with Active Matter Systems (APS Global Physics Summit,American Physical Society, March 18, 2026, Denver, CO, USA).
Klopotek, M. (2024): A reflection on computational modeling… (SAS24 Conference on Modeling for Policy, HLRS Stuttgart, November 2024)
Klopotek, M. (2025a): Statistical Physics and Machine Learning (lecture given to scholarship recipients of the Hans-Böckler Foundation, March 18, 2025, Stuttgart.)
Klopotek, M. (2025b): FromML interpretability to robustly optimal information processing with active-matter reservoir computers (colloquium at the Technical University of Vienna / invited by I. Brezinova and S. Andergassen, June 35, 2025, Vienna).
Klopotek, M. (2025c) [speech]: The Cloud of Unknowing: A Journey Toward AI Through Physics (commencement/keynote address atthe University of Tübingen’s Central Doctoral Graduation Ceremony, July 19, 2025, Tübingen).
Klopotek, M. (2025d): Physical Roots of Computation and Learning in Malleable Uncertainties; Do We Need a Physical Definition of Inference? (SAS25 Conference—Uncertainty, HLRS Stuttgart, July 2025)
Klopotek, M. (2025e): Complexity (Research Frontiers Workshop on Scientific Machine Learning:October6–10, 2025, Stuttgart)
Klopotek, M. (2026b): Reservoir Computing with Biological-like Matter: Basic Perspectives for Future OI [Organoid Intelligence] (Organoid Intelligence Workshop, Stem Cells in Neuroscience Conference, February 26, 2026, Tübingen).
Klopotek, M. (2026c): Basic physics insights from statistical mechanics toward future computing (Future Computing Workshop, HLRS, March 26, 2026, Stuttgart).
Klopotek, M. (2026d): Basic physics insights for embodied intelligence from models of computing in matter(Embodied Intelligence Conference, March 20, 2026, global). Proceedings online [https://www.youtube.com@EmbodiedIntelligenceConference].
Klopotek, M. (2026e): Reservoir Computing with Active Matter: A Statistical-Physical Viewpoint (International Reservoir Computing Conference, March 25–27, 2026, March 25, 2026, Berlin). Proceedings recorded.
Klopotek, M. (2026f): "Physical Reservoir Computing with Active Matter: Fundamental Insights into Learning and Inference as Non-Equilibrium Statistical Mechanics" (Academy Day ofthe Johanna Quandt Young Academy), May 8, 2026, Frankfurt.
Klopotek, M. (2026g) [speech]: Report of the Young Academy (Annual Celebration of the Heidelberg Academy of Sciences and Humanities, June 20, 2026, Heidelberg).
Klopotek, M.* & Raidl, E.* (2026): Understanding Machine Learning—A Physical Perspective (Lecture Series“We Research for You,” July 22, 2026, Heidelberg).
Raidl, E. (2025): Explainability (Research Frontiers Workshop on Scientific Machine Learning:October6–10, 2025, Stuttgart).
Raidl, E. (2025): Logics for “Because” (Workshop on “Because,” Nov. 28, 2025, Mannheim).
Raidl, E. (2026): Explainability and Complexity (Values in Machine Learning, Oct. 16–17, 2026, Konstanz).
Stein, J. (2025): Statistical Learning Theory Meets Formal Learning Theory—Ockham's Razor and the VC Dimension. (Conference of the German Society for the Philosophy of Science, Erlangen, March 24–26, 2025).
Stein, J. (2026): Counteracting Complexity-Driven Opacity in Machine Learning. (University of Groningen TF-PCCP Meeting, Groningen, April 2026).
Stein, J. (2026): Does Mechanistic Interpretability Research Provide Mechanistic Explanations? (SOPhiA 2026 - Salzburg Conference for Young Analytic Philosophy, Salzburg, September 2–4, 2026).
Stein, J.* &Raidl, E. (2025a): On the Complexity of Neural Networks. (Tübingen and Friends Workshop on the Philosophy of Machine Learning 2025, Tübingen, April 2025).
Stein, J.* & Raidl, E. (2025b): Complexity and the Opacity of Neural Network Training. (SAS25 Conference on Uncertainty, HLRS Stuttgart, July 28–30, 2025).
Weinmann, M.* andKlopotek, M. (2024): Contextual Alignment for Robust Learning in Dynamical Systems (Spring Meetings of the German Physical Society (DPG): Condensed Matter Section, March 2025, Berlin).
Weinmann, M.* andKlopotek, M. (2026a): Autoencoder Learning Dynamics on the MCMC Ising Dataset (Spring Meetings of the German Physical Society (DPG): Condensed Matter Section, March 8–14, 2026, March 9, 2026, Dresden).
Weinmann, M.* andKlopotek, M. (2026b) [poster]: Learning Dynamics of Autoencoders on Ising Model Data (Roccella Conference on Inference and AI - ROCKIN' AI, August 31–September 5, 2026, Roccella Jonica, Italy).
Weinmann, M.* andKlopotek, M. (2026c): Learning Dynamics of Autoencoders on Ising Model Data(32nd Meeting of the Condensed Matter Division, European Physical Society (CMD), September 20–25, 2026, Graz Center of Physics, Austria).
Weinmann, M.* andKlopotek, M. (2026d) [poster]: Learning Dynamics of Autoencoders on Ising Model Data (2026 Bootcamp of the IMPRS-IS, September 23–25, 2026, Sonthofen).
(* indicates the presenter of a paper with multiple authors listed)
Events or Publications in Science Communication/Knowledge Transfer
Raidl, E. (2026):Interview with André Boße for the Baden-Württemberg Foundation’s magazine “Perspektiven.” [André Boße: “Should I tell you how you’re doing?” On AI and communication. In:Perspektiven—The Magazine of the Baden-Württemberg Foundation. Issue 01/2026.]
Klopotek, M. (2026d): Prometheus: From Physical Emergence to the Diversification of Artificial Intelligence and Computing,Athene: HAdW Magazine (June 2026 issue).
Other Project-Related Publications by the Applicants
Egenlauf, P., …,Klopotek, M. (2026a) Capturing reduced-order quantum many-body dynamics out of equilibrium via neural ordinary differential equations,Machine Learning: Science and Technology 7(2), 025062.
Egenlauf, P., …,Klopotek, M. (2026b) Entropy production in active matter systems as an indicator of computing performance, to be published onarXiv.
Gaimann, M. U. andKlopotek, M. (2026a): Reservoir computing with active matter, Part I: Robustly optimal intrinsic dynamics. Under review (final round), arXiv:2505.05420 preprint (01/2026, v4).
Gaimann, M. U. andKlopotek, M. (2026b): Reservoir computing with active matter, Part II: Optimal information injection and propagation mechanisms. Under Review, arXiv:2509.01799 (3/2026, v2).
Gaimann, M. U., Romero Castillo, A., andKlopotek, M. (2026): Static-Shape Input Encodings as Baselines for Active Matter Reservoir Computing.Manuscript, to be published on arXiv.
Klopotek, M. (2026a): Relations of Adaptivity, Robustness, and Interpretability in Beta-VAEs… (working title).
Klopotek, M. (2026h): Nonequilibrium Physics of Machine Inference in Active Matter Reservoir Computers (working title) [Invited article].
Assistant Professor Eric Raidl, Ph.D.
Center of Excellence "Machine Learning: New Perspectives for Science"
AI Research Building
Maria-von-Linden-Str. 6
72076 Tübingen
Dr. Miriam Klopotek
University of Stuttgart
Stuttgart Center for Simulation Science
SimTech Cluster of Excellence
Universitätsstraße 32
70569 Stuttgart