Understanding How Machines Learn

Gitta Kutyniok holds the Bavarian AI Chair for Mathematical Foundations of Artificial Intelligence at LMU, one of the AI professorships funded under the State of Bavaria’s High-Tech Agenda. Her research work addresses precisely these types of questions: when systems automatically learn to make decisions based on numerous training examples, when they gain experience, systematize it, and use it to derive rules, we want to know how they arrive at these decisions. Kutyniok wants to find out what the main criteria are in these processes. Conversely, she also aims to identify the most important components that artificial neural networks and the resulting algorithms need in order to reach the “right” decisions, and what these machines need in the way of learning material. She also aims to unravel what guidelines need to be drafted and what the “ideal setup” for neural networks is, as well as how to ultimately maintain a practical understanding of what self-learning machines do—that is, how to maintain “explainable AI.”

This last issue is becoming increasingly important. After all, there are a number of potential applications of AI in highly sensitive areas, such as computer-aided diagnosis and treatment planning. “We don’t yet have a sufficient understanding,” Kutyniok says, “of how well neural networks actually work. For example, we have no error estimate for them.” It often happens in experiments that slight variations in the setup suddenly result in the system making glaring mistakes. That’s why Kutyniok formulates her research aim thus: “I want to make neural networks more secure, more robust.”

Kutyniok is also working on AI applications, primarily in medical imaging, a field in which she gained years of experience before turning to neural-network research. She discovered, for example, that by using conventional model-based techniques, such as compressed sensing, in combination with shearlets, she could develop methodologies that accelerate data acquisition in magnetic resonance tomography (MRT), “so patients don’t have to stay in the tube so long.” Shearlets are special function systems that make it possible to represent images particularly efficiently. Learning methods such as neural networks are good at detecting certain patterns in the original data. “In contrast, the inner workings of humans are almost too complex to permit precise mathematical modeling.” Kutyniok therefore pursues the strategy of combining the two approaches, physical models and AI techniques, thus, in her words, “uniting the best of both worlds.”

Kutyniok studied mathematics and computer science and obtained a degree in both disciplines. Following her Habilitation, she attended leading US universities Princeton, Stanford, and Yale on a Heisenberg Scholarship from the Deutsche Forschungsgemeinschaft, or DFG (German Research Foundation). Finally, she was awarded an Einstein Professorship for mathematics at Technische Universität Berlin. She has been in Munich since October 2020.

“I have an outstanding research environment here: Many leading scientists are based in Munich, offering many opportunities for cooperation at LMU, and even more if we also count the Technical University,” says Kutyniok. And as for the shape of her own research field, it lines up fairly precisely with the structures she encounters at LMU. “The faculty unites mathematics, computer science, and statistics. At most other universities, these disciplines are more widely scattered.”