Prof. Dr.-Ing. Margret Keuper

Machine Learning

Email: keuper (at) uni-mannheim.de

Room: B6, 26 B1.18

I joined the Data and Web Science Group in October 2023 as a Professor for Machine Learning. My research interests are Computer Vision and Machine Learning. More specifically, I am interested in problems such as

  • Robustness and Reliability of Deep Learning Models
  • Neural Architecture Search
  • Grouping Problems (in applications such as Image and Motion Segmentation and Multiple Object Tracking)
  • Efficient Solvers for Large Grouping Problems
  • Motion Estimation
  • Image Generation and Deep Fake Detection

Before joining the University of Mannheim in 2023, I  was a Professor for Visual Computing at the University of Siegen (2021–2023) and  a Juniorprofessor for Image Processing (2017–2021) here in Mannheim.  During my PhD with Thomas Brox at the University of Freiburg, I focused on the segmentation in volumetric bio-medical image data.

Ongoing Research Projects

Learning to Sense 

Climate Visions – Automated Image Analysis for Reactions and Emotions in Images on Climate Change posted on Social Media 

Previous Projects:

DeToL – Deep Topology Learning - funded by the BMBF (Federal Ministry of Education and Research)

Video Segmentation from Multiple Representations using Lifted Multicuts - DFG Project KE 2264/1–1

Phd Students

At the University of Mannheim

External PhD Students

Alumni

Publications

News:

S. Agnihotri, S. Jung, M. Keuper: CosPGD: an efficient white-box adversarial attack for pixel-wise prediction tasks (https://openreview.net/forum?id=CXZqGJonmt), accepted at ICML 2024.

Y. Zhou, M. Fritz, M. Keuper: MultiMax: Sparse and Multi-Modal Attention Learning (https://openreview.net/forum?id=IC9UZ8lm25), accepted at ICML 2024.

J. P. Schneider, M. Fatima, J. Lukasik, A. Kolb, M. Keuper, M. Moeller: Implicit Representations for Constrained Image Segmentation (https://openreview.net/forum?id=IaV6AgrTUp), accepted at ICML 2024.

Y. Li, M. Keuper, D. Zhang, A. Khoreva: Adversarial Supervision Makes Layout-to-Image Diffusion Models Thrive (https://arxiv.org/abs/2401.08815),  ICLR 2024.

J. Lukasik, P. Gavrikov, J. Keuper, M. Keuper: Improving Native CNN Robustness with Filter Frequency Regularization, TMLR 2023.

Y. Li, M. Keuper, D. Zhang, A. Khoreva, Divide & Bind Your Attention for Improved Generative Semantic Nursing(link is external)", BMVC 2023 (oral).

T. Medi, J. Tayyub, M. Sarmad, F. Lindseth, M. Keuper, FullFormer: Generating Shapes inside Shapes, GCPR 2023. 

K. Prasse, S. Jung, Y. Zhou, M. Keuper, Local Spherical Harmonics Improve Skeleton-based Hand Action Recognition, GCPR 2023.

J. Lukasik, J. Geiping, M. Möller, M. Keuper, Differentiable Architecture Search: a One-Shot Method?, AutoML Conference workshop, 2023.

P. Müller, A. Braun, M. Keuper, Classification robustness to common optical aberrations, ICCV2023 AROW Workshop.

S. Agnihotri, K.V. Gandikota, J. Grabinski, P. Chandramouli, M. Keuper, On the unreasonable vulnerability of transformers for image restoration and an easy fix”(link is external), ICCV2023 AROW Workshop

An Evaluation of Zero-Cost Proxies -- from Neural Architecture Search to Model Robustness, J. Lukasik, M. Möller, M. Keuper, accepted at GCPR, 2023. 

An extended Benchmark Study of Human-Like Behavior under Adversarial Training,  P. Gavrikov, J. Keuper, M. Keuper, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2023.

Improving Primary-Vertex Reconstruction with a Minimum Cost lifted Multicut Graph Partitioning Algorithm, V. Kostyukhin, M. Keuper, I. Ibragimov, N. Owtscharenko, M. Cristinziani, Journal of Instrumentation (JINST) , 2023.

Neural Architecture Design and Robustness: A Dataset, S. Jung, J. Lukasik, M. Keuper,  ICLR 2023.

Intra-Source Style Augmentation for Improved Domain Generalization, Y. Li, D. Zhang, M. Keuper, A. Khoreva, WACV 2023.

Trading-off Image Quality for Robustness is not necessary with Regularized Deterministic Autoencoders, A. Saseendran, K. Skubsch, S. Falkner, M. Keuper, NeurIPS 2022.              

Robust Models are Less Over-Confident, J. Grabinski, P. Gavrikov, J. Keuper, M. Keuper, NeurIPS 2022. 

Learning Where to Look -- Generative NAS is Surprisingly Efficient, J. Lukasik, S. Jung, M. Keuper, ECCV 2022.

FrequencyLowCut Pooling -- Plug & Play against Catastrophic Overfitting, J. Grabinski, S. Jung, J. Keuper, M. Keuper, ECCV 2022.

Learning to solve Minimum Cost Multicuts efficiently using Edge-Weighted Graph Convolutional Neural Networks, S. Jung, M. Keuper, ECML-PKDD 2022.

Higher-Order Multicuts for Geometric Model Fitting and Motion Segmentation, E. Levinkov*, A. Kardoost*, B. Andres and M. Keuper (*equal contribution),  in IEEE Transactions on Pattern Analysis and Machine Intelligence, doi: 10.1109/TPAMI.2022.3148795.

NAS-Bench-301 and the Case for Surrogate Benchmarks for Neural Architecture Search, J. Siems, L. Zimmer, A. Zela, J. Lukasik, M. Keuper and F. Hutter,  ICLR, 2022.

Shape your Space: A Gaussian Mixture Regularization Approach to Deterministic Autoencoders , A. Saseendran, K. Skubch, S. Falkner, M. Keuper,  NeurIPS 2021.

Spectral Distribution aware Image Generation, S. Jung, M. Keuper, AAAI 2021.

Estimating the Robustness of Classification Models by the Structure of the Learned Feature-Space, K. Ho, F.-J. Pfreundt, J Keuper, M Keuper,  https://arxiv.org/abs/2106.12303

Beyond the Spectrum: Detecting Deepfakes by Image Re-Synthesis, Y He, N Yu, M Keuper, M Fritz, accepted at IJCAI 2021

Uncertainty in Minimum Cost Multicuts for Image and Motion Segmentation, A Kardoost, M Keuper,  arXiv preprint arXiv:2105.07469, accepted at UAI 2021

Multi-Class Multi-Instance Count Conditioned Adversarial Image Generation, A Saseendran, K Skubch, M Keuper, arXiv preprint arXiv:2103.16795

SpectralDefense: Detecting Adversarial Attacks on CNNs in the Fourier Domain, P Harder, FJ Pfreundt, M Keuper, J Keuper, arXiv preprint arXiv:2103.03000, accepted at IJCNN 2021

Learning embeddings for image clustering: An empirical study of triplet loss approaches, K Ho, J Keuper, FJ Pfreundt, M Keuper, 2020 25th International Conference on Pattern Recognition (ICPR), 87–94

Object Segmentation Tracking from Generic Video Cues, A Kardoost, S Müller, J Weickert, M Keuper, 2020 25th International Conference on Pattern Recognition (ICPR), 623–630

Smooth variational graph embeddings for efficient neural architecture search, J Lukasik, D Friede, A Zela, F Hutter, M Keuper, arXiv preprint arXiv:2010.04683, accepted at IJCNN 2021

You can also find a full list of my publications on Google Scholar.

Awards and Nominations

Teaching

At the University of Mannheim, I am teaching the following courses:

Higher Level Computer Vision (CS 646)

Image Processing (CS 647)

Professional Activities

Invited Talks:

  • “Introduction to Computer Vision“ at Female's Favour{IT}e Conference 2018, Feb. 2018.
  • „Probabilistic Graphical Models for Multi-Class Segmentation in Images and Videos“, Colloquiumsvortrag, Institut für Neuroinformatik, Bochum, Sep. 2016.
  • “Segmentation of Neuronal Structures using Multi-Label Level Sets”. In the ISBI-2012 workshop/challenge on Segmentation of neuronal structures in EM stacks organized by Ignacio Arganda-Carreras, Sebastian Seung, Albert Cardona, and Johannes Schindelin, März 2012.

PC Member / Reviewer:

Conferences: ECCV (since 2014), ICCV (since 2015), CVPR (since 2016), ICPR (2016), ACCV (since 2016), BMVC (since 2017), NeurIPS (since 2018), GCPR 2018 (meta-reviewer), AAAI (SPC 2021),

Journals: IEEE Transactions for Circuits and Systems for Video Technology – TCSVT (2015), Image and Vision Computing Journal – IMAVIS (2016), IEEE Transactions on Pattern Analysis and Machine Intelligence – TPAMI (2015, 2016, 2017, 2018), IEEE Transactions on Image Processing – TIP (2017, 2018), Pattern Recognition (2017), The Visual Computer Journal (2017), Journal of Electronic Imaging (2016, 2017), Applied Computing and Informatics (2018), Entropy (2017), Computer Vision and Image Understanding (2017)

Other:

Co-organization of the LWDA 2018 conference (Lernen. Wissen. Daten. Analysen) in Mannheim.