TrackOpt


Learning to Optimize Physically Constrained Sparse-to-Dense Point Tracking

The tracking of individually occurring points or dense point clouds is highly relevant in a variety of physical and biological problems. Such problems pose a variety of challenges for machine learning methods, since learning must be possible on the basis of often relatively small amounts of annotated training data that is often subject to measurement uncertainties. The aim of this project is to create an efficient method framework that enables new tracking problems to be flexibly integrated and reliably solved. Model-driven, potentially discrete optimization problems are integrated with deep neural networks so that the strengths of both approaches can be exploited. In particular, the integration of model-driven knowledge means that the planned framework can work in a very data-efficient manner. At the same time, learned networks are optimized to predict consistent solutions despite uncertainty and measurement inaccuracy.


Plan

We create a resilient framework on the basis of three fields of application that enables current tracking problems to be flexibly integrated and reliably solved. Specifically, this involves particle physics, microfluidics and microscopy. In order to achieve high data efficiency and simultaneous resilience to measurement errors, model-driven optimization problems, which make it possible to include conditions for a valid solution in terms of the biological or physical problem, are integrated with deep neural networks.


Toolbox

We develop a reusable and transdisciplinary, modular software toolbox that also enables external parties in many research and application areas to independently solve complex tracking problems with different boundary conditions. This will be made available to the interested public as an open source application.


Researchers

University of Mannheim, Chair of Machine Learning

  • Prof. Margret Keuper
  • Steffen Jung

Heinrich Heine University Düsseldorf, Chair of Machine Learning

  • Prof. Paul Swoboda

University of Siegen, Experimental Particle and Astroparticle Physics Group

  • Prof. Markus Cristinziani

University of Siegen, Chair of Computational Sensorics

  • Prof. Ivo Ihrke

Ilmenau University of Technology, Group of Engineering Thermodynamics

  • Prof. Christian Cierpka
  • Sebastian Sachs

Funding

This project is funded by the BMBF and DLR (01IS24074A-D).