Prof. Dr. Roland Herzog

Group Leader

I joined Heidelberg University in April 2021 and established the group Scientific Computing and Optimization (SCOOP) at the Interdisciplinary Center for Scientific Computing (IWR).

You can find my CV here.

Research interests

My research interests include

  • optimal control of partial differential equations
  • large-scale optimization and its applications
  • numerical linear algebra
  • optimal experimental design
  • optimization on manifolds
  • numerical methods for partial differential equations

Recent teaching

Recent events organized

Currently supervising

  • M.Sc. Thesis of Johannes Manstein:
    The Simplex Method on Manifolds
    M.Sc. Mathematik, Heidelberg University
    Supervision: Roland Herzog, Peter Albers and Georg Müller
  • M.Sc. Thesis of Changjing Hu:
    Enhancing Acoustic Classification in Ecological Monitoring: Using Self-Supervised Learning for Limited Mammal Sound Datasets
    M.Sc. Scientific Computing, Heidelberg University
    Supervision: Peter Fransson, Joacim Rocklöv and Roland Herzog
  • M.Sc. Thesis of Laurin Ernst:
    Invertible Neural Networks for Parameter Identification in Differential Equations
    M.Sc. Mathematik, Heidelberg University
    Supervision: Roland Herzog and Evelyn Herberg
  • M.Sc. Thesis of Mario Maric:
    Preconditioned Solution in Nonlocal Optimal Control
    M.Sc. Scientific Computing, Heidelberg University
    Supervision: Roland Herzog and Georg Müller
  • M.Sc. Thesis of Nico Haaf:
    Optimal Control with Functions of Bounded Variation in Mixed Formulation
    M.Sc. Mathematik, Heidelberg University
    Supervision: Roland Herzog, Michael Hinze and Evelyn Herberg
  • B.Sc. Thesis of Lukas Moritz:
    Parsen von Abhängigkeiten und Referenzbeziehungen in verteilten LaTeX-Dokumenten
    50% B.Sc. Informatik, Heidelberg University
    Supervision: Roland Herzog and Georg Müller
  • B.Sc. Thesis of Christian Reibold:
    The Courant-Fisher Theorem from an Optimization Perspective
    B.Sc. Mathematik, Heidelberg University
    Supervision: Roland Herzog and Georg Müller
  • B.Sc. Thesis of Jan Müller:
    A Regularized Newton Method
    B.Sc. Informatik, Heidelberg University
    Supervision: Roland Herzog and Georg Müller
  • B.Sc. Thesis of Martin Koloseus:
    Single Line Image Approximation using Optimization Techniques
    B.Sc. Mathematik, Heidelberg University
    Supervision: Roland Herzog and Georg Müller

Latest publications

  • Viktor Martinek, Julia Reuter, Ophelia Frotscher, Sanaz Mostaghim, Markus Richter and Roland Herzog
    Shape constraints in symbolic regression using penalized least squares, 2024
    arXiv:2405.20800
    bibtex 
    @ONLINE{MartinekReuterFrotscherMostaghimRichterHerzog:2024:1,
  AUTHOR = {Martinek, Viktor and Reuter, Julia and Frotscher, Ophelia and Mostaghim, Sanaz and Richter, Markus and Herzog, Roland},
  DATE = {2024-05},
  EPRINT = {2405.20800},
  EPRINTTYPE = {arXiv},
  TITLE = {Shape constraints in symbolic regression using penalized least squares},
}
  • Julia Reuter, Viktor Martinek, Roland Herzog and Sanaz Mostaghim
    Unit-aware genetic programming for the development of empirical equations, 2024
    arXiv:2405.18896
    bibtex 
    @ONLINE{ReuterMartinekHerzogMostaghim:2024:1,
  AUTHOR = {Reuter, Julia and Martinek, Viktor and Herzog, Roland and Mostaghim, Sanaz},
  DATE = {2024-05},
  EPRINT = {2405.18896},
  EPRINTTYPE = {arXiv},
  NOTE = {accepted at the 18th International Conference on Parallel Problem Solving From Nature (PPSN) 2024},
  TITLE = {Unit-aware genetic programming for the development of empirical equations},
}
  • Ronny Bergmann, Roland Herzog and Hajg Jasa
    The Riemannian convex bundle method, 2024
    arXiv:2402.13670
    bibtex 
    @ONLINE{BergmannHerzogJasa:2024:1,
  AUTHOR = {Bergmann, Ronny and Herzog, Roland and Jasa, Hajg},
  DATE = {2024-02},
  EPRINT = {2402.13670},
  EPRINTTYPE = {arXiv},
  TITLE = {The Riemannian convex bundle method},
}
  • Karina Koval, Roland Herzog and Robert Scheichl
    Tractable optimal experimental design using transport maps, 2024
    arXiv:2401.07971
    bibtex 
    @ONLINE{KovalHerzogScheichl:2024:1,
  AUTHOR = {Koval, Karina and Herzog, Roland and Scheichl, Robert},
  DATE = {2024-01},
  EPRINT = {2401.07971},
  EPRINTTYPE = {arXiv},
  TITLE = {Tractable optimal experimental design using transport maps},
}
  • Evelyn Herberg, Roland Herzog, Frederik Köhne, Leonie Kreis and Anton Schiela
    Sensitivity-based layer insertion for residual and feedforward neural networks, 2023
    arXiv:2311.15995
    bibtex 
    @ONLINE{HerbergHerzogKoehneKreisSchiela:2023:1,
  AUTHOR = {Herberg, Evelyn and Herzog, Roland and Köhne, Frederik and Kreis, Leonie and Schiela, Anton},
  DATE = {2023-11},
  EPRINT = {2311.15995},
  EPRINTTYPE = {arXiv},
  TITLE = {Sensitivity-based layer insertion for residual and feedforward neural networks},
}
  • Roland Herzog, Frederik Köhne, Leonie Kreis and Anton Schiela
    Frobenius-type norms and inner products of matrices and linear maps with applications to neural network training, 2023
    arXiv:2311.15419
    bibtex 
    @ONLINE{HerzogKoehneKreisSchiela:2023:1,
  AUTHOR = {Herzog, Roland and Köhne, Frederik and Kreis, Leonie and Schiela, Anton},
  DATE = {2023-11},
  EPRINT = {2311.15419},
  EPRINTTYPE = {arXiv},
  TITLE = {Frobenius-type norms and inner products of matrices and linear maps with applications to neural network training},
}
  • Frederik Köhne, Leonie Kreis, Anton Schiela and Roland Herzog
    Adaptive step sizes for preconditioned stochastic gradient descent, 2023
    arXiv:2311.16956
    bibtex 
    @ONLINE{KoehneKreisSchielaHerzog:2023:1,
  AUTHOR = {Köhne, Frederik and Kreis, Leonie and Schiela, Anton and Herzog, Roland},
  DATE = {2023-11},
  EPRINT = {2311.16956},
  EPRINTTYPE = {arXiv},
  TITLE = {Adaptive step sizes for preconditioned stochastic gradient descent},
}
  • Roland Herzog, Jan-Frederik Pietschmann and Max Winkler
    Optimal control of Hughes' model for pedestrian flow via local attraction
    Applied Mathematics and Optimization 88(3), 2023
    arXiv:2011.03580 doi:10.1007/s00245-023-10064-8
    bibtex 
    @ARTICLE{HerzogPietschmannWinkler:2023:1,
  AUTHOR = {Herzog, Roland and Pietschmann, Jan-Frederik and Winkler, Max},
  DATE = {2023-10-17},
  DOI = {10.1007/s00245-023-10064-8},
  EPRINT = {2011.03580},
  EPRINTTYPE = {arXiv},
  JOURNALTITLE = {Applied Mathematics and Optimization},
  NUMBER = {3},
  TITLE = {Optimal control of Hughes' model for pedestrian flow via local attraction},
  VOLUME = {88},
}