Nonlinear Optimization


Course Information

The information on this website is preliminary and will be updated continuously.

Description

This class provides a detailed overview of algorithms for unconstrained and constrained smooth, nonlinear optimization problems in finite dimensions. It will emphasize the interplay of optimization and numerical linear algebra. Optimality conditions and associated constraint qualifications for constrained problems will be presented and discussed. Moreover, the class will give an introduction to algorithmic differentiation (AD).

Prerequisites

Skills from Analysis I and II (MA1/ MA2), Lineare Algebra I (MA4) as well as basic optimization skills are highly recommended.

Concept and Components

This class is comprised of:

  • Detailed lecture notes
  • 2x 2h lectures per week
  • Exercise sheets with corresponding answer sheets
  • Tutorials for co-working on exercise sheets
  • An exam following the end of the lecture period

More Information will be announced.

Dates and Schedule

Information on the exercise labs can be found in MÜSLI.

Please also refer to the class’ schedule.

Exercises

Exercises will be centered around one exercise sheet per week containing both theoretical/analytical questions and numerical/implementation exercises. Default programming language – in the sense that it will be used in our answer sheets and we will be providing support for it – will be Python. Feel free to work with another programming laguage that is suitable for implementing the optimization algorithms if you are self sufficient working with it.

In the exercise tutorials (see MÜSLI), you will have the oportunity to work on the exercise sheets with your peers and with support from our tutors. You can get the most out of their time if you show up having already taken a first look at the exercises and bringing your own questions and discussion topics to the meetings. Feel free to ask questions on the lecture notes or the lectures as well.

For successful participation in this semester’s exercises, you will be asked to submit your exercises weekly, see exams. To evaluate your success on the exercise sheets, please compare your work with the answer sheets we will provide and, of course, feel free to talk to your tutor in the labs.

You may work on the exercises in groups of up to five students.

Please submit your work via Moodle in the following format:

The name of every group member must be represented in the file name. The members are separated by an underscore “_”. Each member is specified in the format “firstname(s)-surname(s)”. Should you have multiple surnames or first names, simply join them without any separator. The listing of the members is followed by an underscore and a tag for the current sheet in the format exsheetnumber. The sheet number must have two digits. If the exercise only requires a PDF, then a simple file upload suffices. Should the exercise require multiple files, such as some code files, etc., bundle them into a zip archive. The name of the archive must follow the conventions specified above. Example:

firstname(s)1-lastname(s)1_firstname(s)2-lastname(s)2_ex01.zip

Mario Maric and Viktor Stein von Kamienski are group members and want to hand in a PDF and a Jupyter notebook for sheet number 4. They archive both files into a zip and call it:

Mario-Maric_Viktor-Steinvonkamienski_ex04.zip

We will use this naming scheme to identify and track the groups. The order of the members, the capitalization of the names, or how many people uploaded the file is irrelevant. Just make sure that the spelling of the members does not change between different assignments. A failure to adhere to this convention will result in a fail on the assignment.

Class Registration

To register for this class, please register for an exercise group at MÜSLI. Please also register in case you are interested in participating in this class but not in the exercises. This will allow us to get an idea of class demand.

Attention(!): Registration for the class does not automatically include registration for an examination. More information on the exams can be found in the section exams.

Exams

We will be offering exams at the end of the semester and during the following summer break.

It is important that you register in HeiCo, so that we can officially submit your exam results.

Exam Format

TBA

Exam Admission Rules

If you want to take the exam with us, we require that you are registered in Müsli and that you meet at least one of the following criteria:

  1. You have been admitted to an exam for this class in a previous semester and let us know via E-Mail when and by whom you have been admitted by 2024-06-30.
  2. You have successfully participated in this semester’s exercise program in the sense that:
    • On at least 12 out of 13 exercise sheets, you have worked on every exercise to a reasonable degree. “To a reasonable degree” means that you have at least sketched an approach of how to solve the excercise and made a connection to the material of the lecture.

Exam Dates

TBA

Exam Registration

TBA

Course Material

Lecture Notes

Exercises

Literature

This class is self contained and does not rely on outside literature. If you would like to read up additionally, we can however recommend the following literature: