(Created 2010-07-25.)

OPTIMIZATION | FMA051 |

**Aim**

The aim of the course is to present basic optimization theory, and to give an overview of the most important methods and their practical use.

*Knowledge and understanding*

For a passing grade the student must

be familiar with the theory of convex sets and convex functions, and be able to state and derive the most important theorems on convexity.

be familiar with Kuhn-Tucker Theory and be able to state and derive the most important theorems therein.

*Skills and abilities*

For a passing grade the student must

be able to show capability to handle optimization problems using a computer.

be able to show capability to, in the context of problem solving, develop the theory somewhat further.

with proper terminology, well structured and with clear logic, be able to describe the connections between different concepts in the course.

with proper terminology, suitable notation, in a well structured way and with clear logic be able to describe the solution to a mathematical problem and the theory within the framework of the course.

**Contents**

Quadratic forms and matrix factorisation. Convexity. The theory of optimization with and without constraints: Lagrange functions, Kuhn-Tucker theory. Duality. Methods of optimization without constraints: line search, steepest descent, Newton methods, conjugate directions, non-linear least squares optimisation. Methods of optimization with constraints: linear optimization, the simplex method, quadratic programming, penalty and barrier methods.

**Literature**

Böiers, L-C: Lectures on Optimization. KF-Sigma 2009.

Department of Mathematics: Exercises in Optimization. KF-Sigma 2009.

Department of Mathematics: Computer Laboratory Exercises in Optimization.