Syllabus academic year 2011/2012
(Created 2011-09-01.)
OPTIMIZATIONFMA051
Credits: 6. Grading scale: TH. Cycle: A (Second Cycle). Main field: Technology. Language of instruction: The course will be given in English on demand. Alternative for: I3. Optional for: D4, E4, E4pe, E4ra, F4, F4bm, F4bs, F4fm, Pi3, Pi3bm, Pi3bs, Pi3fm, Pi3mrk, Pi3pv, Pi3ssr. Course coordinator: Director of Studies Anders Holst, Anders.Holst@math.lth.se, Mathematics. Recommended prerequisits: Basic university studies in calculus and linear algebra, including basic theory of quadratic forms. Assessment: Written test comprising theory and problems. Two computer exercises and one project. Home page: http://www.maths.lth.se/matematiklth/vitahyllan/kursprogram/opt/.

Aim
The aim of the course is to present basic optimization theory, and to give an overview of the most important methods and their practical use.

Knowledge and understanding
For a passing grade the student must

be familiar with and, in his/her own words, be able to describe the optimization algorithms, for problems with and without constraints, encountered in the course, and their properties.

be familiar with the theory of convex sets and convex functions, and be able to state and derive the most important theorems on convexity.

be aware of how to make use of convexity in the treatment of an optimization problem.

be familiar with Kuhn-Tucker Theory and be able to state and derive the most important theorems therein.

Skills and abilities
For a passing grade the student must

be able to demonstrate an ability to solve optimization problems within the framework of the course.

be able to demonstrate an ability to handle optimization problems using a computer.

be able to demonstrate an ability to, in the context of problem solving, develop the theory somewhat further.

with proper terminology, well structured and with clear logic, be able to describe the connections between different concepts in the course.

with proper terminology, suitable notation, in a well structured way and with clear logic be able to describe the solution to a mathematical problem and the theory within the framework of the course.

Contents
Quadratic forms and matrix factorisation. Convexity. The theory of optimization with and without constraints: Lagrange functions, Kuhn-Tucker theory. Duality. Methods for optimization without constraints: line search, steepest descent, Newton methods, conjugate directions, non-linear least squares optimization. Methods for optimization with constraints: linear optimization, the simplex method, quadratic programming, penalty and barrier methods.

Literature
Böiers, L-C: Lectures on Optimization. Studentlitteratur 2010.
Department of Mathematics: Computer Laboratory Exercises in Optimization.