Valid for: 2022/23
Faculty: Faculty of Engineering, LTH
Decided by: PLED I
Date of Decision: 2022-04-11
Elective for: BME4, C4, D4-ns, E4-ae, F4, F4-bg, F4-bm, I4, Pi4-ssr, MMSR2
Language of instruction: The course will be given in English
Markov chains and processes are a class of models which, apart from a rich mathematical structure, also has applications in many disciplines, such as telecommunications and production (queue and inventory theory), reliability analysis, financial mathematics (e.g., hidden Markov models), automatic control, and image processing (Markov fields).
The aim of this course is to give the student the basic concepts and methods for Poisson processes, discrete Markov chains and processes, and also the ability to apply them. The course presents examples of applications in different fields, in order to facilitate the use of the knowledge in other courses where Markov models appear.
Knowledge and understanding
For a passing grade the student must
Competences and skills
For a passing grade the student must
Judgement and approach
For a passing grade the student must
Markov chains: model graphs, Markov property, transition probabilities, persistent and transient states, positive and null persistent states, communication, existence and uniqueness of stationary distribution, and calculation thereof, absorption times.
Poisson process: Law of small numbers, counting processes, event distance, non-homogeneous processes, diluting and super positioning, processes on general spaces.
Markov processes: transition intensities, time dynamic, existence and uniqueness of stationary distribution, and calculation thereof, birth-death processes, absorption times.
Introduction to renewal theory and regenerative processes.
Grading scale: TH - (U,3,4,5) - (Fail, Three, Four, Five)
Assessment: Written exam and compulsory computer exercises.
The examiner, in consultation with Disability Support Services, may deviate from the regular form of examination in order to provide a permanently disabled student with a form of examination equivalent to that of a student without a disability.
Parts
Code: 0115. Name: Examination.
Credits: 6,5. Grading scale: TH. Assessment: Written examination.
Code: 0215. Name: Laboratory Work Part 1.
Credits: 0,5. Grading scale: UG. Assessment: The first computer exercise
Code: 0315. Name: Laboratory work Part 2.
Credits: 0,5. Grading scale: UG. Assessment: The rest of the computer exercises
Assumed prior knowledge: A basic course in mathematical statistics.
The number of participants is limited to: No
The course overlaps following course/s: FMS180, MASC03
Director of studies: Johan Lindström, studierektor@matstat.lu.se
Course homepage: http://www.ctr.maths.lu.se/course/fms180masc03/
Further information: The course is also given at the faculty of science with the code MASC03.