(Created 2011-09-01.)
 MONTE CARLO AND EMPIRICAL METHODS FOR STOCHASTIC INFERENCE FMS091
Credits: 7,5. Grading scale: TH. Cycle: A (Second Cycle). Main field: Technology. Language of instruction: The course might be given in English. FMS091 overlaps following cours/es: MAS221 and MASM11. Optional for: D4, F4, F4bm, F4fm, I4, Pi4, Pi4bm, Pi4bs, Pi4mrk. Course coordinator: Anna Lindgren, Director of studies, studierektor@matstat.lu.se, Mathematical Statistics. Recommended prerequisits: Basic course in Mathematical statistics and at least one of Stationary stochastic processer or Markov processes. Some programming experience. The course might be cancelled if the number of applicants is less than 16. Assessment: Written and oral project presentation. Further information: The course is also given at the faculty of science with the code MASM11. Home page: http://www.maths.lth.se/matstat/kurser/fms091/.

Aim
The purpose of the course is to give the students tools and knowledge to handle complex statistical problems and models. The aim is that students shall gain proficiency with such modern computer intencive statistical methods as are required in order to estimate and assess uncertainties in complex models that often arise in different applications (e.g. economics, biology, climate, environmental statistics). The main aim lies in enhancing the scope of statistical problems that the student will be able to solve.

Knowledge and understanding
For a passing grade the student must

• explain and use the concept of statistical uncertainty from a frequentist perspective as well as from a Bayesian perspective,

• describe fundamental principles of random variable generation and Monte Carlo integration.

• describe fundamental principles of parametric and non-parametric resampling.

Skills and abilities
For a passing grade the student must

• given a stochastic model and problem formulation, choose relevant quantities in a way that permits approximation using Monte Carlo methods,

• given a (possibly multivariate) probability distribution, suggest and implement in a computer program, a method for generation of random variables from this distribution,

• given a large number of generated random variables from a probability distribution, approximate relevant probabilities and expectations as well as estimate the uncertainty in the approximated quantities,

• given a model description and a statistical problem, suggest a simple permutation test and implement it in a computer program,

• given a model description and a statistical problem, suggest a resampling procedure and implement it in a computer program,

• present the course of action taken and conclusions drawn in the solution of a given statistical problem.

Judgement and approach
For a passing grade the student must

• be able to identify and problemise the possibilities and limitations of statistical inference.

Contents
Simulation based methods of statistical analysis. Markov chain methods for complex problems, e.g. Gibbs sampling and the Metropolis-Hastings algorithm. Bayesian modelling and inference. The re-sampling principle, both non-parametric and parametric. The Jack-knife method of variance estimation. Methods for constructing confidence intervals using re-sampling. Re-sampling in regression. Permutations test as an alternative to both asymptotic parametric tests and to full re-sampling. Examples of more complicated situations. Effective numerical calculations in re-sampling. The EM-algorithm for estimation in partially observed models.

Literature
Sköld, M: Computer Intensive Statistical Methods, Avd. för Matematisk statistik, LU, 2006.