Unit name | Stochastic Optimisation |
---|---|
Unit code | MATHM6005 |
Credit points | 10 |
Level of study | M/7 |
Teaching block(s) |
Teaching Block 2D (weeks 19 - 24) |
Unit director | Dr. Tadic |
Open unit status | Not open |
Pre-requisites |
MATH11300 Probability 1 and MATH 11400 Statistics 1, while MATH21400 Applied Probability 2 is desirable, but not essential. |
Co-requisites |
None |
School/department | School of Mathematics |
Faculty | Faculty of Science |
Unit aims
The underlying aim is to use a combination of models, techniques and theory from stochastic control and equilibrium selection to determine behaviour that is optimal with regard to some given reward structure.
General Description of the Unit
Stochastic optimisation covers a broad framework of problems at the interface of applied probability and optimisation. The main focus of this unit is on Markov decision processes and game theory. Markov decision processes describe a class of single decision-maker optimisation problems that arise when applied probability models (eg Markov chains) are extended to allow for action-dependent transition distributions and associated rewards. Game theory problems are more complex in that they involve two or more decision makers (players), so the optimal action for each player will depend on the actions of other players. Here, we focus on Nash equilibria - strategies that are conditionally optimal in the sense that a player can not do do better by changing their own strategy while other players stay with their current strategy
Each module covers an area of statistics and applied probability relevant to the research and other interests of members of academic staff. Details are given in the Syllabus section below.
Relation to Other Units
This unit is a first course on stochastic optimisation.
Additional unit information can be found at http://www.maths.bristol.ac.uk/study/undergrad/current_units/index.html
Learning Objectives
Students who successfully complete this unit should be able to:
Transferable Skills
In addition to the general skills associated with other mathematical units, students will also have the opportunity to gain practice in the following: report writing, oral presentations, use of information resources, use of initiative in learning material in other than that provided by the lectures themselves, time management, general IT skills and word-processing.
Lectures, supported by problem and solution sheets.
100% Examination.
Raw scores on the examinations will be determined according to the marking scheme written on the examination paper. The marking scheme, indicating the maximum score per question, is a guide to the relative weighting of the questions. Raw scores are moderated as described in the Undergraduate Handbook.
Reading and references are available at http://www.maths.bristol.ac.uk/study/undergrad/current_units/index.html