Unit name | Information Theory 3 |
---|---|
Unit code | MATH34600 |
Credit points | 10 |
Level of study | H/6 |
Teaching block(s) |
Teaching Block 1B (weeks 7 - 12) |
Unit director | Dr. Jaggi |
Open unit status | Not open |
Pre-requisites |
Year 2 Theoretical Physics OR MATH11300 Probability 1 (or MATH10013 Probability and Statistics) OR Level 2 Physics MATH11400 Statistics 1 is helpful, but not necessary |
Co-requisites |
None |
School/department | School of Mathematics |
Faculty | Faculty of Science |
Unit Aims
To give a rigorous and modern introduction into Shannon's theory of information, with emphasis on fundamental concepts and mathematical techniques.
Unit Description
Shannon's information theory underlies many aspects of modern life, including streaming an MP3 or movie, or taking and storing digital photos. It is one of the great intellectual achievements of the 20th century, which continues to inspire communications engineering and to generate challenging mathematical problems. Recently it has extended dramatically into physics as quantum information theory. The course is about the fundamental ideas of this theory: data compression and reliable communication over noisy channels.
It is a statistical theory, so notions of probability play a great role, and in particular laws of large numbers as well as the concept of entropy are fundamental, culminating in Shannon's coding theorems. The course aims at demonstrating information theoretical modelling, and the mathematical techniques required will be rigorously developed.
Relation to Other Units
It is a natural companion to the Quantum Information course offered in Mathematics (MATHM5610), and to a certain degree to Cryptography B (COMSM0007), offered in Computer Science, and Communications (EENG 22000), in Electrical Engineering. It may also be interesting to physicists having attended Statistical Physics (PHYS30300).
This unit should enable students to:
Transferable skills:
Mathematical - Knowledge of basic information theory; probabilistic reasoning.
General skills - Modelling, problem solving and logical analysis Assimilation and use of complex and novel ideas
The unit will be taught through a combination of
80% Timed, open-book examination 20% Group projects
Raw scores on the examinations will be determined according to the marking scheme written on the examination paper. The marking scheme, indicating the maximum score per question, is a guide to the relative weighting of the questions. Raw scores are moderated as described in the Undergraduate Handbook.
If you fail this unit and are required to resit, reassessment is by a written examination in the August/September Resit and Supplementary exam period.
Recommended
Further