CTU FEE Moodle
Graphical Markov Models
B232 - Summer 23/24
This course is not present in Moodle. You can visit its homepage by clicking the "Course page (outside Moodle)" button on the right (if available).
Graphical Markov Models - XEP33GMM
| Credits | 4 |
| Semesters | Winter |
| Completion | Exam |
| Language of teaching | English |
| Extent of teaching | 2P+1S |
Annotation
The course was taught in WS 2023/24 for the last time. It will not be opened anymore.
Markov models on graphs represent a model class widely applied in many areas of computer science, such as computer networks, data security, robotics and pattern recognition. The first part of the course covers inference and learning for Markov models on chains and trees. All these tasks including structure learning can be solved by efficient algorithms. The second part addresses graphical models on general graphs. Here on the contrary, practically all inference and learning tasks are NP-complete. The focus is therefore on efficient approximative algorithms.
Markov models on graphs represent a model class widely applied in many areas of computer science, such as computer networks, data security, robotics and pattern recognition. The first part of the course covers inference and learning for Markov models on chains and trees. All these tasks including structure learning can be solved by efficient algorithms. The second part addresses graphical models on general graphs. Here on the contrary, practically all inference and learning tasks are NP-complete. The focus is therefore on efficient approximative algorithms.
Study targets
Course objectives:
(1) To gain in depth understanding of the chain "model-problem-algorithm" in the context of probabilistic Markov models especially for inference and learning problems.
(2) To enable students to adapt and apply the learned problem formulations and algorithms for different application context.
(3) To provide a basic ability to recognize the applicability of the learned concepts for specific applications in artificial intelligence and machine learning.
(1) To gain in depth understanding of the chain "model-problem-algorithm" in the context of probabilistic Markov models especially for inference and learning problems.
(2) To enable students to adapt and apply the learned problem formulations and algorithms for different application context.
(3) To provide a basic ability to recognize the applicability of the learned concepts for specific applications in artificial intelligence and machine learning.
Course outlines
1. Markov chains, equivalent representations, ergodicity, convergence theorem for homogeneous Markov chains
2. Hidden Markov Models on chains for speech recognition: pre-processing, dynamic time warping, HMM-s
3. Recognizing the generating model - calculating the emission probability for a measured signal sequence.
4. Recognizing the most probable sequence of hidden states and the sequence of most probable states.
5. Possible formulations for supervised and unsupervised learning tasks (parameter estimation).
6. Supervised and unsupervised learning according to the Maximum-Likelihood principle, the Expectation Maximization algorithm
7. Hidden Markov models on acyclic graphs (trees). Estimating the graph structure.
8. Hidden Markov models with continuous state spaces. Kalman filter and particle filters.
9. Markov Random Fields - Markov models on general graphs. Equivalence to Gibbs models, Examples from Computer Vision.
10. Relations to Constraint Satisfaction Problems and Energy Minimization tasks, unified formulation, semi-rings.
11. Searching the most probable state configuration: transforming the task into a MinCut-problem for the submodular case.
12. Searching the most probable state configuration: approximation algorithms for the general case.
13. The partition function and marginal probabilities: approximation algorithms for their estimation.
14. Duality between marginal probabilities and Gibbs potentials. The Expectation Maximization algorithm for parameter learning.
2. Hidden Markov Models on chains for speech recognition: pre-processing, dynamic time warping, HMM-s
3. Recognizing the generating model - calculating the emission probability for a measured signal sequence.
4. Recognizing the most probable sequence of hidden states and the sequence of most probable states.
5. Possible formulations for supervised and unsupervised learning tasks (parameter estimation).
6. Supervised and unsupervised learning according to the Maximum-Likelihood principle, the Expectation Maximization algorithm
7. Hidden Markov models on acyclic graphs (trees). Estimating the graph structure.
8. Hidden Markov models with continuous state spaces. Kalman filter and particle filters.
9. Markov Random Fields - Markov models on general graphs. Equivalence to Gibbs models, Examples from Computer Vision.
10. Relations to Constraint Satisfaction Problems and Energy Minimization tasks, unified formulation, semi-rings.
11. Searching the most probable state configuration: transforming the task into a MinCut-problem for the submodular case.
12. Searching the most probable state configuration: approximation algorithms for the general case.
13. The partition function and marginal probabilities: approximation algorithms for their estimation.
14. Duality between marginal probabilities and Gibbs potentials. The Expectation Maximization algorithm for parameter learning.
Exercises outlines
The lectures will be accompanied by seminars and labs. Advanced exercises will be discussed in seminars. The aim is to deepen the learned knowledge and to develop skills in recognizing the applicability of the learned concepts.
Literature
[1] Stan Y. Li; Markov Random Field Modeling in Image Analysis, Springer Verlag, 3. edition, 2009
[2] Michail I. Schlesinger and Vaclav Hlavac; Ten Lectures on Statistical and Structural Pattern Recognition. Kluwer Academic Press, 2002
[3] Daphne Koller, Nir Friedman, Probabilistic Graphical Models Principles and Techniques, MIT Press, 2009
[2] Michail I. Schlesinger and Vaclav Hlavac; Ten Lectures on Statistical and Structural Pattern Recognition. Kluwer Academic Press, 2002
[3] Daphne Koller, Nir Friedman, Probabilistic Graphical Models Principles and Techniques, MIT Press, 2009
Requirements
Basics of probability theory, graphs and graph algorithms.