Parallel algorithms

B232 - Summer 23/24
This course is not present in Moodle. You can visit its homepage by clicking the "Course page (outside Moodle)" button on the right (if available).

Parallel algorithms - B4M35PAG

Credits 6
Semesters Winter
Completion Assessment + Examination
Language of teaching Czech
Extent of teaching 2P+2S
Annotation
In the introductory lectures, we will focus on general approaches to design of parallel algorithms and their properties important for understanding the fundamental principles of parallel and distributed algorithms. Subsequently we will talk about fundamental parallel algorithms; typically, constituting cornerstones of algorithms for real-world problems. The laboratory exercise will be aimed at hardware platform commonly used in practice.
Course outlines
1. Introduction to parallel computing
2. Principles of parallel and distributed algorithms design
3. Basic communication operations
4. Properties of parallel algorithms
5. Matrix Algorithms
6. Algorithms for Linear Algebra
7. Sorting, TEST
8. Parallel accelerators
9. Graph algorithms I.
10. Graph algorithms II.
11. Combinatorial algorithms
12. Dynamic programming
13. Fast Fourier transform
Exercises outlines
1. Introduction to parallel programming, environment setting
2. Introduction to Cpp11 threads
3. Advanced constructs in Cpp11
4. Assignment of the semestral work + homework 1
5. OpenMP - basic constructs
6. OpenMP - vectorization, parallel sort
7. Homework 2, deadline for homework 1
8. Semestral work - consultation
9. OpenMPI - distributed algorithms
10. Homework 3, deadline for homework 2
11. Semestral work - consultation
12. Presentations of semestral works
13. deadline for homework 3, student assessment
Literature
[1] Ananth Grama, Anshul Gupta, George Karypis, Vipin Kumar: Introduction to Parallel Computing, Second Edition, Addison Wesley, 2003.

[2] Georg Hager, Gerhard Wellein: Introduction to High Performance Computing for Scientists and Engineers, CRC Press, 2011.

[3] James Reinders, Jim Jeffers: Intel Xeon Phi Coprocessor High-Performance Programming, Newnes, 2013.
Requirements
Basic competence in C++ programming and algorithmization.