Parallel Programming of High-Performance Systems 2022

Mar 8, 2022, 9:30 AM → Mar 10, 2022, 4:00 PM Europe/Berlin

Online

This online course, a collaboration of Erlangen National High Performance Computing Center (NHR@FAU) and Leibniz Supercomputing Center (LRZ), is targeted at students and scientists with interest in programming modern HPC hardware, specifically the large-scale parallel computing systems available at the Gauss Centers and in the NHR Alliance.. 

Topics covered include:

• HPC Intro, Systems in Germany
• Elements of MPI and OpenMP
• OpenMP in Depth
• MPI in Depth
• Basic Computer Architecture: Shared Memory
• Basic computer architecture: Distributed Memory
• Profiling Tools
• Performance Pitfalls

See the timetable for details.

Prerequisites

Course participants should have a working UNIX/Linux knowledge (login with secure shell, shell commands, compilers, vi or emacs editors). Good working knowledge of at least one of the standard HPC languages: Fortran 95, C or C++ is also required

Hands-On

Exercises will be conducted on a Linux Cluster at NHR@FAU in Erlangen.

Content Level

The content level of the course is broken down as:

Beginner's content:	70%
Intermediate content:	30%
Advanced content:	0%
Community-targeted content:	0%

Language

English

Lecturers

G. Hager (NHR@FAU), A. Afzal (NHR@FAU), M. Wittmann (NHR@FAU), V. Weinberg (LRZ)

Prices and Eligibility

The course is open and free of charge for people from academia from the Member States (MS) of the European Union (EU) and Associated/Other Countries to the Horizon 2020 programme.

Withdrawal Policy

Please only register for the course if you are really going to attend. No-shows will be blacklisted and excluded from future events. If you want to withdraw your registration, please send e-mail to georg.hager@fau.de.

Parallel Programming for High Performance Systems Moodle Page

Tuesday, March 8

9:30 AM → 9:45 AM Session opens

Speakers: Dr Georg Hager, Dr Volker Weinberg

9:45 AM → 10:00 AM Welcome and Introduction

Speaker: Dr Volker Weinberg

10:00 AM → 10:45 AM HPC Introduction, Systems in Germany

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

10:45 AM → 11:15 AM Hands-On: Logging in, starting a batch job

11:15 AM → 11:30 AM Coffee Break

11:30 AM → 12:30 PM Elements of OpenMP and MPI (I)

Speaker: Dr Volker Weinberg

12:30 PM → 1:15 PM Lunch Break

1:15 PM → 2:00 PM Elements of OpenMP and MPI (II)

Speaker: Dr Volker Weinberg

2:00 PM → 3:00 PM Hands-On: OpenMP and MPI basics

3:00 PM → 3:15 PM Coffee Break

3:15 PM → 4:00 PM Basic Computer Architecture: Shared Memory

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

Wednesday, March 9

9:30 AM → 9:45 AM Room opens

9:45 AM → 11:00 AM OpenMP in Depth

Speaker: Dr Volker Weinberg

11:00 AM → 11:15 AM Coffee Break

11:15 AM → 12:15 PM Hands-On: OpenMP

12:15 PM → 1:00 PM Lunch Break

1:00 PM → 1:45 PM Basic Computer Architecture: Distributed Memory

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

1:45 PM → 2:30 PM MPI in Depth (I)

Speaker: Ayesha Afzal

2:30 PM → 2:45 PM Coffee Break

2:45 PM → 3:30 PM MPI in Depth (II)

Speaker: Ayesha Afzal

3:30 PM → 4:00 PM Hands-On: MPI

Thursday, March 10

9:30 AM → 9:45 AM Room opens

9:45 AM → 10:45 AM Profiling Tools

Speakers: Ayesha Afzal, Dr Georg Hager (Erlangen National High Performance Computing Center)

10:45 AM → 11:15 AM Hands-On: Profiling with gprof

11:15 AM → 11:30 AM Coffee Break

11:30 AM → 12:15 PM OpenMP Programming: Correctness, Tuning, Examples

Speaker: Dr Markus Wittmann

12:15 PM → 1:00 PM Lunch Break

1:00 PM → 2:00 PM Hands-On: Profiling with ITAC

2:00 PM → 2:30 PM Performance Pitfalls

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

2:30 PM → 2:45 PM Coffee Break

2:45 PM → 3:45 PM Hands-On: Performance Pitfalls

3:45 PM → 4:00 PM Wrap-up & adjourn