Parallel Programming of High-Performance Systems 2022

Mar 8, 2022, 9:30 AM → Mar 10, 2022, 4:00 PM Europe/Berlin

Online

This online course, a collaboration of Erlangen National High Performance Computing Center (NHR@FAU) and Leibniz Supercomputing Center (LRZ), is targeted at students and scientists with interest in programming modern HPC hardware, specifically the large-scale parallel computing systems available at the Gauss Centers and in the NHR Alliance.. 

Topics covered include:

• HPC Intro, Systems in Germany
• Elements of MPI and OpenMP
• OpenMP in Depth
• MPI in Depth
• Basic Computer Architecture: Shared Memory
• Basic computer architecture: Distributed Memory
• Profiling Tools
• Performance Pitfalls

See the timetable for details.

Prerequisites

Course participants should have a working UNIX/Linux knowledge (login with secure shell, shell commands, compilers, vi or emacs editors). Good working knowledge of at least one of the standard HPC languages: Fortran 95, C or C++ is also required

Hands-On

Exercises will be conducted on a Linux Cluster at NHR@FAU in Erlangen.

Content Level

The content level of the course is broken down as:

Beginner's content:	70%
Intermediate content:	30%
Advanced content:	0%
Community-targeted content:	0%

Language

English

Lecturers

G. Hager (NHR@FAU), A. Afzal (NHR@FAU), M. Wittmann (NHR@FAU), V. Weinberg (LRZ)

Prices and Eligibility

The course is open and free of charge for people from academia from the Member States (MS) of the European Union (EU) and Associated/Other Countries to the Horizon 2020 programme.

Withdrawal Policy

Please only register for the course if you are really going to attend. No-shows will be blacklisted and excluded from future events. If you want to withdraw your registration, please send e-mail to georg.hager@fau.de.

Parallel Programming for High Performance Systems Moodle Page

Tuesday, March 8

1 Session opens

Speakers: Dr Georg Hager, Dr Volker Weinberg

2 Welcome and Introduction

Speaker: Dr Volker Weinberg

3 HPC Introduction, Systems in Germany

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

4 Hands-On: Logging in, starting a batch job

11:15 AM Coffee Break

5 Elements of OpenMP and MPI (I)

Speaker: Dr Volker Weinberg

12:30 PM Lunch Break

6 Elements of OpenMP and MPI (II)

Speaker: Dr Volker Weinberg

7 Hands-On: OpenMP and MPI basics

3:00 PM Coffee Break

8 Basic Computer Architecture: Shared Memory

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

Wednesday, March 9

9 Room opens

10 OpenMP in Depth

Speaker: Dr Volker Weinberg

11:00 AM Coffee Break

11 Hands-On: OpenMP

12:15 PM Lunch Break

12 Basic Computer Architecture: Distributed Memory

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

13 MPI in Depth (I)

Speaker: Ayesha Afzal

2:30 PM Coffee Break

14 MPI in Depth (II)

Speaker: Ayesha Afzal

15 Hands-On: MPI

Thursday, March 10

16 Room opens

17 Profiling Tools

Speakers: Ayesha Afzal, Dr Georg Hager (Erlangen National High Performance Computing Center)

18 Hands-On: Profiling with gprof

11:15 AM Coffee Break

19 OpenMP Programming: Correctness, Tuning, Examples

Speaker: Dr Markus Wittmann

12:15 PM Lunch Break

20 Hands-On: Profiling with ITAC

21 Performance Pitfalls

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

2:30 PM Coffee Break

22 Hands-On: Performance Pitfalls

23 Wrap-up & adjourn