Parallel Programming of High-Performance Systems 2024 (on-site)

Feb 20, 2024, 10:30 AM → Feb 22, 2024, 4:00 PM Europe/Berlin

02.135 (FAU Computer Science Building)

This on-site course, a collaboration of Erlangen National High Performance Computing Center (NHR@FAU) and Leibniz Supercomputing Center (LRZ), is targeted at students and scientists with interest in programming modern HPC clusters from the research group to the computing center level.

Topics covered include:

• HPC Introduction
• HPC Systems in Germany
• Elements of MPI and OpenMP
• OpenMP in Depth
• MPI in Depth
• Basic Computer Architecture: Shared Memory
• Basic computer architecture: Distributed Memory
• Basic Profiling Tools
• Performance Pitfalls

See the timetable for details.

Prerequisites

Course participants should have a working UNIX/Linux knowledge (login with secure shell, shell commands, compilers, vi or emacs editors). Good working knowledge of at least one of the standard HPC languages: Fortran 95, C or C++ is also required

Hands-On

Exercises will be conducted on a Linux Cluster at NHR@FAU in Erlangen.

Content Level

The content level of the course is broken down as:

Beginner's content:	70%
Intermediate content:	30%
Advanced content:	0%
Community-targeted content:	0%

Language

English

Lecturers

G. Hager (NHR@FAU), A. Afzal (NHR@FAU), M. Wittmann (NHR@FAU), V. Weinberg (LRZ)

Prices and Eligibility

The course is open and free of charge for people from academia from the Member States (MS) of the European Union (EU) and Associated/Other Countries to the Horizon 2020 programme.

Withdrawal Policy

Please only register for the course if you are really going to attend. No-shows will be blacklisted and excluded from future events. If you want to withdraw your registration, please send e-mail to georg.hager@fau.de.

Parallel Programming for High Performance Systems Moodle Page

Tuesday, February 20

1 Welcome and Introduction

Speaker: Dr Volker Weinberg

2 HPC Introduction, Systems in Germany

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

3 Hands-On: Logging in, working with code examples

12:15 PM Lunch Break

4 Elements of OpenMP and MPI

Speaker: Dr Volker Weinberg

3:00 PM Coffee Break

5 Hands-On: OpenMP and MPI basics

6 Basic Computer Architecture: Shared Memory

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

Wednesday, February 21

7 OpenMP in Depth

Speaker: Dr Markus Wittmann

10:45 AM Coffee Break

8 Hands-On: OpenMP

12:00 PM Lunch Break

9 Basic Computer Architecture: Distributed Memory

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

10 MPI in Depth (I)

Speaker: Ayesha Afzal

2:30 PM Coffee Break

11 MPI in Depth (II)

Speaker: Ayesha Afzal

12 Hands-On: MPI (and OpenMP)

Thursday, February 22

13 Profiling Tools

Speakers: Ayesha Afzal, Dr Georg Hager (Erlangen National High Performance Computing Center)

14 Hands-On: Profiling with gprof

10:45 AM Coffee Break

15 Hands-On: Profiling with ITAC

12:00 PM Lunch Break

16 Benchmarking and data presentation

17 Performance pitfalls and how to spot them

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

18 Hands-On

2:30 PM Coffee Break

19 Hands-On

20 Wrap-up & adjourn