Parallel Programming of High-Performance Systems 2024 (on-site)

Feb 20, 2024, 10:30 AM → Feb 22, 2024, 4:00 PM Europe/Berlin

02.135 (FAU Computer Science Building)

This on-site course, a collaboration of Erlangen National High Performance Computing Center (NHR@FAU) and Leibniz Supercomputing Center (LRZ), is targeted at students and scientists with interest in programming modern HPC clusters from the research group to the computing center level.

Topics covered include:

• HPC Introduction
• HPC Systems in Germany
• Elements of MPI and OpenMP
• OpenMP in Depth
• MPI in Depth
• Basic Computer Architecture: Shared Memory
• Basic computer architecture: Distributed Memory
• Basic Profiling Tools
• Performance Pitfalls

See the timetable for details.

Prerequisites

Course participants should have a working UNIX/Linux knowledge (login with secure shell, shell commands, compilers, vi or emacs editors). Good working knowledge of at least one of the standard HPC languages: Fortran 95, C or C++ is also required

Hands-On

Exercises will be conducted on a Linux Cluster at NHR@FAU in Erlangen.

Content Level

The content level of the course is broken down as:

Beginner's content:	70%
Intermediate content:	30%
Advanced content:	0%
Community-targeted content:	0%

Language

English

Lecturers

G. Hager (NHR@FAU), A. Afzal (NHR@FAU), M. Wittmann (NHR@FAU), V. Weinberg (LRZ)

Prices and Eligibility

The course is open and free of charge for people from academia from the Member States (MS) of the European Union (EU) and Associated/Other Countries to the Horizon 2020 programme.

Withdrawal Policy

Please only register for the course if you are really going to attend. No-shows will be blacklisted and excluded from future events. If you want to withdraw your registration, please send e-mail to georg.hager@fau.de.

Parallel Programming for High Performance Systems Moodle Page

Tuesday, February 20

10:30 AM → 11:00 AM Welcome and Introduction

Speaker: Dr Volker Weinberg

11:00 AM → 11:45 AM HPC Introduction, Systems in Germany

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

11:45 AM → 12:15 PM Hands-On: Logging in, working with code examples

12:15 PM → 1:15 PM Lunch Break

1:15 PM → 3:00 PM Elements of OpenMP and MPI

Speaker: Dr Volker Weinberg

3:00 PM → 3:15 PM Coffee Break

3:15 PM → 4:15 PM Hands-On: OpenMP and MPI basics

4:15 PM → 5:00 PM Basic Computer Architecture: Shared Memory

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

Wednesday, February 21

9:00 AM → 10:45 AM OpenMP in Depth

Speaker: Dr Markus Wittmann

10:45 AM → 11:00 AM Coffee Break

11:00 AM → 12:00 PM Hands-On: OpenMP

12:00 PM → 1:00 PM Lunch Break

1:00 PM → 1:45 PM Basic Computer Architecture: Distributed Memory

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

1:45 PM → 2:30 PM MPI in Depth (I)

Speaker: Ayesha Afzal

2:30 PM → 2:45 PM Coffee Break

2:45 PM → 3:30 PM MPI in Depth (II)

Speaker: Ayesha Afzal

3:30 PM → 5:00 PM Hands-On: MPI (and OpenMP)

Thursday, February 22

9:00 AM → 10:00 AM Profiling Tools

Speakers: Ayesha Afzal, Dr Georg Hager (Erlangen National High Performance Computing Center)

10:00 AM → 10:45 AM Hands-On: Profiling with gprof

10:45 AM → 11:00 AM Coffee Break

11:00 AM → 12:00 PM Hands-On: Profiling with ITAC

12:00 PM → 1:00 PM Lunch Break

1:00 PM → 1:30 PM Benchmarking and data presentation

1:30 PM → 2:00 PM Performance pitfalls and how to spot them

Speaker: Dr Georg Hager (Erlangen National High Performance Computing Center)

2:00 PM → 2:30 PM Hands-On

2:30 PM → 2:45 PM Coffee Break

2:45 PM → 3:45 PM Hands-On

3:45 PM → 4:00 PM Wrap-up & adjourn