Intermediate Course 2025/04/10: Intermediate HPC and Data Management topics @KIT

Thursday Apr 10, 2025, 9:30 AM → 5:05 PM Europe/Berlin

Gebäude 20.21 (KIT Campus Süd)

Das Scientific Computing Center lädt Sie herzlich am 10. April zum Kurs "Weiterführende Hochleistungsrechnen-(HPC) und Daten-Management-Themen" ein. Die Veranstaltung richtet sich an alle aktiven, forgeschrittenen Nutzer der bwHPC-Cluster (bwUniCluster, bwForCluster) und des Hochleistungsrechners HoreKa und umfasst Batch- und Job-Scripting, weiterführendes Jobmanagement (inkl. für parallele Anwendungen), Kompilieren, Remote-Visualisierung und Daten-Management. Vorkenntnisse im Umgang mit der Bash-Shell und dem Linux-Kommandozeileninterface werden für diesen Kurs empfohlen. Die Präsenzveranstaltung kombiniert Vorträge mit Tutorien. Der Kurs findet in englischer Sprache statt. Es fallen keine Teilnahmegebühren an.

---

The Scientific Computing Center is hosting the course: "Intermediate High Performance Computing (HPC) and Data Management topics" on April 10, 2025. This course is aimed at active, intermediate users of the bwHPC clusters (bwUniCluster, bwForClusters) and the HPC cluster HoreKa and includes advanced batch & job scripting, compiling, remote visualization and data management. Knowledge about the Bash shell and the Linux command line interface are recommended for this course. The event combines talks and tutorials. The course will be conducted in English. It is free of charge and will take place on-site.

9:30 AM → 10:15 AM Hints for successful submitting procedure to the HPC cluster (Horeka)

10:15 AM → 10:35 AM Break

10:35 AM → 12:35 PM Intermediate Bash Scripting + Exercises

• Bash and shell features and utilities:
  * loops
  * using the terminal efficiently
  * basic unix tools and their composability
  * defensive programming
• ssh tips and tricks
• Discussion about workflows
• Bash/Job Scripting and HPC workflows:
  • best practices for data/metadata organization and wokflows
  • Job Arrays
  • Coalescing work together: parbatch

12:35 PM → 2:15 PM Lunch Break

2:15 PM → 3:00 PM File Systems

The intermediate file system course will provide more details about the file systems, e.g. how to check quotas, how to use $TMPDIR, BeeOND, the LSDF Online Storage and workspaces on flash storage.

3:00 PM → 3:20 PM Break

3:20 PM → 4:50 PM Batch System: Best Practices and Running parallel jobs

• Best practices for job setup and resource specification
• Job script templates
• Making use of the greatly parallel systems: specifying resources for parallel programs
• MPI programs (compute bound, memory bound, ...)
• OpenMP programs
• MPI + OpenMP hybrid programs