Performance analysis on GPUs with NVIDIA tools

Europe/Berlin
Online

Online

The link to the Zoom session will be communicated to registered participants a few days before the event
Description

NHR@FAUPorting Code to the GPU promises large speedups, but there can be pitfalls on the way to realizing its potential. This course will introduce NVIDIA's profiler as a tool to spot common performance bugs that arise when porting code to the GPU.

A practical demonstration introduces the basics of GPU performance analysis. NVIDIA's profiling tool Nsight Systems ist used to analyze GPU utilization and to spot performance anomalies. The complementary tool Nsight Compute is then used to gain more insight about the performance of individual GPU kernels. The performance analysis will be guided by simple, resource-based performance models which will enable the developer to develop a concept of how far the performance is from the "target."

Attendees will be able to follow along the demos and conduct their own experiments on the NHR@FAU GPU cluster.

Requirements

  • basic understanding of GPU programming with CUDA, OpenMP, or OpenACC
  • compile applications by invoking the compiler on the command line
  • editing files through ssh connection via vim, emacs, nano, ...

Participation

Participation is free of charge for attendees from German universities,
academic computing centers, and research institutions. Please only register for the course if you are really going to attend. No-shows will be blacklisted and excluded from future NHR@FAU events.

Instructor

Dominik Ernst (NHR@FAU)

 

This course is organized by Erlangen National High Performance Computing Center (NHR@FAU)

 

A practical demonstration introduces the basics of GPU performance analysis. NVIDIA's profiling tool Nsight Systems ist used to analyze GPU utilization and to spot performance anomalies. The complimentary tool Nsight compute is then used to gain more insight about the performance of individual GPU kernels.

    • 9:00 AM 10:30 AM
      Lecture and hands-on part 1 1h 30m
    • 10:30 AM 10:40 AM
      Break 10m
    • 10:40 AM 11:40 AM
      Lecture and hands-on part 2 1h
    • 11:40 AM 11:50 AM
      Break 10m
    • 11:50 AM 1:00 PM
      Lecture and hands-on part 3 1h 10m