Analyzing Deep Learning APIs and Applications with HPC performance tools

NHR Tutorial (Online)

Wednesday, 06/15/2022, 9:00 am - 01:00 pm

Speaker: Holger Brunst, Sebastian Döbel, Andreas Gocht-Zech (ZIH)
                 Thomas Steinke (ZIB)

Deep Learning APIs such as TensorFlow or PyTorch usually do not guarantee efficient use of HPC resources. With existing HPC tools, the efficiency analysis of Deep Learning applications is more difficult than for classical HPC applications. This tutorial aims to bridge the gap between Deep Learning APIs and classical HPC infrastructure and presents practical approaches and recipes for efficient model training on HPC resources. Moreover, we show methods to analyse DeepLearning application's performance.

Agenda

• Basic knowledge of HPC systems
• Basic knowledge of performance analysis
• Good practices for running machine learning applications on HPC systems
• How-to: Analyse performance of machine learning applications

Handouts

The course material (slides) will be made available to the class participants.

HPC-Certification Forum Links

Prerequisites

• First contact with machine learning application

• Basic understanding of machine learning approaches

• Hands-On: Use an TensorFlow environment

Learning Objectives

• Understanding of HPC resources and how to utilize it with machine learning tasks
• Basic knowledge of performance analyzing tools

Registration

Link: https://event.zih.tu-dresden.de/nhr/deepl-hpc
Registration is closing on 06/07/2022. The NHR tutorial is limited to 30 participants.
You will receive the access data shortly before the event by email to your registered email address.

Further Information

Course language: English
Target group: HPC Beginners, HPC Users, HPC Dev, ML users and ML developers

If you have any further questions, please contact Anja Gerbes ().