Analyzing Deep Learning APIs and Applications with HPC performance tools
NHR Tutorial (Online)
Wednesday, 06/15/2022, 9:00 am - 01:00 pm
Speaker: Holger Brunst, Sebastian Döbel, Andreas Gocht-Zech (ZIH)
Thomas Steinke (ZIB)
Deep Learning APIs such as TensorFlow or PyTorch usually do not guarantee efficient use of HPC resources. With existing HPC tools, the efficiency analysis of Deep Learning applications is more difficult than for classical HPC applications. This tutorial aims to bridge the gap between Deep Learning APIs and classical HPC infrastructure and presents practical approaches and recipes for efficient model training on HPC resources. Moreover, we show methods to analyse DeepLearning application's performance.
Agenda
- Basic knowledge of HPC systems
- Basic knowledge of performance analysis
- Good practices for running machine learning applications on HPC systems
- How-to: Analyse performance of machine learning applications
Handouts
The course material (slides) will be made available to the class participants.
HPC-Certification Forum Links
Prerequisites
-
First contact with machine learning application
-
Basic understanding of machine learning approaches
-
Hands-On: Use an TensorFlow environment
Learning Objectives
- Understanding of HPC resources and how to utilize it with machine learning tasks
- Basic knowledge of performance analyzing tools
Registration
Link: https://event.zih.tu-dresden.de/nhr/deepl-hpc
Registration is closing on 06/07/2022. The NHR tutorial is limited to 30 participants.
You will receive the access data shortly before the event by email to your registered email address.
Further Information
Course language: English
Target group: HPC Beginners, HPC Users, HPC Dev, ML users and ML developers
If you have any further questions, please contact Anja Gerbes ().