ScaDS.AI-Tutorial: Efficient Parallel Hyperparameter Optimization with OmniOpt on HPC

In this training the hyper-parameter (HP) optimisation tool OmniOpt is introduced. OmniOpt is a tailor-made solution for the high performance computing (HPC) cluster Taurus of TU Dresden which allows to optimise the HPs of a wide range of problems, ranging from neural networks to classical simulations. Thereby, the emphasis is on versatility, flexibility (as regards the type of application to be optimised and the choice of its HPs) and user-friendliness. The use of the HPC system Taurus with its vast resources of GPUs, CPUs and storage assures that even large problems may be handled within a moderate computation time. Moreover, there is a variety of tools for the automatic analysis and graphical representation of the optimisation results.

This training is suitable for researchers as well as for students with basic knowledge in Linux and a command-line based programming language, e.g. Python or C. Researchers who bring their own code to be optimised, are highly welcome. After a general introduction into HPC and OmniOpt, the main part of the training will be a hands-on session, where the participants can try out the tool in practice.

Registration is required. Participation is free.