MCSE - Memory and Storage Technologies in HPC

Mass storage access for exascale supercomputers

Main memory (memory) and mass storage (storage) are classically separate technologies for different purposes. The relatively new NVMe (Non-Volatile Memory) technology combines features of both: on the one hand, significantly higher access speeds than classic storages, and on the other hand, the eponymous property of retaining the contents even after switching off and on. NVMe hardware is used for both storage hardware and modified RAM bars.

The aim is to eliminate the usual separation between RAM and non-volatile memory to enable a significant increase in efficiency. As a result, different classes of memory media can be used flexibly. In the project, alternative interfaces for the elementary input/output of parallel applications are investigated for this purpose. As a result, system-independent communication interfaces (I/O verbs) will be developed. In addition, the IML system (Infinite Memory Layer) will enable applications to share data in a consistent, reliable and fast way.

The innovative core of the project is the development of I/O verbs to improve the scalability and performance of mass storage accesses. The targeted performance increase contributes to a more efficient use of new high-performance computers and energy savings. The results and findings obtained are readily transferable to other systems.