Strengthening connections between HPC and data management solutions & data orchestration

EUDAT Conference 2024

3-5 December 2024 | Karlsruhe, Germany

Description | Programme | Venue | Open Calls | Partnership | Hotel List

 

Data management is a very diverse domain spanning many types of storage technologies, transfer protocols, tools and policies. These aspects must work together in harmony to deliver powerful tooling to handle the ever increasing amount of data processed on large computing infrastructures such as HPC clusters or cloud operators. In this session we offer several talks focusing on various aspects of data orchestration on HPC with repeatable and open science in mind.

We will provide a brief overview of open problems in data management on HPC and explore solutions for orchestrating data oriented workflows such as the LEXIS Platform and the IO-SEA software stack. One of the session will also focus on novel approaches to data orchestration across diverse land of database systems and traditiional file-based storages explored in the EXA4MIND project.

 

Session Organisers : Martin Golasowski (IT4I) & Jan Martinovic (IT4I)