Data System and Data Management in a Federation of HPC/Cloud Centers
Identifikátory výsledku
Kód výsledku v IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F61989100%3A27740%2F22%3A10250558" target="_blank" >RIV/61989100:27740/22:10250558 - isvavai.cz</a>
Výsledek na webu
<a href="https://www.taylorfrancis.com/chapters/oa-edit/10.1201/9781003176664-4/data-system-data-management-federation-hpc-cloud-centers-johannes-munke-mohamad-hayek-martin-golasowski-rub%C3%A9n-garc%C3%ADa-hern%C3%A1ndez-fr%C3%A9d%C3%A9ric-donnat-c%C3%A9dric-koch-hofer-philippe-couvee-stephan-hachinger-jan-martinovi%C4%8D" target="_blank" >https://www.taylorfrancis.com/chapters/oa-edit/10.1201/9781003176664-4/data-system-data-management-federation-hpc-cloud-centers-johannes-munke-mohamad-hayek-martin-golasowski-rub%C3%A9n-garc%C3%ADa-hern%C3%A1ndez-fr%C3%A9d%C3%A9ric-donnat-c%C3%A9dric-koch-hofer-philippe-couvee-stephan-hachinger-jan-martinovi%C4%8D</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1201/9781003176664-4" target="_blank" >10.1201/9781003176664-4</a>
Alternativní jazyky
Jazyk výsledku
angličtina
Název v původním jazyce
Data System and Data Management in a Federation of HPC/Cloud Centers
Popis výsledku v původním jazyce
This chapter describes the federation of high-performance computing/data centers by a highly reliable distributed data infrastructure (DDI) as part of the LEXIS project (Large-Scale EXecution for Industry and Society, H2020 GA 825532). LEXIS offers user-friendly, cross-site orchestration for simulation and big data workflows, as well as data management, currently implemented at the IT4Innovations National Supercomputing Center (IT4I, CZ) and the Leibniz Supercomputing Centre (LRZ, DE). The chapter outlines requirements and implementation for such an infrastructure in the European context, considering the FAIR principles of modern research data management. Our high-reliability setup of iRODS (Integrated Rule-Oriented Data System) as data middleware is described, as well as the hardware behind the DDI, including burst buffers. A unified user access is ensured using the LEXIS authentication and authorization infrastructure. The LEXIS DDI has been integrated successfully into the LEXIS platform via REST APIs, and into the European data management landscape via EUDAT interfaces and tools. (C) 2022 selection and editorial matter, Olivier Terzo and Jan Martinovic; individual chapters, the contributors.
Název v anglickém jazyce
Data System and Data Management in a Federation of HPC/Cloud Centers
Popis výsledku anglicky
This chapter describes the federation of high-performance computing/data centers by a highly reliable distributed data infrastructure (DDI) as part of the LEXIS project (Large-Scale EXecution for Industry and Society, H2020 GA 825532). LEXIS offers user-friendly, cross-site orchestration for simulation and big data workflows, as well as data management, currently implemented at the IT4Innovations National Supercomputing Center (IT4I, CZ) and the Leibniz Supercomputing Centre (LRZ, DE). The chapter outlines requirements and implementation for such an infrastructure in the European context, considering the FAIR principles of modern research data management. Our high-reliability setup of iRODS (Integrated Rule-Oriented Data System) as data middleware is described, as well as the hardware behind the DDI, including burst buffers. A unified user access is ensured using the LEXIS authentication and authorization infrastructure. The LEXIS DDI has been integrated successfully into the LEXIS platform via REST APIs, and into the European data management landscape via EUDAT interfaces and tools. (C) 2022 selection and editorial matter, Olivier Terzo and Jan Martinovic; individual chapters, the contributors.
Klasifikace
Druh
C - Kapitola v odborné knize
CEP obor
—
OECD FORD obor
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Návaznosti výsledku
Projekt
—
Návaznosti
V - Vyzkumna aktivita podporovana z jinych verejnych zdroju
Ostatní
Rok uplatnění
2022
Kód důvěrnosti údajů
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Údaje specifické pro druh výsledku
Název knihy nebo sborníku
HPC, Big Data, and AI Convergence Towards Exascale: Challenge and Vision
ISBN
978-1-03-200984-1
Počet stran výsledku
22
Strana od-do
59-80
Počet stran knihy
322
Název nakladatele
CRC Press
Místo vydání
Boca Raton
Kód UT WoS kapitoly
—