Column-oriented Data Store for Astrophysical Data

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F14%3A10271949" target="_blank" >RIV/00216208:11320/14:10271949 - isvavai.cz</a>

Výsledek na webu

<a href="http://dx.doi.org/10.1109/DEXA.2014.60" target="_blank" >http://dx.doi.org/10.1109/DEXA.2014.60</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1109/DEXA.2014.60" target="_blank" >10.1109/DEXA.2014.60</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Column-oriented Data Store for Astrophysical Data

Popis výsledku v původním jazyce

Astrophysical databases have used proprietary formats (especially FITS format) to represent measured data and related metadata. The design of the FITS format was influenced by punch cards, thus it is extremely inappropriate for modern hardware. Even though this format is well established in the domain of astrophysics and will be definitely used as a common ground for data exchange, a new representation is required if the data are to be processed efficiently in a high performance manner. In this paper, we propose a specialized column-oriented format for the measured data, which allows much faster loading from the persistent data storage and direct application of the data in computational operations. Furthermore, we have tested various I/O methods implemented in modern operating systems to accommodate a different access patterns that were observed in the most use cases. We have created a prototype implementation of the proposed methods and experimentally evaluated their benefits.

Název v anglickém jazyce

Column-oriented Data Store for Astrophysical Data

Popis výsledku anglicky

Astrophysical databases have used proprietary formats (especially FITS format) to represent measured data and related metadata. The design of the FITS format was influenced by punch cards, thus it is extremely inappropriate for modern hardware. Even though this format is well established in the domain of astrophysics and will be definitely used as a common ground for data exchange, a new representation is required if the data are to be processed efficiently in a high performance manner. In this paper, we propose a specialized column-oriented format for the measured data, which allows much faster loading from the persistent data storage and direct application of the data in computational operations. Furthermore, we have tested various I/O methods implemented in modern operating systems to accommodate a different access patterns that were observed in the most use cases. We have created a prototype implementation of the proposed methods and experimentally evaluated their benefits.

Druh

D - Stať ve sborníku

CEP obor

IN - Informatika

OECD FORD obor

—

Projekt

Výsledek vznikl pri realizaci vícero projektů. Více informací v záložce Projekty.

Návaznosti

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Rok uplatnění

2014

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název statě ve sborníku

25th International Workshop on Database and Expert Systems Applications

ISBN

978-1-4799-5722-4

ISSN

1529-4188

e-ISSN

—

Počet stran výsledku

5

Strana od-do

258-262

Název nakladatele

IEEE Computer Society

Místo vydání

Los Alamitos, CA

Místo konání akce

Munich, Germany

Datum konání akce

1. 9. 2014

Typ akce podle státní příslušnosti

WRD - Celosvětová akce

Kód UT WoS článku

—