Normalization of Unstructured Log Data into Streams of Structured Event Objects

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14610%2F19%3A00109532" target="_blank" >RIV/00216224:14610/19:00109532 - isvavai.cz</a>

Result on the web

<a href="http://dl.ifip.org/db/conf/im/im2019diss/190892.pdf" target="_blank" >http://dl.ifip.org/db/conf/im/im2019diss/190892.pdf</a>

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

Normalization of Unstructured Log Data into Streams of Structured Event Objects

Original language description

Monitoring plays a crucial role in the operation of any sizeable distributed IT infrastructure. Whether it is a university network or cloud datacenter, monitoring information is continuously used in a wide spectrum of ways ranging from mission-critical jobs, e.g. accounting or incident handling, to equally important development-related tasks, e.g. debugging or fault-detection. Whilst pursuing a novel vision of new-generation event-driven monitoring systems, we have identified that a particularly rich source of monitoring information, computer logs, is also one of the most problematic in terms of automated processing. Log data are predominantly generated in an ad-hoc manner using a variety of incompatible formats with the most important pieces of information, i.e. log messages, in the form of unstructured strings. This clashes with our long-term goal of designing a system enabling its users to transparently define real-time continuous queries over homogeneous streams of properly defined monitoring event objects with explicitly described structure. Our goal is to bridge this gap by normalizing the poorly structured log data into streams of structured event objects. The combined challenge of this goal is structuring the log data, whilst considering the high velocity with which they are generated in modern IT infrastructures. This paper summarizes the contributions of a dissertation thesis "Normalization of Unstructured Log Data into Streams of Structured Event Objects" dealing with the matter at hand in detail.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

<a href="/en/project/EF16_019%2F0000822" target="_blank" >EF16_019/0000822: CyberSecurity, CyberCrime and Critical Information Infrastructures Center of Excellence</a><br>

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Publication year

2019

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM)

ISBN

9781728106182

ISSN

1573-0077

e-ISSN

—

Number of pages

6

Pages from-to

671-676

Publisher name

IEEE

Place of publication

Washington DC, USA

Event location

Washington DC, USA

Event date

Apr 8, 2019

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

000469937200120