Concept drift robust adaptive novelty detection for data streams

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21220%2F18%3A00322656" target="_blank" >RIV/68407700:21220/18:00322656 - isvavai.cz</a>

Result on the web

<a href="https://www.sciencedirect.com/science/article/pii/S0925231218305253" target="_blank" >https://www.sciencedirect.com/science/article/pii/S0925231218305253</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1016/j.neucom.2018.04.069" target="_blank" >10.1016/j.neucom.2018.04.069</a>

Result language

angličtina

Original language name

Concept drift robust adaptive novelty detection for data streams

Original language description

In this paper we study the performance of two original adaptive unsupervised novelty detection methods (NDMs) on data with concept drift. Newly, the concept drift is considered as a challenging data imbalance that should be ignored by the NDMs, and only system changes and outliers represent novelty. The field of application for such NDMs is broad. For example, the method can be used as a supportive method for real-time system fault detection, for onset detection of events in biomedical signals, in monitoring of nonlinearly controlled processes, for event driven automated trading, etc. The two newly studied methods are the error and learning based novelty detection (ELBND) and the learning entropy (LE) based detection. These methods use both the error and weight increments of a (supervised) learning model. Here, we study these methods with normalized least-mean squares (NLMS) adaptive filter, and while the NDMs were studied on various real life tasks, newly, we carry out the study on two types of data streams with concept drift to analyze the general ability for unsupervised novelty detection. The two data streams, one with system changes, second with outliers, represent different novelty scenarios to demonstrate the performance of the proposed NDMs with concept drifts in data. Both tested NDMs work as a feature extractor. Thus, a classification framework is used for the evaluation of the obtained features and NDM benchmarking, where two other NDMs, one based on the adaptive model plain error, second using the sample entropy (SE), are used as the reference for the comparison to the proposed methods. The results show that both newly studied NDMs are superior to the merely use of the plain error of adaptive model and also to the sample entropy based detection while they are robust against the concept drift occurrence. (C) 2018 Elsevier B.V. All rights reserved.

Czech name

—

Czech description

—

Type

J_imp - Article in a specialist periodical, which is included in the Web of Science database

CEP classification

—

OECD FORD branch

20304 - Aerospace engineering

Project

<a href="/en/project/EF16_019%2F0000826" target="_blank" >EF16_019/0000826: Center of Advanced Aerospace Technology</a><br>

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Publication year

2018

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

Neurocomputing

ISSN

0925-2312

e-ISSN

1872-8286

Volume of the periodical

309

Issue of the periodical within the volume

10

Country of publishing house

NL - THE KINGDOM OF THE NETHERLANDS

Number of pages

8

Pages from-to

46-53

UT code for WoS article

000436622300005

EID of the result in the Scopus database

2-s2.0-85048277986