Setting an asymptotically optimal threshold for detecting anomalies in a multivariate gaussian sample with application to time series

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F67985807%3A_____%2F25%3A00635803" target="_blank" >RIV/67985807:_____/25:00635803 - isvavai.cz</a>

Výsledek na webu

—

DOI - Digital Object Identifier

—

Jazyk výsledku

angličtina

Název v původním jazyce

Setting an asymptotically optimal threshold for detecting anomalies in a multivariate gaussian sample with application to time series

Popis výsledku v původním jazyce

ZÁKLADNÍ ÚDAJE: Seminar ISCB Czechia. 18.03.2025-18.03.2025, Prague / Online. ABSTRAKT: Anomalies, often referred to as outliers, are data points that deviate significantly from the rest of the dataset. These points may represent errors or unusual observations, and their detection can reveal important events, such as production faults, system defects, or health issues, what makes their identification highly valuable. A wide variety of anomaly detection techniques exist, as no single method is universally effective. The basic approach to detecting anomalies relies on a manually set threshold, but selecting such a threshold is a non-trivial statistical task. In this talk, we propose a threshold for detecting anomalies in data with a multivariate normal distribution, specifically when anomalous observations are rare and differ from the rest of the data by their mean value. Under certain conditions, the proposed threshold is shown to be asymptotically optimal in the sense that the expected number of misidentified outliers tends to zero as the sample size increases. The performance of the proposed threshold is compared with other popular thresholding methods through simulations in both univariate and multivariate cases. Additionally, the method is applied to real data collected within the DigiWell project.

Název v anglickém jazyce

Setting an asymptotically optimal threshold for detecting anomalies in a multivariate gaussian sample with application to time series

Popis výsledku anglicky

ZÁKLADNÍ ÚDAJE: Seminar ISCB Czechia. 18.03.2025-18.03.2025, Prague / Online. ABSTRAKT: Anomalies, often referred to as outliers, are data points that deviate significantly from the rest of the dataset. These points may represent errors or unusual observations, and their detection can reveal important events, such as production faults, system defects, or health issues, what makes their identification highly valuable. A wide variety of anomaly detection techniques exist, as no single method is universally effective. The basic approach to detecting anomalies relies on a manually set threshold, but selecting such a threshold is a non-trivial statistical task. In this talk, we propose a threshold for detecting anomalies in data with a multivariate normal distribution, specifically when anomalous observations are rare and differ from the rest of the data by their mean value. Under certain conditions, the proposed threshold is shown to be asymptotically optimal in the sense that the expected number of misidentified outliers tends to zero as the sample size increases. The performance of the proposed threshold is compared with other popular thresholding methods through simulations in both univariate and multivariate cases. Additionally, the method is applied to real data collected within the DigiWell project.

Druh

O - Ostatní výsledky

CEP obor

—

OECD FORD obor

10103 - Statistics and probability

Projekt

<a href="/cs/project/EH22_008%2F0004583" target="_blank" >EH22_008/0004583: Excelentní výzkum v oblasti digitálních technologií a wellbeingu</a><br>

Návaznosti

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Rok uplatnění

2025

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů