On Fusion of Learned and Designed Features for Video Data Analytics

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F21%3A10433255" target="_blank" >RIV/00216208:11320/21:10433255 - isvavai.cz</a>

Result on the web

<a href="https://doi.org/10.1007/978-3-030-67835-7_23" target="_blank" >https://doi.org/10.1007/978-3-030-67835-7_23</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/978-3-030-67835-7_23" target="_blank" >10.1007/978-3-030-67835-7_23</a>

Result language

angličtina

Original language name

On Fusion of Learned and Designed Features for Video Data Analytics

Original language description

Video cameras have become widely used for indoor and outdoor surveillance. Covering more and more public space in cities, the cameras serve various purposes ranging from security to traffic monitoring, urban life, and marketing. However, with the increasing quantity of utilized cameras and recorded streams, manual video monitoring and analysis becomes too laborious. The goal is to obtain effective and efficient artificial intelligence models to process the video data automatically and produce the desired features for data analytics. To this end, we propose a framework for real-time video feature extraction that fuses both learned and hand-designed analytical models and is applicable in real-life situations. Nowadays, state-of-the-art models for various computer vision tasks are implemented by deep learning. However, the exhaustive gathering of labeled training data and the computational complexity of resulting models can often render them impractical. We need to consider the benefits and limitations of each technique and find the synergy between both deep learning and analytical models. Deep learning methods are more suited for simpler tasks on large volumes of dense data while analytical modeling can be sufficient for processing of sparse data with complex structures. Our framework follows those principles by taking advantage of multiple levels of abstraction. In a use case, we show how the framework can be set for an advanced video analysis of urban life.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2021

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

27th International Conference, MMM 2021, Prague, Czech Republic, June 22–24, 2021, Proceedings, Part II

ISBN

978-3-030-67834-0

ISSN

—

e-ISSN

—

Number of pages

13

Pages from-to

268-280

Publisher name

Springer

Place of publication

Cham, Germany

Event location

Prague

Event date

Jun 22, 2021

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—