The DIRAC AWEAR Audio-Visual Platform for Detection of Unexpected and Incongruent Events

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21230%2F08%3A03150858" target="_blank" >RIV/68407700:21230/08:03150858 - isvavai.cz</a>

Result on the web

—

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

The DIRAC AWEAR Audio-Visual Platform for Detection of Unexpected and Incongruent Events

Original language description

It is of prime importance in everyday human life to cope with and respond appropriately to events that are not foreseen by prior experience. Machines to a large extent lack the ability to respond appropriately to such inputs. An important class of unexpected events is defined by incongruent combinations of inputs from different modalities and therefore multimodal information provides a crucial cue for the identification of such events, e.g., the sound of a voice is being heard while the person in the fieldof- view does not move her lips. In the project DIRAC (``Detection and Identification of Rare Audio-visual Cues'') we have been developing algorithmic approaches to the detection of such events, as well as an experimental hardware platform to test it.An audio-visual platform ("AWEAR" - audio-visual wearable device) has been constructed with the goal to help users with disabilities or a high cognitive load to deal with unexpected events. Key hardware components include stereo panorami

Czech name

The DIRAC AWEAR Audio-Visual Platform for Detection of Unexpected and Incongruent Events

Czech description

It is of prime importance in everyday human life to cope with and respond appropriately to events that are not foreseen by prior experience. Machines to a large extent lack the ability to respond appropriately to such inputs. An important class of unexpected events is defined by incongruent combinations of inputs from different modalities and therefore multimodal information provides a crucial cue for the identification of such events, e.g., the sound of a voice is being heard while the person in the fieldof- view does not move her lips. In the project DIRAC (``Detection and Identification of Rare Audio-visual Cues'') we have been developing algorithmic approaches to the detection of such events, as well as an experimental hardware platform to test it.An audio-visual platform ("AWEAR" - audio-visual wearable device) has been constructed with the goal to help users with disabilities or a high cognitive load to deal with unexpected events. Key hardware components include stereo panorami

Type

D - Article in proceedings

CEP classification

JD - Use of computers, robotics and its application

OECD FORD branch

—

Project

—

Continuities

R - Projekt Ramcoveho programu EK

Publication year

2008

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

ICMI 2008: Proceedings of the 10th International Conference on Multimodal Interfaces

ISBN

978-1-60558-198-9

ISSN

—

e-ISSN

—

Number of pages

4

Pages from-to

—

Publisher name

ACM

Place of publication

New York

Event location

Chania, Crete

Event date

Oct 20, 2008

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—