Analysis and Enhancement of Speech and Image Signals form Noise for Cross-Modal Analysis of Verbal and Non-verbal Communication
Project goals
Human speech, gestures, face-playing, head rotations and so on are not the subjects of emotion expression, which can be studied separately. If we understand how humans obtain information in communication from several channels, we can understand in whichway all the partial activities and the features participate on behalf of what it should be expressed. Verbal and non-verbal communication belongs to the basic methods of information transmission among humans. For a united automatic perceptual image and speech analysis it is necessary to determinate the correct image and speech synchronization. To solve this problem it is necessary to exactly determinate speech-pause positions in a speech signal for the speech analyzing and to exactly determinate mouth and eyes positions in an image signal for the image analyzing. If speech or image signals are highly disturbed, it is quite difficult (frequently impossible) to be this automatic analysis performed. The fundamental purpose of proposed project solution (a
Keywords
Speech signal enhancementone-channel and multi-channel methodspauses detectionface and facial features detectionverbal and non-verbal communication analysisemotional states
Public support
Provider
Ministry of Education, Youth and Sports
Programme
COST
Call for proposals
COST 6 (SMSM2008OC3)
Main participants
—
Contest type
VS - Public tender
Contract ID
1146/2010-32
Alternative language
Project name in Czech
Analýza a zvýraznění řečových a obrazových signálů ze šumu pro vzájemnou analýzu verbální a neverbální komunikace
Annotation in Czech
Navrhnout, optimalizovat a realizovat metody pro zvýraznění řečových signálů ze šumového pozadí. Navrhnout a realizovat metody pro analýzu řečových a obrazových signálů z hlediska verbální a neverbální komunikace.
Scientific branches
Completed project evaluation
Provider evaluation
V - Vynikající výsledky projektu (s mezinárodním významem atd.)
Project results evaluation
Within the frame of the project, new algorithms for verbal and nonverbal communication analysis were proposed: speech signal enhancement, speech pauses detection, face and facial parts detection and emotional analysis from speech and video signal.
Solution timeline
Realization period - beginning
Jan 1, 2008
Realization period - end
Nov 30, 2010
Project status
U - Finished project
Latest support payment
Mar 1, 2010
Data delivery to CEP
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data delivery code
CEP11-MSM-OC-U/01:1
Data delivery date
Jun 30, 2011
Finance
Total approved costs
1,430 thou. CZK
Public financial support
1,430 thou. CZK
Other public sources
0 thou. CZK
Non public and foreign sources
0 thou. CZK
Recognised costs
1 430 CZK thou.
Public support
1 430 CZK thou.
0%
Provider
Ministry of Education, Youth and Sports
CEP
JA - Electronics and optoelectronics
Solution period
01. 01. 2008 - 30. 11. 2010