Multimodal and multilingual communication with computer
Project goals
Research area of multimodal and multilingual speech processing and recognition will be explored in this project. These tasks are addressed in international COST 2102 action ?Cross-Modal Analysis of Verbal and Non-verbal Communication? and our research team has been invited to this action. Multimodal and multilingual speech processing and recognition belongs to perspective areas of modern voice technologies at present. A visual signal is processed and recognized together with audio signal in multimodal voice technologies and it is able to improve recognition score namely in noise conditions or it is able to bring new information in audio-visual speech signal evaluation. The importance of multilingual systems is emphased by the possibility of utilizationfor less frequent languages.
Keywords
Public support
Provider
Ministry of Education, Youth and Sports
Programme
COST
Call for proposals
COST 7 (SMSM2009OC4)
Main participants
—
Contest type
VS - Public tender
Contract ID
1147/2010-32
Alternative language
Project name in Czech
Multimodální a multilinguální komunikace s počítačem
Annotation in Czech
Hlavními cíli tohoto projektu je základní výzkumu v oblasti multimodální komunikace s počítačem, audio-vizuálního zpracování televizních pořadů a řešení problematiky efektivního převodu vyvíjených systémů rozpoznávání řeči pro jiné národní jazyky.
Scientific branches
R&D category
ZV - Basic research
CEP classification - main branch
JD - Use of computers, robotics and its application
CEP - secondary branch
IN - Informatics
CEP - another secondary branch
—
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
20204 - Robotics and automatic control
20205 - Automation and control systems
Completed project evaluation
Provider evaluation
V - Vynikající výsledky projektu (s mezinárodním významem atd.)
Project results evaluation
The developed prototypes : 1) audio-visual voice dialogue system, 2) system artificial interpreter, 3) system for automatic audio-visual collection, annotation and indexing of TV broadcast, 4) system for computer voice dictation in Slovak language
Solution timeline
Realization period - beginning
Apr 1, 2009
Realization period - end
Nov 30, 2010
Project status
U - Finished project
Latest support payment
Mar 1, 2010
Data delivery to CEP
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data delivery code
CEP11-MSM-OC-U/01:1
Data delivery date
Jun 30, 2011
Finance
Total approved costs
680 thou. CZK
Public financial support
680 thou. CZK
Other public sources
0 thou. CZK
Non public and foreign sources
0 thou. CZK
Recognised costs
680 CZK thou.
Public support
680 CZK thou.
0%
Provider
Ministry of Education, Youth and Sports
CEP
JD - Use of computers, robotics and its application
Solution period
01. 04. 2009 - 30. 11. 2010