Multi-modal dialogue system with sign language capabilities
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F49777513%3A23520%2F11%3A43898198" target="_blank" >RIV/49777513:23520/11:43898198 - isvavai.cz</a>
Result on the web
<a href="http://dx.doi.org/10.1145/2049536.2049599" target="_blank" >http://dx.doi.org/10.1145/2049536.2049599</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1145/2049536.2049599" target="_blank" >10.1145/2049536.2049599</a>
Alternative languages
Result language
angličtina
Original language name
Multi-modal dialogue system with sign language capabilities
Original language description
This paper presents the design of a multimodal sign-language-enabled dialogue system. Its functionality was tested on a prototype of an information kiosk for the deaf people providing information about train connections. We use an automatic computer-vision-based sign language recognition, automatic speech recognition and touchscreen as input modalities. The outputs are shown on a screen displaying 3D signing avatar and on a touchscreen displaying graphical user interface. The information kiosk can be used both by hearing users and deaf users in several languages. We focus on description of sign language input and output modality.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
JD - Use of computers, robotics and its application
OECD FORD branch
—
Result continuities
Project
Result was created during the realization of more than one project. More information in the Projects tab.
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2011
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
ASSETS'11: Proceedings of the 13th international ACM SIGACCESS Conference on Computers and Accessibility
ISBN
978-1-4503-0919-6
ISSN
—
e-ISSN
—
Number of pages
2
Pages from-to
265-266
Publisher name
Association for Computing Machinery (ACM)
Place of publication
New York
Event location
Dundee, Scotland
Event date
Oct 24, 2011
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
000304018900052