Bengali Visual Genome: A Multimodal Dataset for Machine Translation and Image Captioning
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F21%3A10456913" target="_blank" >RIV/00216208:11320/21:10456913 - isvavai.cz</a>
Result on the web
<a href="http://dx.doi.org/10.1007/978-981-16-6624-7_7" target="_blank" >http://dx.doi.org/10.1007/978-981-16-6624-7_7</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/978-981-16-6624-7_7" target="_blank" >10.1007/978-981-16-6624-7_7</a>
Alternative languages
Result language
angličtina
Original language name
Bengali Visual Genome: A Multimodal Dataset for Machine Translation and Image Captioning
Original language description
Multimodal machine translation (MMT) refers to the extraction of information from more than one modality aiming at performance improvement by utilizing information collected from the modalities other than pure text. The availability of multimodal datasets, particularly for Indian regional languages, is still limited, and thus, there is a need to build such datasets for regional languages to promote the state of MMT research. In this work, we describe the process of creation of the Bengali Visual Genome (BVG) dataset. The BVG is the first multimodal dataset consisting of text and images suitable for English-to-Bengali multimodal machine translation tasks and multimodal research. We also demonstrate the sample use-cases of machine translation and region-specific image captioning using the new BVG dataset. These results can be considered as the baseline for subsequent research.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
<a href="/en/project/GX19-26934X" target="_blank" >GX19-26934X: Neural Representations in Multi-modal and Multi-lingual Modeling</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2021
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
9th International Conference on Frontiers of Intelligent Computing: Theory and Applications (FICTA 2021)
ISBN
978-981-16-6624-7
ISSN
—
e-ISSN
—
Number of pages
8
Pages from-to
63-70
Publisher name
Springer Nature Singapore
Place of publication
Singapore
Event location
Mizoram, India
Event date
Jun 25, 2021
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—