Syntax Representation in Word Embeddings and Neural Networks - A Survey
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F20%3A10424473" target="_blank" >RIV/00216208:11320/20:10424473 - isvavai.cz</a>
Result on the web
<a href="https://ics.upjs.sk/~horvath/itat2020/paper16.pdf" target="_blank" >https://ics.upjs.sk/~horvath/itat2020/paper16.pdf</a>
DOI - Digital Object Identifier
—
Alternative languages
Result language
angličtina
Original language name
Syntax Representation in Word Embeddings and Neural Networks - A Survey
Original language description
Neural networks trained on natural language processing tasks capture syntax even though it is not provided as a supervision signal. This indicates that syntactic analysis is essential to the understating of language in artificial intelligence systems. This overview paper covers approaches of evaluating the amount of syntactic information included in the representations of words for different neural network architectures. We mainly summarize research on English monolingual data on language modeling tasks and multilingual data for neural machine translation systems and multilingual language models. We describe which pre-trained models and representations of language are best suited for transfer to syntactic tasks.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
<a href="/en/project/GA18-02196S" target="_blank" >GA18-02196S: Linguistic Structure Representation in Neural Networks</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2020
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Proceedings of the 20th Conference Information Technologies - Applications and Theory (ITAT 2020)
ISBN
—
ISSN
1613-0073
e-ISSN
—
Number of pages
11
Pages from-to
38-48
Publisher name
Tomáš Horváth
Place of publication
Košice, Slovakia
Event location
Oravská Lesná, Slovakia
Event date
Sep 18, 2020
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—