Asking Questions: an Innovative Way to Interact with Oral History Archives
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F49777513%3A23520%2F23%3A43969529" target="_blank" >RIV/49777513:23520/23:43969529 - isvavai.cz</a>
Result on the web
<a href="https://www.isca-speech.org/archive/interspeech_2023/svec23_interspeech.html" target="_blank" >https://www.isca-speech.org/archive/interspeech_2023/svec23_interspeech.html</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.21437/Interspeech.2023" target="_blank" >10.21437/Interspeech.2023</a>
Alternative languages
Result language
angličtina
Original language name
Asking Questions: an Innovative Way to Interact with Oral History Archives
Original language description
The paper describes our initial effort to use Transformer-based neural networks for understanding and presenting oral history archives. Such archives of interviews often contain large passages of the interviewee’s speech. Our approach automatically generates relevant questions, which enrich such monotonous parts and allows the listener to better orient in the interview. The generated questions also allow for finding interesting parts of the interview without changing the original meaning of the testimony. We present our working pipeline consisting of a Wav2Vec speech recognizer, BERT-based punctuation detection, T5 asking questions model and BERT-based semantic continuity model.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
20205 - Automation and control systems
Result continuities
Project
<a href="/en/project/GA22-27800S" target="_blank" >GA22-27800S: Transformers of multiple modalities for more natural spoken dialog</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2023
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
ISBN
—
ISSN
2308-457X
e-ISSN
—
Number of pages
2
Pages from-to
3679-3680
Publisher name
International Speech Communication Association
Place of publication
New York
Event location
Dublin, Ireland
Event date
Aug 20, 2023
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—