Assessing the Human Ability to Recognize Synthetic Speech in Ordinary Conversation

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216305%3A26230%2F23%3APU149413" target="_blank" >RIV/00216305:26230/23:PU149413 - isvavai.cz</a>

Result on the web

<a href="https://ieeexplore.ieee.org/document/10346006" target="_blank" >https://ieeexplore.ieee.org/document/10346006</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1109/BIOSIG58226.2023.10346006" target="_blank" >10.1109/BIOSIG58226.2023.10346006</a>

Result language

angličtina

Original language name

Assessing the Human Ability to Recognize Synthetic Speech in Ordinary Conversation

Original language description

This work assesses the human ability to recognize synthetic speech (deepfake). This paper describes an experiment in which we communicated with respondents using voice messages. We presented the respondents with a cover story about testing the user-friendliness of voice messages while secretly sending them a pre-prepared deep fake recording during the conversation. We examined their reactions, knowledge of deepfakes, or how many could correctly identify which message was deepfake. The results show that none of the respondents reacted in any way to the fraudulent deepfake message, and only one retrospectively admitted to noticing something specific. On the other hand, a voicemail message that contained a deepfake was correctly identified by 83.9% of respondents after revealing the nature of the experiment. Thus, the results show that although the deepfake recording was clearly identifiable among others, no one reacted to it. In summary, we show that the human ability to recognize voice deepfakes is not at a level we can trust. It is very difficult for people to distinguish between real and fake voices, especially if they do not expect them.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

S - Specificky vyzkum na vysokych skolach

Publication year

2023

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

2023 International Conference of the Biometrics Special Interest Group (BIOSIG)

ISBN

978-3-88579-733-3

ISSN

—

e-ISSN

—

Number of pages

5

Pages from-to

1-5

Publisher name

GI - Group for computer science

Place of publication

Darmstadt

Event location

Darmstadt

Event date

Sep 20, 2023

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—