Codec-Based Deepfake Source Tracing via Neural Audio Codec Taxonomy

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216305%3A26230%2F26%3A0199995" target="_blank" >RIV/00216305:26230/26:0199995 - isvavai.cz</a>

Result on the web

<a href="https://www.isca-archive.org/interspeech_2025/chen25j_interspeech.pdf" target="_blank" >https://www.isca-archive.org/interspeech_2025/chen25j_interspeech.pdf</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.21437/Interspeech.2025-1297" target="_blank" >10.21437/Interspeech.2025-1297</a>

Result language

angličtina

Original language name

Codec-Based Deepfake Source Tracing via Neural Audio Codec Taxonomy

Original language description

Recent advances in neural audio codec-based speech generation (CoSG) models have produced remarkably realistic audio deepfakes. We refer to deepfake speech generated by CoSG systems as codec-based deepfake, or CodecFake. Although existing anti-spoofing research on CodecFake predominantly focuses on verifying the authenticity of audio samples, almost no attention was given to tracing the CoSG used in generating these deepfakes. In CodecFake generation, processes such as speech-to-unit encoding, discrete unit modeling, and unit-to-speech decoding are fundamentally based on neural audio codecs. Motivated by this, we introduce source tracing for CodecFake via neural audio codec taxonomy, which dissects neural audio codecs to trace CoSG. Our experimental results on the CodecFake+ dataset provide promising initial evidence for the feasibility of CodecFake source tracing while also highlighting several challenges that warrant further investigation.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

S - Specificky vyzkum na vysokych skolach

Publication year

2025

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Proceedings of the Annual Conference of the International Speech Communication Association Interspeech

ISBN

—

ISSN

—

e-ISSN

2958-1796

Number of pages

5

Pages from-to

1538-1542

Publisher name

International Speech Communication Association

Place of publication

Rotterdam, Nizozemí

Event location

Rotterdam

Event date

Aug 17, 2025

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—