Pose and Facial Expression Transfer by using StyleGAN

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21230%2F24%3A00378115" target="_blank" >RIV/68407700:21230/24:00378115 - isvavai.cz</a>

Result on the web

—

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

Pose and Facial Expression Transfer by using StyleGAN

Original language description

We propose a method to transfer pose and expression between face images. Given a source and target face portrait, the model produces an output image in which the pose and expression of the source face image are transferred onto the target identity. The architecture consists of two encoders and a mapping network that projects the two inputs into the latent space of StyleGAN2, which finally generates the output. The training is self-supervised from video sequences of many individuals. Manual labeling is not required. Our model enables the synthesis of random identities with controllable pose and expression. Close-to-real-time performance is achieved.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

S - Specificky vyzkum na vysokych skolach

Publication year

2024

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Proceedings of the 27th Computer Vision Winter Workshop

ISBN

978-961-96564-0-2

ISSN

—

e-ISSN

—

Number of pages

10

Pages from-to

8-17

Publisher name

Slovenian Pattern Recognition Society

Place of publication

Ljubljana

Event location

Terme Olimia

Event date

Feb 14, 2024

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—