Light Field Video Streaming on GPU

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216305%3A26230%2F26%3A0198106" target="_blank" >RIV/00216305:26230/26:0198106 - isvavai.cz</a>

Výsledek na webu

<a href="https://www.sciencedirect.com/science/article/pii/S0923596525001237" target="_blank" >https://www.sciencedirect.com/science/article/pii/S0923596525001237</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1016/j.image.2025.117377" target="_blank" >10.1016/j.image.2025.117377</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Light Field Video Streaming on GPU

Popis výsledku v původním jazyce

This paper proposes an efficient encoding method for light field video rendering in real time. Each frame of the light field video consists of a grid of images capturing the scene from different camera positions. The images are encoded by a video compression algorithm. The positions of the keyframes on the grid are automatically determined. The proposed compression uses GPU-accelerated HW video decoders. Data transfer between the host and the GPU memory is minimal. Only the packets necessary for the novel view synthesis are transferred. Standard video compression methods need to decode all packets between keyframes, and other existing light field compression methods focus solely on the best compression ratio. The proposed method outperforms them in the quality/decoding time ratio, which is the most important metric for the real-time rendering. The results presented show that currently existing alternatives cannot be used efficiently for 4K light field video streaming. A proof-of-concept light field player was implemented and is available to use. The proposal solves the memory and streaming requirements that are the most crucial issues in light field rendering. The paper additionally outlines enhancements to a current light field rendering technique, which has been modified to integrate effectively with the newly proposed encoding method.

Název v anglickém jazyce

Light Field Video Streaming on GPU

Popis výsledku anglicky

This paper proposes an efficient encoding method for light field video rendering in real time. Each frame of the light field video consists of a grid of images capturing the scene from different camera positions. The images are encoded by a video compression algorithm. The positions of the keyframes on the grid are automatically determined. The proposed compression uses GPU-accelerated HW video decoders. Data transfer between the host and the GPU memory is minimal. Only the packets necessary for the novel view synthesis are transferred. Standard video compression methods need to decode all packets between keyframes, and other existing light field compression methods focus solely on the best compression ratio. The proposed method outperforms them in the quality/decoding time ratio, which is the most important metric for the real-time rendering. The results presented show that currently existing alternatives cannot be used efficiently for 4K light field video streaming. A proof-of-concept light field player was implemented and is available to use. The proposal solves the memory and streaming requirements that are the most crucial issues in light field rendering. The paper additionally outlines enhancements to a current light field rendering technique, which has been modified to integrate effectively with the newly proposed encoding method.

Druh

J_imp - Článek v periodiku v databázi Web of Science

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

—

Návaznosti

S - Specificky vyzkum na vysokych skolach

Rok uplatnění

2025

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

SIGNAL PROCESSING-IMAGE COMMUNICATION

ISSN

0923-5965

e-ISSN

1879-2677

Svazek periodika

2025

Číslo periodika v rámci svazku

138

Stát vydavatele periodika

NL - Nizozemsko

Počet stran výsledku

12

Strana od-do

0-0

Kód UT WoS článku

001566258400001

EID výsledku v databázi Scopus

2-s2.0-105008990839