Performance Evaluation of Objective Quality Assessment Methods for Omnidirectional Images Under Emerging Compressions

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216305%3A26220%2F24%3APU152522" target="_blank" >RIV/00216305:26220/24:PU152522 - isvavai.cz</a>

Nalezeny alternativní kódy

RIV/68407700:21230/24:00377813

Výsledek na webu

<a href="https://ieeexplore.ieee.org/document/10714248" target="_blank" >https://ieeexplore.ieee.org/document/10714248</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1109/ACCESS.2024.3478793" target="_blank" >10.1109/ACCESS.2024.3478793</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Performance Evaluation of Objective Quality Assessment Methods for Omnidirectional Images Under Emerging Compressions

Popis výsledku v původním jazyce

This paper presents a unique study of objective and subjective image quality assessment (IQA) of 360 degrees images, distorted by emerging and legacy compressions - AV1 Image File Format (AVIF), Joint Photographic Experts Group (JPEG), High Efficiency Image File Format (HEIC), JPEG XL from the cross-lab experiments carried out by two universities. The performance evaluation of objective conventional IQA methods relied on statistical data analysis employing not only traditional approaches with correlation coefficients but also advanced techniques such as Receiver Operating Characteristic (ROC) analysis, which offers several statistical advantages. The comprehensive statistical examination presented, utilizing an outcome from the subjective experiment with 66 observers, confirmed that the performance of specific IQA metrics depends not only on the image features but also on the applied image compression algorithm. Overall, the study examined nine IQA objective metrics. For instance, when evaluating distortion caused by the AVIF and HEIC codecs, the Multi-Scale Structural Similarity (MS-SSIM) metric exhibited the best performance, while the Feature Similarity chrominance (FSIMc) metric excelled in assessing JPEG-based compressions. Additionally, detailed outcomes of the subjective experiments, including eye-tracking data, are available in a public dataset. This study provides previously unexplored insights into the performance of conventional objective metrics for 360 degrees images degraded by emerging image codecs. The presented results suggest suitable metrics for specific application scenarios (codecs) and, along with the dataset, lay the groundwork for further research on new objective quality assessment methods for omnidirectional images under emerging compressions.

Název v anglickém jazyce

Performance Evaluation of Objective Quality Assessment Methods for Omnidirectional Images Under Emerging Compressions

Popis výsledku anglicky

This paper presents a unique study of objective and subjective image quality assessment (IQA) of 360 degrees images, distorted by emerging and legacy compressions - AV1 Image File Format (AVIF), Joint Photographic Experts Group (JPEG), High Efficiency Image File Format (HEIC), JPEG XL from the cross-lab experiments carried out by two universities. The performance evaluation of objective conventional IQA methods relied on statistical data analysis employing not only traditional approaches with correlation coefficients but also advanced techniques such as Receiver Operating Characteristic (ROC) analysis, which offers several statistical advantages. The comprehensive statistical examination presented, utilizing an outcome from the subjective experiment with 66 observers, confirmed that the performance of specific IQA metrics depends not only on the image features but also on the applied image compression algorithm. Overall, the study examined nine IQA objective metrics. For instance, when evaluating distortion caused by the AVIF and HEIC codecs, the Multi-Scale Structural Similarity (MS-SSIM) metric exhibited the best performance, while the Feature Similarity chrominance (FSIMc) metric excelled in assessing JPEG-based compressions. Additionally, detailed outcomes of the subjective experiments, including eye-tracking data, are available in a public dataset. This study provides previously unexplored insights into the performance of conventional objective metrics for 360 degrees images degraded by emerging image codecs. The presented results suggest suitable metrics for specific application scenarios (codecs) and, along with the dataset, lay the groundwork for further research on new objective quality assessment methods for omnidirectional images under emerging compressions.

Druh

J_imp - Článek v periodiku v databázi Web of Science

CEP obor

—

OECD FORD obor

20202 - Communication engineering and systems

Projekt

<a href="/cs/project/LTT20004" target="_blank" >LTT20004: Spolupráce s mezinárodním výzkumným centrem v oblasti digitálních komunikačních systémů</a><br>

Návaznosti

S - Specificky vyzkum na vysokych skolach

Rok uplatnění

2024

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název periodika

IEEE Access

ISSN

2169-3536

e-ISSN

—

Svazek periodika

12

Číslo periodika v rámci svazku

10

Stát vydavatele periodika

US - Spojené státy americké

Počet stran výsledku

11

Strana od-do

150419-150429

Kód UT WoS článku

001340684200001

EID výsledku v databázi Scopus

2-s2.0-85207622738