Temporal HDR Tone Mapping IP Core

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216305%3A26230%2F22%3APR37602" target="_blank" >RIV/00216305:26230/22:PR37602 - isvavai.cz</a>

Výsledek na webu

<a href="https://www.fit.vut.cz/research/product/771/" target="_blank" >https://www.fit.vut.cz/research/product/771/</a>

DOI - Digital Object Identifier

—

Jazyk výsledku

angličtina

Název v původním jazyce

Temporal HDR Tone Mapping IP Core

Popis výsledku v původním jazyce

This component is part of Comp4Drones Component Repository. Module provides a video processing module that converts RGB images captured by a drone into tone-mapped high dynamic range (HDR) video streams. The component is implemented for Xilinx FPGA  and can read data from a camera sensor, merge multiple images with alternating exposures into HDR images or HDR video, and apply HDR tone mapping. The system is also capable of image pre-processing, exposure control, and "ghost-free" function to remove possible artifacts caused by the movement of objects. The component is divided into four main blocks: Sensor data acquisition, Buffering, HDR merging and deghosting, and HDR tone mapping. The architecture is based on the Xilinx Zynq platform and is connected to the Python 2000 CMOS sensor using LVDS interface. The CMOS output is raw CFA image data with a Bayer filter mosaic, which is stored in DDR memory using DMA and double buffering. The HDR merge block reads three image streams simultaneously and applies an inverse camera response function to obtain an image with a linear response and merge HDR image. The merging algorithm performs per-pixel processing, which requires a relatively small number of per-pixel operations. The HDR tone mapping pipeline is implemented in FPGA and pipelined at 200MHz while processing one pixel per clock. The input of the tone mapping block is 18-bit CFA pixel in 10.8 fixed-point representation, and the output is an RGB pixel in the <0,1> interval. The algorithm is based on the Durand and Dorsey tone mapping operator, which is a two-pass algorithm. However, due to limited memory size, the implementation only computes minimum and maximum values (or percentiles) of the base layer. This component is designed to support data acquisition for further processing in the FPGA or in the following systems. It provides acquired data in HDR or tone-mapped format and can be extended with other data analytics tools/algorithms such as

Název v anglickém jazyce

Temporal HDR Tone Mapping IP Core

Popis výsledku anglicky

This component is part of Comp4Drones Component Repository. Module provides a video processing module that converts RGB images captured by a drone into tone-mapped high dynamic range (HDR) video streams. The component is implemented for Xilinx FPGA  and can read data from a camera sensor, merge multiple images with alternating exposures into HDR images or HDR video, and apply HDR tone mapping. The system is also capable of image pre-processing, exposure control, and "ghost-free" function to remove possible artifacts caused by the movement of objects. The component is divided into four main blocks: Sensor data acquisition, Buffering, HDR merging and deghosting, and HDR tone mapping. The architecture is based on the Xilinx Zynq platform and is connected to the Python 2000 CMOS sensor using LVDS interface. The CMOS output is raw CFA image data with a Bayer filter mosaic, which is stored in DDR memory using DMA and double buffering. The HDR merge block reads three image streams simultaneously and applies an inverse camera response function to obtain an image with a linear response and merge HDR image. The merging algorithm performs per-pixel processing, which requires a relatively small number of per-pixel operations. The HDR tone mapping pipeline is implemented in FPGA and pipelined at 200MHz while processing one pixel per clock. The input of the tone mapping block is 18-bit CFA pixel in 10.8 fixed-point representation, and the output is an RGB pixel in the <0,1> interval. The algorithm is based on the Durand and Dorsey tone mapping operator, which is a two-pass algorithm. However, due to limited memory size, the implementation only computes minimum and maximum values (or percentiles) of the base layer. This component is designed to support data acquisition for further processing in the FPGA or in the following systems. It provides acquired data in HDR or tone-mapped format and can be extended with other data analytics tools/algorithms such as

Druh

R - Software

CEP obor

—

OECD FORD obor

20206 - Computer hardware and architecture

Projekt

<a href="/cs/project/8A19003" target="_blank" >8A19003: Framework of key enabling technologies for safe and autonomous drones' applications</a><br>

Návaznosti

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Rok uplatnění

2022

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Interní identifikační kód produktu

Temporal HDR TMO IP-Core

Technické parametry

Pro informace o technických parametrech prosím kontaktujte: Výzkumné centrum informačních technologií, Fakulta informačních technologií VUT v Brně, Božetěchova 2, 612 00 Brno, 541 141 270.

Ekonomické parametry

Produkt se poskytuje zdarma pro výzkum a komerčně za poplatek na základě licenční smlouvy.

IČO vlastníka výsledku

00216305

Název vlastníka

Vysoké učení technické v Brně