Sub-Frame Appearance and 6D Pose Estimation of Fast Moving Objects

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F67985556%3A_____%2F20%3A00533751" target="_blank" >RIV/67985556:_____/20:00533751 - isvavai.cz</a>

Výsledek na webu

<a href="http://dx.doi.org/10.1109/CVPR42600.2020.00681" target="_blank" >http://dx.doi.org/10.1109/CVPR42600.2020.00681</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1109/CVPR42600.2020.00681" target="_blank" >10.1109/CVPR42600.2020.00681</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Sub-Frame Appearance and 6D Pose Estimation of Fast Moving Objects

Popis výsledku v původním jazyce

We have proposed a method for sub-frame appearance and 6D pose estimation of fast moving objects. We propose a novel method that tracks fast moving objects, mainly non-uniform spherical, in full 6 degrees of freedom, estimating simultaneously their 3D motion trajectory, 3D pose and object appearance changes with a time step that is a fraction of the video frame exposure time. The sub-frame object localization and appearance estimation allows realistic temporal super-resolution and precise shape estimation. The method, called TbD-3D (Tracking by Deblatting in 3D) relies on a novel reconstruction algorithm which solves a piece-wise deblurring and matting problem. The 3D rotation is estimated by minimizing the reprojection error. As a second contribution, we present a new challenging dataset with fast moving objects that change their appearance and distance to the camera. High-speed camera recordings with zero lag between frame exposures were used to generate videos with different frame rates annotated with ground-truth trajectory and pose.

Název v anglickém jazyce

Sub-Frame Appearance and 6D Pose Estimation of Fast Moving Objects

Popis výsledku anglicky

We have proposed a method for sub-frame appearance and 6D pose estimation of fast moving objects. We propose a novel method that tracks fast moving objects, mainly non-uniform spherical, in full 6 degrees of freedom, estimating simultaneously their 3D motion trajectory, 3D pose and object appearance changes with a time step that is a fraction of the video frame exposure time. The sub-frame object localization and appearance estimation allows realistic temporal super-resolution and precise shape estimation. The method, called TbD-3D (Tracking by Deblatting in 3D) relies on a novel reconstruction algorithm which solves a piece-wise deblurring and matting problem. The 3D rotation is estimated by minimizing the reprojection error. As a second contribution, we present a new challenging dataset with fast moving objects that change their appearance and distance to the camera. High-speed camera recordings with zero lag between frame exposures were used to generate videos with different frame rates annotated with ground-truth trajectory and pose.

Druh

D - Stať ve sborníku

CEP obor

—

OECD FORD obor

20206 - Computer hardware and architecture

Projekt

<a href="/cs/project/GA18-05360S" target="_blank" >GA18-05360S: Řešení inverzních problémů vznikajících při analýze rychle se pohybujících objektů</a><br>

Návaznosti

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Rok uplatnění

2020

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název statě ve sborníku

2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

ISBN

978-1-7281-7169-2

ISSN

1063-6919

e-ISSN

2575-7075

Počet stran výsledku

9

Strana od-do

6777-6785

Název nakladatele

IEEE

Místo vydání

Piscataway

Místo konání akce

Seattle

Datum konání akce

16. 6. 2020

Typ akce podle státní příslušnosti

WRD - Celosvětová akce

Kód UT WoS článku

—