Sub-Frame Appearance and 6D Pose Estimation of Fast Moving Objects

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21230%2F20%3A00345872" target="_blank" >RIV/68407700:21230/20:00345872 - isvavai.cz</a>

Výsledek na webu

<a href="https://doi.org/10.1109/CVPR42600.2020.00681" target="_blank" >https://doi.org/10.1109/CVPR42600.2020.00681</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1109/CVPR42600.2020.00681" target="_blank" >10.1109/CVPR42600.2020.00681</a>

Jazyk výsledku

angličtina

Název v původním jazyce

Sub-Frame Appearance and 6D Pose Estimation of Fast Moving Objects

Popis výsledku v původním jazyce

We propose a novel method that tracks fast moving objects, mainly non-uniform spherical, in full 6 degrees of freedom, estimating simultaneously their 3D motion trajectory, 3D pose and object appearance changes with a time step that is a fraction of the video frame exposure time. The sub-frame object localization and appearance estimation allows realistic temporal super-resolution and precise shape estimation. The method, called TbD-3D (Tracking by Deblatting in 3D) relies on a novel reconstruction algorithm which solves a piece-wise deblurring and matting problem. The 3D rotation is estimated by minimizing the reprojection error. As a second contribution, we present a new challenging dataset with fast moving objects that change their appearance and distance to the camera. High-speed camera recordings with zero lag between frame exposures were used to generate videos with different frame rates annotated with ground-truth trajectory and pose.

Název v anglickém jazyce

Sub-Frame Appearance and 6D Pose Estimation of Fast Moving Objects

Popis výsledku anglicky

We propose a novel method that tracks fast moving objects, mainly non-uniform spherical, in full 6 degrees of freedom, estimating simultaneously their 3D motion trajectory, 3D pose and object appearance changes with a time step that is a fraction of the video frame exposure time. The sub-frame object localization and appearance estimation allows realistic temporal super-resolution and precise shape estimation. The method, called TbD-3D (Tracking by Deblatting in 3D) relies on a novel reconstruction algorithm which solves a piece-wise deblurring and matting problem. The 3D rotation is estimated by minimizing the reprojection error. As a second contribution, we present a new challenging dataset with fast moving objects that change their appearance and distance to the camera. High-speed camera recordings with zero lag between frame exposures were used to generate videos with different frame rates annotated with ground-truth trajectory and pose.

Druh

D - Stať ve sborníku

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

<a href="/cs/project/GA18-05360S" target="_blank" >GA18-05360S: Řešení inverzních problémů vznikajících při analýze rychle se pohybujících objektů</a><br>

Návaznosti

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Rok uplatnění

2020

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Název statě ve sborníku

2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition

ISBN

978-1-7281-7168-5

ISSN

1063-6919

e-ISSN

2575-7075

Počet stran výsledku

9

Strana od-do

6777-6785

Název nakladatele

IEEE Computer Society

Místo vydání

USA

Místo konání akce

Seattle

Datum konání akce

13. 6. 2020

Typ akce podle státní příslušnosti

WRD - Celosvětová akce

Kód UT WoS článku

000620679507006