Let It Flow: Simultaneous Optimization of 3D Flow and Object Clustering

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21230%2F25%3A00376833" target="_blank" >RIV/68407700:21230/25:00376833 - isvavai.cz</a>

Result on the web

<a href="https://doi.org/10.1109/TIV.2024.3443316" target="_blank" >https://doi.org/10.1109/TIV.2024.3443316</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1109/TIV.2024.3443316" target="_blank" >10.1109/TIV.2024.3443316</a>

Result language

angličtina

Original language name

Let It Flow: Simultaneous Optimization of 3D Flow and Object Clustering

Original language description

We study the problem of self-supervised 3D scene flow estimation from real large-scale raw point cloud sequences. The problem is crucial to various automotive tasks like trajectory prediction, object detection, and scene reconstruction. In the absence of ground truth scene flow labels, contemporary approaches concentrate on deducing and optimizing flow across sequential pairs of point clouds by incorporating structure-based regularization on flow and object rigidity. The rigid objects are estimated by a variety of 3D spatial clustering methods. While state-of-the-art methods successfully capture overall scene motion using the Neural Prior structure, they encounter challenges in discerning multi-object motions. We identified the structural constraints and the use of large and strict rigid clusters as the main pitfall of the current approaches, and we propose a novel clustering approach that allows for a combination of overlapping soft clusters and non-overlapping rigid clusters. Flow is then jointly estimated with progressively growing non-overlapping rigid clusters together with fixed-size overlapping soft clusters. We evaluate our method on multiple datasets with LiDAR point clouds, demonstrating superior performance over the self-supervised baselines and reaching new state-of-the-art results. Our method excels in resolving flow in complicated dynamic scenes with multiple independently moving objects close to each other, including pedestrians, cyclists, and other vulnerable road users. Our codes are publicly available on https://github.com/ctu-vras/let-it-flow

Czech name

—

Czech description

—

Type

J_SC - Article in a specialist periodical, which is included in the SCOPUS database

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

Result was created during the realization of more than one project. More information in the Projects tab.

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Publication year

2025

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

IEEE Transactions on Intelligent Vehicles

ISSN

2379-8858

e-ISSN

2379-8904

Volume of the periodical

10

Issue of the periodical within the volume

3

Country of publishing house

US - UNITED STATES

Number of pages

9

Pages from-to

2094-2102

UT code for WoS article

—

EID of the result in the Scopus database

2-s2.0-105013517823