Pose consistency KKT-loss for weakly supervised learning of robot-terrain interaction model

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21230%2F21%3A00350149" target="_blank" >RIV/68407700:21230/21:00350149 - isvavai.cz</a>

Result on the web

<a href="https://doi.org/10.1109/LRA.2021.3076957" target="_blank" >https://doi.org/10.1109/LRA.2021.3076957</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1109/LRA.2021.3076957" target="_blank" >10.1109/LRA.2021.3076957</a>

Result language

angličtina

Original language name

Pose consistency KKT-loss for weakly supervised learning of robot-terrain interaction model

Original language description

We address the problem of self-supervised learning for predicting the shape of supporting terrain (i.e. the terrain which will provide rigid support for the robot during its traversal) from sparse input measurements. The learning method exploits two types of ground-truth labels: dense 2.5D maps and robot poses, both estimated by a usual SLAM procedure from offline recorded measurements. We show that robot poses are required because straightforward supervised learning from the 3D maps only suffers from: (i) exaggerated height of the supporting terrain caused by terrain flexibility (vegetation, shallow water, snow or sand) and (ii) missing or noisy measurements caused by high spectral absorbance or non-Lambertian reflectance of the measured surface. We address the learning from robot poses by introducing a novel KKT-loss, which emerges as the distance from necessary Karush-Kuhn-Tucker conditions for constrained local optima of a simplified first-principle model of the robot-terrain interaction. We experimentally verify that the proposed weakly supervised learning from ground-truth robot poses boosts the accuracy of predicted support heightmaps and increases the accuracy of estimated robot poses. All experiments are conducted on a dataset captured by a real platform. Both the dataset and codes which replicates experiments in the paper are made publicly available as a part of the submission.

Czech name

—

Czech description

—

Type

J_imp - Article in a specialist periodical, which is included in the Web of Science database

CEP classification

—

OECD FORD branch

20204 - Robotics and automatic control

Project

Result was created during the realization of more than one project. More information in the Projects tab.

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Publication year

2021

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

IEEE Robotics and Automation Letters

ISSN

2377-3766

e-ISSN

2377-3766

Volume of the periodical

6

Issue of the periodical within the volume

3

Country of publishing house

US - UNITED STATES

Number of pages

8

Pages from-to

5477-5484

UT code for WoS article

000652782200001

EID of the result in the Scopus database

2-s2.0-85105035385