Visual Geo-Localization and Camera Pose Estimation in Natural Environments

Kód výsledku v IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216305%3A26230%2F26%3A0201826" target="_blank" >RIV/00216305:26230/26:0201826 - isvavai.cz</a>

Výsledek na webu

<a href="https://www.vut.cz/vutium/spisy?action=ukazka&id=2367&publikace_id=19481" target="_blank" >https://www.vut.cz/vutium/spisy?action=ukazka&id=2367&publikace_id=19481</a>

DOI - Digital Object Identifier

—

Jazyk výsledku

angličtina

Název v původním jazyce

Visual Geo-Localization and Camera Pose Estimation in Natural Environments

Popis výsledku v původním jazyce

This thesis presents my work, along with the contributions of my research group CPhoto@FIT, on the challenging task of visual geo-localization and camera pose estimation in natural environments. The primary objective is to determine the geographical position and orientation of a camera using visual information from captured images. Natural environments, characterized by irregular landscapes, self-similar features, and sparse datasets, pose unique challenges compared to more structured settings, such as urban areas. We developed novel methods for camera orientation and pose estimation, utilizing techniques such as silhouette edge matching, semantic cues, line correspondences, and cascaded attention mechanisms. To support training and evaluation in outdoor localization tasks, we introduced three datasets—GeoPose3K, Alps100K, and CrossLocate. These datasets provide a diverse range of visual and synthetic modalities, including semantic segmentation, depth maps, and silhouette maps. Additionally, we contributed to skyline (horizon line) detection, a critical component of outdoor geo-localization techniques. We further contributed by proposing two complementary approaches to image geo-localization in natural environments. The first method is specifically designed for scenarios with extensive coverage of community-contributed photographs, ensuring high localization accuracy in such regions. In contrast, the second approach, which relies on image retrieval from a synthetic database, offers a groundbreaking solution by enabling global operation, irrespective of the availability of community photographs. Finally, we explored applications of visual geo-localization in areas such as augmented reality, automatic label placement, and depth map estimation. The methods presented in this work achieve state-of-the-art performance across various benchmarks and real-world scenarios.

Název v anglickém jazyce

Visual Geo-Localization and Camera Pose Estimation in Natural Environments

Popis výsledku anglicky

This thesis presents my work, along with the contributions of my research group CPhoto@FIT, on the challenging task of visual geo-localization and camera pose estimation in natural environments. The primary objective is to determine the geographical position and orientation of a camera using visual information from captured images. Natural environments, characterized by irregular landscapes, self-similar features, and sparse datasets, pose unique challenges compared to more structured settings, such as urban areas. We developed novel methods for camera orientation and pose estimation, utilizing techniques such as silhouette edge matching, semantic cues, line correspondences, and cascaded attention mechanisms. To support training and evaluation in outdoor localization tasks, we introduced three datasets—GeoPose3K, Alps100K, and CrossLocate. These datasets provide a diverse range of visual and synthetic modalities, including semantic segmentation, depth maps, and silhouette maps. Additionally, we contributed to skyline (horizon line) detection, a critical component of outdoor geo-localization techniques. We further contributed by proposing two complementary approaches to image geo-localization in natural environments. The first method is specifically designed for scenarios with extensive coverage of community-contributed photographs, ensuring high localization accuracy in such regions. In contrast, the second approach, which relies on image retrieval from a synthetic database, offers a groundbreaking solution by enabling global operation, irrespective of the availability of community photographs. Finally, we explored applications of visual geo-localization in areas such as augmented reality, automatic label placement, and depth map estimation. The methods presented in this work achieve state-of-the-art performance across various benchmarks and real-world scenarios.

Druh

O - Ostatní výsledky

CEP obor

—

OECD FORD obor

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Projekt

<a href="/cs/project/LTAIZ19004" target="_blank" >LTAIZ19004: Topografická analýza obrazu s využitím metod hlubokého učení</a><br>

Návaznosti

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Rok uplatnění

2025

Kód důvěrnosti údajů

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů