Visual Geo-Localization and Camera Pose Estimation in Natural Environments

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216305%3A26230%2F26%3A0201826" target="_blank" >RIV/00216305:26230/26:0201826 - isvavai.cz</a>

Result on the web

<a href="https://www.vut.cz/vutium/spisy?action=ukazka&id=2367&publikace_id=19481" target="_blank" >https://www.vut.cz/vutium/spisy?action=ukazka&id=2367&publikace_id=19481</a>

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

Visual Geo-Localization and Camera Pose Estimation in Natural Environments

Original language description

This thesis presents my work, along with the contributions of my research group CPhoto@FIT, on the challenging task of visual geo-localization and camera pose estimation in natural environments. The primary objective is to determine the geographical position and orientation of a camera using visual information from captured images. Natural environments, characterized by irregular landscapes, self-similar features, and sparse datasets, pose unique challenges compared to more structured settings, such as urban areas. We developed novel methods for camera orientation and pose estimation, utilizing techniques such as silhouette edge matching, semantic cues, line correspondences, and cascaded attention mechanisms. To support training and evaluation in outdoor localization tasks, we introduced three datasets—GeoPose3K, Alps100K, and CrossLocate. These datasets provide a diverse range of visual and synthetic modalities, including semantic segmentation, depth maps, and silhouette maps. Additionally, we contributed to skyline (horizon line) detection, a critical component of outdoor geo-localization techniques. We further contributed by proposing two complementary approaches to image geo-localization in natural environments. The first method is specifically designed for scenarios with extensive coverage of community-contributed photographs, ensuring high localization accuracy in such regions. In contrast, the second approach, which relies on image retrieval from a synthetic database, offers a groundbreaking solution by enabling global operation, irrespective of the availability of community photographs. Finally, we explored applications of visual geo-localization in areas such as augmented reality, automatic label placement, and depth map estimation. The methods presented in this work achieve state-of-the-art performance across various benchmarks and real-world scenarios.

Czech name

—

Czech description

—

Type

O - Miscellaneous

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

<a href="/en/project/LTAIZ19004" target="_blank" >LTAIZ19004: Deep-Learning Approach to Topographical Image Analysis</a><br>

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2025

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů