Learning multi-level graph attentional representation for thermal infrared object tracking

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F62690094%3A18470%2F25%3A50022608" target="_blank" >RIV/62690094:18470/25:50022608 - isvavai.cz</a>

Result on the web

<a href="https://www.sciencedirect.com/science/article/pii/S0952197625009571?via%3Dihub" target="_blank" >https://www.sciencedirect.com/science/article/pii/S0952197625009571?via%3Dihub</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1016/j.engappai.2025.110957" target="_blank" >10.1016/j.engappai.2025.110957</a>

Result language

angličtina

Original language name

Learning multi-level graph attentional representation for thermal infrared object tracking

Original language description

Thermal infrared (TIR) object tracking is a fundamental task in computer vision that is not affected by changes in lighting conditions. It performs better than visible light trackers in extreme environments such as nighttime, heavy rain, haze, and sandstorms. However, TIR object tracking also faces challenges such as occlusion, thermal crossover, motion blur, and similarity interference. Unlike visual tracking, TIR images lack color information and texture features. These factors make it challenging to learn detailed and shape features of the targets, making it hard to distinguish between targets and interference effectively. In this study, we propose a graph-based deep learning model, SiamMLGR, within the Siamese framework for stable TIR object tracking to address these issues. Specifically, to extract more fine-grained features of TIR targets, we propose a multiple graph attention module (MGAM) to replace the global matching information transmission method in the Siamese framework. This module constructs a graph structure to establish local and global connections between the target and the search area. Furthermore, to retain more of the features learned by the MGAM, we propose a spatial graph convolutional module (SGCM), which uses an explicit graph adjacency matrix to propagate information between the attention graphs. Additionally, we incorporate large-scale datasets from the visual tracking field into the model training process. By mixing these with TIR datasets, we address the sample imbalance issue present in pure TIR datasets. Extensive experimental results indicate that the proposed method achieves state-of-the-art performance.

Czech name

—

Czech description

—

Type

J_imp - Article in a specialist periodical, which is included in the Web of Science database

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2025

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

Engineering applications of artificial intelligence

ISSN

0952-1976

e-ISSN

1873-6769

Volume of the periodical

155

Issue of the periodical within the volume

September

Country of publishing house

GB - UNITED KINGDOM

Number of pages

12

Pages from-to

"Article Number: 110957"

UT code for WoS article

001491146700001

EID of the result in the Scopus database

2-s2.0-105004653868