Enhanced SOMHunter for Known-item Search in Lifelog Data

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F21%3A10433625" target="_blank" >RIV/00216208:11320/21:10433625 - isvavai.cz</a>

Result on the web

<a href="https://doi.org/10.1145/3463948.3469074" target="_blank" >https://doi.org/10.1145/3463948.3469074</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1145/3463948.3469074" target="_blank" >10.1145/3463948.3469074</a>

Result language

angličtina

Original language name

Enhanced SOMHunter for Known-item Search in Lifelog Data

Original language description

SOMHunter represents a modern light-weight framework for known-item search in datasets of visual data like images or videos. The framework combines an effective W2VV++ text-to-image search approach, a traditional Bayesian like model for maintenance of relevance scores influenced by positive examples, and several types of exploration and exploitation displays. With this initial setting in 2020, already the first prototype of the system turned out to be highly competitive in comparison with other state-of-the-art systems at Video Browser Showdown and Lifelog Search Challenge competitions. In this paper, we present a new version of the system further extending the list of visual data search capabilities. The new version combines localized text queries with collage queries tested at VBS 2021 in two separate systems by our team. Furthermore, the new version of SOMHunter will integrate also the new CLIP text search model recently released by OpenAI. We believe that all the extensions will improve chances to effectively initialize the search that can continue with already supported browsing capabilities.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

<a href="/en/project/GJ19-22071Y" target="_blank" >GJ19-22071Y: Flexible models for known-item search in large video collections</a><br>

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Publication year

2021

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

LSC &apos;21: Proceedings of the 4th Annual on Lifelog Search Challenge

ISBN

978-1-4503-8533-6

ISSN

—

e-ISSN

—

Number of pages

3

Pages from-to

71-73

Publisher name

ACM

Place of publication

New YorkNYUnited States

Event location

Taipei, Taiwan

Event date

Aug 21, 2021

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—