Self-attention for The Image Completion Task on the Calorimeter Data in High Energy Physics

Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21340%2F23%3A00369788" target="_blank" >RIV/68407700:21340/23:00369788 - isvavai.cz</a>
Result on the web
—
DOI - Digital Object Identifier
—

Result language
angličtina
Original language name
Self-attention for The Image Completion Task on the Calorimeter Data in High Energy Physics
Original language description
Detector simulations are an important component of the research in high energy physics. However, the traditional Mote Carlo-based simulation tools are computationally intensive and finding a faster alternative is necessary. Development of the deep learning models for detector simulations has been of interest to the HEP Community with main focus on the MLPs and CNNs. However, these models are usually limited to one very specific detector and particle setup. In the aim of having a more general model, we explore the self-attention mechanism for an image completion task on the calorimeter data. Inspired by the vision transformer (ViT), we treat the calorimeter showers as images and use a transformer for masked sequence modelling. We also leverage the graph convolutional layer for embedding of the showers.
Czech name
—
Czech description
—

Project
<a href="/en/project/LM2023061" target="_blank" >LM2023061: Research Infrastructure for Fermilab Experiments</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>S - Specificky vyzkum na vysokych skolach

Publication year
2023
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection
SPMS 2022/23 Stochastic and Physical Monitoring Systems, Proceedings of the international conferences
ISBN
978-80-01-07250-9
ISSN
—
e-ISSN
—
Number of pages
8
Pages from-to
45-52
Publisher name
České vysoké učení technické v Praze
Place of publication
Praha
Event location
Sloup v Čechách
Event date
Jun 26, 2023
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—

Similar results(10)