Virtual neural networks: hundreds of souls in a body

Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F61988987%3A17610%2F25%3AA2602FBZ" target="_blank" >RIV/61988987:17610/25:A2602FBZ - isvavai.cz</a>
Result on the web
<a href="https://link.springer.com/article/10.1007/s00521-025-11180-y" target="_blank" >https://link.springer.com/article/10.1007/s00521-025-11180-y</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/s00521-025-11180-y" target="_blank" >10.1007/s00521-025-11180-y</a>

Result language
angličtina
Original language name
Virtual neural networks: hundreds of souls in a body
Original language description
We propose a novel paradigm called virtual neural networks where the number of trainable parameters is fixed and the scalability is made on the computation cost level only. The paradigm is an abstract structure that can be implemented using an arbitrary standard convolutional neural network. It combines siamese neural networks and a deep ensemble approach by creating many virtual models that share combined weights given by a few physical models. The ensemble consists of up to hundreds of virtual models that are trained concurrently. Moreover, all virtual networks share the same input, and their tangled structure creates a kind of inner augmentation that elevates the robustness of the whole ensemble. The accuracy of the ensemble increases with the number of virtual networks, while the capacity remains the same. We demonstrate that virtual neural networks outperform models with larger capacity, standard deep ensembles, and modern techniques such as SWA and Masksembles. Moreover, the best single model from our trained ensemble produces better results than other single-trained models, even with more parameters. The code is available online at gitlab.com/EnginCZ/virtual-models-public.
Czech name
—
Czech description
—

Type
J<sub>SC</sub> - Article in a specialist periodical, which is included in the SCOPUS database
CEP classification
—
OECD FORD branch
10102 - Applied mathematics

Project
<a href="/en/project/EH22_008%2F0004583" target="_blank" >EH22_008/0004583: Research of Excellence on Digital Technologies and Wellbeing</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Publication year
2025
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Similar results(10)