Library for parallel data transfers over SSH
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F61989100%3A27740%2F25%3A10259084" target="_blank" >RIV/61989100:27740/25:10259084 - isvavai.cz</a>
Result on the web
<a href="https://opencode.it4i.eu/exa4mind/parallel-ssh" target="_blank" >https://opencode.it4i.eu/exa4mind/parallel-ssh</a>
DOI - Digital Object Identifier
—
Alternative languages
Result language
angličtina
Original language name
Library for parallel data transfers over SSH
Original language description
The result is a library that enables data transfer between two Unix systems. It allows the user to easily transfer large amounts of data, and thanks to parallelization, the total transfer time is significantly reduced. The basis of parallelization is the opening of multiple SFTP connections, where each of them transfers a clearly defined part of the data. The library distinguishes two types of files - large and small. A large file is divided into several parts ("chunks") and each such part is transferred separately by one SFTP connection. Small files are divided into several bundles (one bundle contains several small files), and each of them is transferred by a separate SFTP connection. The library offers a simple interface for user authorization, connection via SSH and management of SFTP connections. It also offers a connection to the HEAppE middleware (https://heappe.eu).The library was inspired by the article "Multi-threaded scp: Easy and Fast File Transfer over SSH" (https://dl.acm.org/doi/fullHtml/10.1145/3569951.3597582), but differs in that it is a pure Python implementation.
Czech name
—
Czech description
—
Classification
Type
R - Software
CEP classification
—
OECD FORD branch
10200 - Computer and information sciences
Result continuities
Project
—
Continuities
—
Others
Publication year
2025
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Internal product ID
044/17-12-2025_SW
Technical parameters
Software je implementován v jazyce Python a je možné ho spustit tam, kde je Python nainstalovaný. Součástí řešení je také ukázka vysvětlující použití knihovny.
Economical parameters
Software je implementován v jazyce Python a je možné ho spustit tam, kde je Python nainstalovaný. Součástí řešení je také ukázka vysvětlující použití knihovny. Zdrojový kód řešení je dostupný na adrese: https://opencode.it4i.eu/exa4mind/parallel-ssh.
Owner IČO
61989100
Owner name
VŠB - TU Ostrava, IT4Innovations