Improving Accuracy of Walltime Estimates in PBS Professional Using Soft Walltimes
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F63839172%3A_____%2F23%3A10133549" target="_blank" >RIV/63839172:_____/23:10133549 - isvavai.cz</a>
Result on the web
<a href="https://link.springer.com/chapter/10.1007/978-3-031-22698-4_10" target="_blank" >https://link.springer.com/chapter/10.1007/978-3-031-22698-4_10</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/978-3-031-22698-4_10" target="_blank" >10.1007/978-3-031-22698-4_10</a>
Alternative languages
Result language
angličtina
Original language name
Improving Accuracy of Walltime Estimates in PBS Professional Using Soft Walltimes
Original language description
Job walltime estimates are used by current batch schedulers to optimize the performance and predictability when scheduling parallel jobs on the computing resources. Since the user-provided estimates are inaccurate and often overestimated, system administrators often seek ways to improve them artificially using some form of walltime predictor. In this work, we present our real-life experience with deploying such a predictor using the soft walltime feature available in PBS Professional resource manager. Our results indicate that the applied solution is working properly, significantly increasing the accuracy of user-provided estimates. We share our experience when tuning the scheduler, discussing several problems that occurred along the way. Also, we provide a comparison of how the system behavior evolved once soft walltimes were deployed in production. Last but not least, we publish collected workload traces along with this paper to allow other researchers to further study and extend our work.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
<a href="/en/project/LM2018140" target="_blank" >LM2018140: e-Infrastructure CZ</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2023
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Job Scheduling Strategies for Parallel Processing
ISBN
978-3-031-22697-7
ISSN
0302-9743
e-ISSN
—
Number of pages
19
Pages from-to
192-210
Publisher name
Springer
Place of publication
Switzerland
Event location
virtual event
Event date
Jun 3, 2022
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
000972597400011