Duet Benchmarking: Improving Measurement Accuracy in the Cloud
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F20%3A10422226" target="_blank" >RIV/00216208:11320/20:10422226 - isvavai.cz</a>
Result on the web
<a href="https://doi.org/10.1145/3358960.3379132" target="_blank" >https://doi.org/10.1145/3358960.3379132</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1145/3358960.3379132" target="_blank" >10.1145/3358960.3379132</a>
Alternative languages
Result language
angličtina
Original language name
Duet Benchmarking: Improving Measurement Accuracy in the Cloud
Original language description
We investigate the duet measurement procedure, which helps improve the accuracy of performance comparison experiments conducted on shared machines by executing the measured artifacts in parallel and evaluating their relative performance together, rather than individually. Specifically, we analyze the behavior of the procedure in multiple cloud environments and use experimental evidence to answer multiple research questions concerning the assumption underlying the procedure. We demonstrate improvements in accuracy ranging from 2.3x to 12.5x (5.03x on average) for the tested ScalaBench (and DaCapo) workloads, and from 23.8x to 82.4x (37.4x on average) for the SPEC CPU 2017 workloads.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
<a href="/en/project/8A18009" target="_blank" >8A18009: From the cloud to the edge - smart IntegraTion and OPtimization Technologies for highly efficient Image and VIdeo processing Systems</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>S - Specificky vyzkum na vysokych skolach<br>I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace
Others
Publication year
2020
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Proceedings of the ACM/SPEC International Conference on Performance Engineering
ISBN
978-1-4503-6991-6
ISSN
—
e-ISSN
—
Number of pages
8
Pages from-to
100-107
Publisher name
ACM
Place of publication
ACM New York
Event location
Edmonton, Canada
Event date
Apr 20, 2020
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—