Trading Performance for Stability in Markov Decision Processes
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14330%2F13%3A00066541" target="_blank" >RIV/00216224:14330/13:00066541 - isvavai.cz</a>
Result on the web
<a href="http://dx.doi.org/10.1109/LICS.2013.39" target="_blank" >http://dx.doi.org/10.1109/LICS.2013.39</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1109/LICS.2013.39" target="_blank" >10.1109/LICS.2013.39</a>
Alternative languages
Result language
angličtina
Original language name
Trading Performance for Stability in Markov Decision Processes
Original language description
We study the complexity of central controller synthesis problems for finite-state Markov decision processes, where the objective is to optimize both the expected mean-payoff performance of the system and its stability. We argue that the basic theoreticalnotion of expressing the stability in terms of the variance of the mean-payoff (called global variance in our paper) is not always sufficient, since it ignores possible instabilities on respective runs. For this reason we propose alernative definitionsof stability, which we call local and hybrid variance, and which express how rewards on each run deviate from the run's own mean-payoff and from the expected mean-payoff, respectively.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
IN - Informatics
OECD FORD branch
—
Result continuities
Project
<a href="/en/project/GPP202%2F12%2FP612" target="_blank" >GPP202/12/P612: Formal Verification of Stochastic Real-Time Systems</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2013
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Proceedings of 28th Annual ACM/IEEE Symposium on Logic in Computer Science (LICS 2013)
ISBN
9781479904136
ISSN
1043-6871
e-ISSN
—
Number of pages
10
Pages from-to
331-340
Publisher name
IEEE Computer Society
Place of publication
London
Event location
New Orleans
Event date
Jun 25, 2013
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
000326815000038