Fuel in Markov Decision Processes (FiMDP): A Practical Approach to Consumption
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14330%2F21%3A00119269" target="_blank" >RIV/00216224:14330/21:00119269 - isvavai.cz</a>
Alternative codes found
RIV/00216305:26230/21:PU155465
Result on the web
<a href="http://dx.doi.org/10.1007/978-3-030-90870-6_34" target="_blank" >http://dx.doi.org/10.1007/978-3-030-90870-6_34</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/978-3-030-90870-6_34" target="_blank" >10.1007/978-3-030-90870-6_34</a>
Alternative languages
Result language
angličtina
Original language name
Fuel in Markov Decision Processes (FiMDP): A Practical Approach to Consumption
Original language description
Consumption Markov Decision Processes (CMDPs) are prob- abilistic decision-making models of resource-constrained systems. We introduce FiMDP, a tool for controller synthesis in CMDPs with LTL objectives expressible by deterministic Büchi automata. The tool implements the recent algorithm for polynomial-time controller synthesis in CMDPs, but extends it with many additional features. On the conceptual level, the tool implements heuristics for improving the expected reachability times of accepting states, and a support for multi-agent task allocation. On the practical level, the tool offers (among other features) a new strategy simulation framework, integration with the Storm model checker, and FiMDPEnv - a new set of CMDPs that model real-world resource-constrained systems. We also present an evaluation of FiMDP on these real-world scenarios.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
—
OECD FORD branch
10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Result continuities
Project
<a href="/en/project/GJ19-15134Y" target="_blank" >GJ19-15134Y: Verification and Analysis of Probabilistic Programs</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2021
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
24th International Symposium on Formal Methods, FM 2021
ISBN
9783030908690
ISSN
0302-9743
e-ISSN
—
Number of pages
17
Pages from-to
640-656
Publisher name
Springer
Place of publication
Cham, Switzerland
Event location
Cham, Switzerland
Event date
Jan 1, 2021
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
000758218600034