Fuel in Markov Decision Processes (FiMDP): A Practical Approach to Consumption

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216305%3A26230%2F21%3APU155465" target="_blank" >RIV/00216305:26230/21:PU155465 - isvavai.cz</a>

Alternative codes found

RIV/00216224:14330/21:00119269

Result on the web

<a href="https://link.springer.com/chapter/10.1007/978-3-030-90870-6_34?getft_integrator=scopus" target="_blank" >https://link.springer.com/chapter/10.1007/978-3-030-90870-6_34?getft_integrator=scopus</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/978-3-030-90870-6_34" target="_blank" >10.1007/978-3-030-90870-6_34</a>

Result language

angličtina

Original language name

Fuel in Markov Decision Processes (FiMDP): A Practical Approach to Consumption

Original language description

Consumption Markov Decision Processes (CMDPs) are probabilistic decision-making models of resource-constrained systems. We introduce FiMDP, a tool for controller synthesis in CMDPs with LTL objectives expressible by deterministic Büchi automata. The tool implements the recent algorithm for polynomial-time controller synthesis in CMDPs, but extends it with many additional features. On the conceptual level, the tool implements heuristics for improving the expected reachability times of accepting states, and a support for multi-agent task allocation. On the practical level, the tool offers (among other features) a new strategy simulation framework, integration with the Storm model checker, and FiMDPEnv - a new set of CMDPs that model real-world resource-constrained systems. We also present an evaluation of FiMDP on these real-world scenarios.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace

Publication year

2021

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ISBN

978-3-030-90869-0

ISSN

—

e-ISSN

—

Number of pages

17

Pages from-to

640-656

Publisher name

Neuveden

Place of publication

Pittsburgh

Event location

Porto

Event date

Nov 20, 2021

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

000758218600034