Filters
Applications of Markov Chains in Quality Control
The report is sight on description of the basic notions and properties of Markov chains and on a exhibits their possible applications in quality control of production. The first part deals with a using of homogenous chains for descr...
BB - Aplikovaná statistika, operační výzkum
- 2003 •
- D
Rok uplatnění
D - Stať ve sborníku
Controller Synthesis and Verification for Markov Decision Processes with Qualitative Branching Time Objectives
We show that the controller synthesis and verification problems for Markov decision processes with qualitative PECTL* objectives are 2-EXPTIME complete. More precisely, the algorithms are polynomial in the size of a given <...
IN - Informatika
- 2008 •
- D
Rok uplatnění
D - Stať ve sborníku
On the Controller Synthesis for Finite-State Markov Decision Processes
We study the problem of effective controller synthesis for finite-state Markov decision processes (MDPs) and the class of properties definable in the logic PCTL of such a controlleris decidable, and we give an algorithm whi...
IN - Informatika
- 2005 •
- D
Rok uplatnění
D - Stať ve sborníku
On the Controller Synthesis for Finite-State Markov Decision Processes
We study the problem of effective controller synthesis for finite-state Markov decision processes (MDPs) and the class of properties definable in the logic PCTL of such a controlleris decidable, and we give an algorithm whi...
IN - Informatika
- 2008 •
- Jx
Rok uplatnění
Jx - Nezařazeno - Článek v odborném periodiku (Jimp, Jsc a Jost)
Multistage stochastic decision and economic processes
, control Markov chains, empirical processes as well as stochastic multiobjective stochastic programming models with Markov type of dependence....
BB - Aplikovaná statistika, operační výzkum
- 2005 •
- Jx
Rok uplatnění
Jx - Nezařazeno - Článek v odborném periodiku (Jimp, Jsc a Jost)
Qualitative Controller Synthesis for Consumption Markov Decision Processes
Consumption Markov Decision Processes (CMDPs) are probabilistic decision-making models of resource-constrained systems. In a CMDP, the controller possesses a certain amount of a critical resource, such as electric power. Ea...
Computer and information sciences
- 2020 •
- D •
- Link
Rok uplatnění
D - Stať ve sborníku
Výsledek na webu
Trading performance for stability in Markov decision processes
We study controller synthesis problems for finite-state Markov decision processes, where the objective is to optimize the expected mean-payoff performance and stability (also known as variability in the literature). We argu...
Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
- 2017 •
- Jimp •
- Link
Rok uplatnění
Jimp - Článek v periodiku v databázi Web of Science
Výsledek na webu
Optimizing the Expected Mean Payoff in Energy Markov Decision Processes
Energy Markov Decision Processes (EMDPs) are finite-state Markov decision processes where each transition is assigned an integer counter update and a rational payoff. An EMDP configuration is a pair s(n), where s i...
IN - Informatika
- 2016 •
- D •
- Link
Rok uplatnění
D - Stať ve sborníku
Výsledek na webu
Risk-sensitive Average Optimality in Markov Decision Processes
-sensitive optimality criteria in Markov decision chains. To this end we assume that the total reward generated by the Markov process is evaluated by an exponential utility and the second central moment of the reward varian...
Statistics and probability
- 2018 •
- Jimp •
- Link
Rok uplatnění
Jimp - Článek v periodiku v databázi Web of Science
Výsledek na webu
Measuring Performance of Continuous-Time Stochastic Processes using Timed Automata
(control states) of a DTA that observes computations of a given stochastic process. Then, we study the properties of DTA measures over semi-Markov processes in greater detail. We show that DTA measures over semi-<...
IN - Informatika
- 2011 •
- D
Rok uplatnění
D - Stať ve sborníku
- 1 - 10 out of 243 667