Markov Decision Petri Net and Markov Decision Well-Formed Net Formalisms
Collection titleLecture Notes in Computer Science
SujetMarkov Decision Processes; Markov Decision Well-formed Nets; Markov Decision Petri Nets; Petri nets
Conference name28th International Conference on Applications and Theory of Petri Nets and Other Models of Concurrency, ICATPN 2007
Book titlePetri Nets and Other Models of Concurrency - ICATPN 2007 28th International Conference on Applications and Theory of Petri Nets and Other Models of Concurrency, ICATPN 2007, Siedlce, Poland, June 25-29, 2007, Proceedings
AuthorKleijn, Jetty; Yakovlev, Alex
MetadataShow full item record
Item number of pages43-62
Abstract (EN)In this work, we propose two high-level formalisms, Markov Decision Petri Nets (MDPNs) and Markov Decision Well-formed Nets (MDWNs), useful for the modeling and analysis of distributed systems with probabilistic and non deterministic features: these formalisms allow a high level representation of Markov Decision Processes. The main advantages of both formalisms are: a macroscopic point of view of the alternation between the probabilistic and the non deterministic behaviour of the system and a syntactical way to define the switch between the two behaviours. Furthermore, MDWNs enable the modeller to specify in a concise way similar components. We have also adapted the technique of the symbolic reachability graph, originally designed for Well-formed Nets, producing a reduced Markov decision process w.r.t. the original one, on which the analysis may be performed more efficiently. Our new formalisms and analysis methods are already implemented and partially integrated in the GreatSPN tool, so we also describe some experimental results.
Showing items related by title, author, creator and subject.
Beccuti, Marco; Codetta-Raiteri, Daniele; Franceschinis, Giuliana; Haddad, Serge (2007) Communication / Conférence
Renault, Jérôme (2011) Article accepté pour publication ou publié
Wu, Chang-Ye (2018-10-04) Thèse