QBD modelling of a finite state controller for queueing systems with unobservable Markovian environments

Asanjarani, Azam (2016). QBD modelling of a finite state controller for queueing systems with unobservable Markovian environments. In: ACM International Conference Proceeding Series. 11th International Conference on Queueing Theory and Network Applications, QTNA 2016, Wellington, New Zealand, (). 13 - 15 December 2016. doi:10.1145/3016032.3016041


Author Asanjarani, Azam
Title of paper QBD modelling of a finite state controller for queueing systems with unobservable Markovian environments
Conference name 11th International Conference on Queueing Theory and Network Applications, QTNA 2016
Conference location Wellington, New Zealand
Conference dates 13 - 15 December 2016
Convener ACM
Proceedings title ACM International Conference Proceeding Series
Journal name ACM International Conference Proceeding Series
Place of Publication New York, NY, United States
Publisher Association for Computing Machinery
Publication Year 2016
Sub-type Fully published paper
DOI 10.1145/3016032.3016041
Open Access Status Not yet assessed
ISBN 9781450348423
Volume Part F126327
Total pages 4
Collection year 2017
Language eng
Abstract/Summary We address the problem of stabilizing control for complex queueing systems with known parameters but unobservable Markovian random environment. In such systems, the controller needs to assign servers to queues without having full information about the servers' states. A control challenge is to devise a policy that matches servers to queues in a way that takes state estimates into account. Maximally attainable stability regions are non-trivial. To handle these situations, we model the system under given decision rules. The model is using Quasi-Birth-and-Death (QBD) structure to find a matrix analytic expression for the stability bound. We use this formulation to illustrate how the stability region grows as the number of controller belief states increases.
Keyword Bellman equations
Complex queueing systems
Control problem
Matrix analytic methods
Partially observed markov decision process (POMDP)
Quasi-birth-and-death (QBD) process
Q-Index Code C1
Q-Index Status Provisional Code
Institutional Status UQ

Document type: Conference Paper
Collections: School of Mathematics and Physics
HERDC Pre-Audit
 
Versions
Version Filter Type
Citation counts: Scopus Citation Count Cited 0 times in Scopus Article
Google Scholar Search Google Scholar
Created: Tue, 28 Mar 2017, 00:20:19 EST by Web Cron on behalf of Learning and Research Services (UQ Library)