# American Institute of Mathematical Sciences

January  2006, 2(1): 63-80. doi: 10.3934/jimo.2006.2.63

## Optimal control for resource allocation in discrete event systems

 1 College of International Business and Management, Shanghai University, Shanghai 201800, China 2 Department of Intelligence and Informatics, Konan University, 8-9-1 Okamoto, Kobe 658-8501

Received  August 2005 Revised  November 2005 Published  January 2006

Supervisory control for discrete event systems (DESs) belongs essentially to the logic level for control problems in DESs. Its corresponding control task is hard. In this paper, we study a new optimal control problem in DESs. The performance measure is to maximize the maximal discounted total reward among all possible strings (i.e., paths) of the controlled system. The condition we need for this is only that the performance measure is well defined. We then divide the problem into three sub-cases where the optimal values are respectively finite, positive infinite and negative infinite. We then show the optimality equation in the case with a finite optimal value. Also, we characterize the optimality equation together with its solutions and characterize the structure of the set of all optimal policies. All the results are still true when the performance measure is to maximize the minimal discounted total reward among all possible strings of the controlled system. Finally, we apply these equations and solutions to a resource allocation system. The system may be deadlocked and in order to avoid the deadlock we can either prohibit occurrence of some events or resolve the deadlock. It is shown that from the view of the maximal discounted total cost, it is better to resolve the deadlock if and only if the cost for resolving the deadlock is less than the threshold value.
Citation: Qiying Hu, Wuyi Yue. Optimal control for resource allocation in discrete event systems. Journal of Industrial & Management Optimization, 2006, 2 (1) : 63-80. doi: 10.3934/jimo.2006.2.63
 [1] Qiying Hu, Wuyi Yue. Optimal control for discrete event systems with arbitrary control pattern. Discrete & Continuous Dynamical Systems - B, 2006, 6 (3) : 535-558. doi: 10.3934/dcdsb.2006.6.535 [2] Qiying Hu, Wuyi Yue. Two new optimal models for controlling discrete event systems. Journal of Industrial & Management Optimization, 2005, 1 (1) : 65-80. doi: 10.3934/jimo.2005.1.65 [3] Semu Mitiku Kassa. Three-level global resource allocation model for HIV control: A hierarchical decision system approach. Mathematical Biosciences & Engineering, 2018, 15 (1) : 255-273. doi: 10.3934/mbe.2018011 [4] Ali Gharouni, Lin Wang. Modeling the spread of bed bug infestation and optimal resource allocation for disinfestation. Mathematical Biosciences & Engineering, 2016, 13 (5) : 969-980. doi: 10.3934/mbe.2016025 [5] Qiying Hu, Chen Xu, Wuyi Yue. A unified model for state feedback of discrete event systems II: Control synthesis problems. Journal of Industrial & Management Optimization, 2008, 4 (4) : 713-726. doi: 10.3934/jimo.2008.4.713 [6] Sang-Heon Lee. Development of concurrent structural decentralised discrete event system using bisimulation concept. Numerical Algebra, Control & Optimization, 2016, 6 (3) : 305-317. doi: 10.3934/naco.2016013 [7] Stefan Jerg, Oliver Junge, Marcus Post. Global optimal feedbacks for stochastic quantized nonlinear event systems. Journal of Computational Dynamics, 2014, 1 (1) : 163-176. doi: 10.3934/jcd.2014.1.163 [8] Irina Kareva, Faina Berezovkaya, Georgy Karev. Mixed strategies and natural selection in resource allocation. Mathematical Biosciences & Engineering, 2013, 10 (5&6) : 1561-1586. doi: 10.3934/mbe.2013.10.1561 [9] Galina Kurina, Sahlar Meherrem. Decomposition of discrete linear-quadratic optimal control problems for switching systems. Conference Publications, 2015, 2015 (special) : 764-774. doi: 10.3934/proc.2015.0764 [10] Anthony M. Bloch, Peter E. Crouch, Nikolaj Nordkvist. Continuous and discrete embedded optimal control problems and their application to the analysis of Clebsch optimal control problems and mechanical systems. Journal of Geometric Mechanics, 2013, 5 (1) : 1-38. doi: 10.3934/jgm.2013.5.1 [11] Qinglan Xia, Shaofeng Xu. On the ramified optimal allocation problem. Networks & Heterogeneous Media, 2013, 8 (2) : 591-624. doi: 10.3934/nhm.2013.8.591 [12] Qiying Hu, Chen Xu, Wuyi Yue. A unified model for state feedback of discrete event systems I: framework and maximal permissive state feedback. Journal of Industrial & Management Optimization, 2008, 4 (1) : 107-123. doi: 10.3934/jimo.2008.4.107 [13] Yuefen Chen, Yuanguo Zhu. Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems. Journal of Industrial & Management Optimization, 2018, 14 (3) : 913-930. doi: 10.3934/jimo.2017082 [14] V.N. Malozemov, A.V. Omelchenko. On a discrete optimal control problem with an explicit solution. Journal of Industrial & Management Optimization, 2006, 2 (1) : 55-62. doi: 10.3934/jimo.2006.2.55 [15] Nguyen Huy Chieu, Jen-Chih Yao. Subgradients of the optimal value function in a parametric discrete optimal control problem. Journal of Industrial & Management Optimization, 2010, 6 (2) : 401-410. doi: 10.3934/jimo.2010.6.401 [16] Aleksandar Zatezalo, Dušan M. Stipanović. Control of dynamical systems with discrete and uncertain observations. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 4665-4681. doi: 10.3934/dcds.2015.35.4665 [17] Radosław Kurek, Paweł Lubowiecki, Henryk Żołądek. The Hess-Appelrot system. Ⅲ. Splitting of separatrices and chaos. Discrete & Continuous Dynamical Systems - A, 2018, 38 (4) : 1955-1981. doi: 10.3934/dcds.2018079 [18] Jitka Machalová, Horymír Netuka. Optimal control of system governed by the Gao beam equation. Conference Publications, 2015, 2015 (special) : 783-792. doi: 10.3934/proc.2015.0783 [19] Thomas I. Seidman. Optimal control of a diffusion/reaction/switching system. Evolution Equations & Control Theory, 2013, 2 (4) : 723-731. doi: 10.3934/eect.2013.2.723 [20] Jérome Lohéac, Jean-François Scheid. Time optimal control for a nonholonomic system with state constraint. Mathematical Control & Related Fields, 2013, 3 (2) : 185-208. doi: 10.3934/mcrf.2013.3.185

2018 Impact Factor: 1.025