# American Institute of Mathematical Sciences

January  2005, 1(1): 65-80. doi: 10.3934/jimo.2005.1.65

## Two new optimal models for controlling discrete event systems

 1 College of International Business and Management, Shanghai University, Shanghai 201800, China 2 Department of Intelligence and Informatics, Konan University, 8-9-1 Okamoto, Kobe 658-8501, Japan

Received  May 2004 Revised  November 2004 Published  January 2005

Supervisory control belongs essentially to the logic level for control problems in discrete event systems (DESs) and its corresponding control task is hard. This is unlike many practical optimal control problems which belong to the performance level and whose control tasks are soft. In this paper, we present two new optimal control problems of DESs: one with cost functions for choosing control inputs, and the other for occurring events. Their performance measures are to minimize the maximal discounted total cost among all possible strings that the system generates. Since this is a nonlinear optimization problem, we model such systems by using Markov decision processes. We then present the optimality equations for both control problems and obtain their optimal solutions. When the cost functions are stationary, we show that both the optimality equations and their solutions are also stationary. We then use these equations and solutions to describe and solve uniformly the basic synthesizing problems in the two branches of the supervisory control area: those being the event feedback control and the state feedback control. Moreover, we show that the control invariant languages and the control invariant predicates with their permissive supervisors and state feedbacks not only have meanings in supervisory control of DESs, but are also the optimal solutions for some optimal control problems. This shows a link existing between the logic level and the performance level for the control of discrete event systems. Finally, a numerical example is given to illustrate some results for supervisory control of a DES.
Citation: Qiying Hu, Wuyi Yue. Two new optimal models for controlling discrete event systems. Journal of Industrial & Management Optimization, 2005, 1 (1) : 65-80. doi: 10.3934/jimo.2005.1.65
 [1] Qiying Hu, Chen Xu, Wuyi Yue. A unified model for state feedback of discrete event systems II: Control synthesis problems. Journal of Industrial & Management Optimization, 2008, 4 (4) : 713-726. doi: 10.3934/jimo.2008.4.713 [2] Qiying Hu, Wuyi Yue. Optimal control for resource allocation in discrete event systems. Journal of Industrial & Management Optimization, 2006, 2 (1) : 63-80. doi: 10.3934/jimo.2006.2.63 [3] Qiying Hu, Chen Xu, Wuyi Yue. A unified model for state feedback of discrete event systems I: framework and maximal permissive state feedback. Journal of Industrial & Management Optimization, 2008, 4 (1) : 107-123. doi: 10.3934/jimo.2008.4.107 [4] Qiying Hu, Wuyi Yue. Optimal control for discrete event systems with arbitrary control pattern. Discrete & Continuous Dynamical Systems - B, 2006, 6 (3) : 535-558. doi: 10.3934/dcdsb.2006.6.535 [5] Changzhi Wu, Kok Lay Teo, Volker Rehbock. Optimal control of piecewise affine systems with piecewise affine state feedback. Journal of Industrial & Management Optimization, 2009, 5 (4) : 737-747. doi: 10.3934/jimo.2009.5.737 [6] Yuefen Chen, Yuanguo Zhu. Indefinite LQ optimal control with process state inequality constraints for discrete-time uncertain systems. Journal of Industrial & Management Optimization, 2018, 14 (3) : 913-930. doi: 10.3934/jimo.2017082 [7] Stefan Jerg, Oliver Junge, Marcus Post. Global optimal feedbacks for stochastic quantized nonlinear event systems. Journal of Computational Dynamics, 2014, 1 (1) : 163-176. doi: 10.3934/jcd.2014.1.163 [8] Yuyun Zhao, Yi Zhang, Tao Xu, Ling Bai, Qian Zhang. pth moment exponential stability of hybrid stochastic functional differential equations by feedback control based on discrete-time state observations. Discrete & Continuous Dynamical Systems - B, 2017, 22 (1) : 209-226. doi: 10.3934/dcdsb.2017011 [9] Galina Kurina, Sahlar Meherrem. Decomposition of discrete linear-quadratic optimal control problems for switching systems. Conference Publications, 2015, 2015 (special) : 764-774. doi: 10.3934/proc.2015.0764 [10] Anthony M. Bloch, Peter E. Crouch, Nikolaj Nordkvist. Continuous and discrete embedded optimal control problems and their application to the analysis of Clebsch optimal control problems and mechanical systems. Journal of Geometric Mechanics, 2013, 5 (1) : 1-38. doi: 10.3934/jgm.2013.5.1 [11] Elimhan N. Mahmudov. Optimal control of second order delay-discrete and delay-differential inclusions with state constraints. Evolution Equations & Control Theory, 2018, 7 (3) : 501-529. doi: 10.3934/eect.2018024 [12] N. U. Ahmed. Existence of optimal output feedback control law for a class of uncertain infinite dimensional stochastic systems: A direct approach. Evolution Equations & Control Theory, 2012, 1 (2) : 235-250. doi: 10.3934/eect.2012.1.235 [13] Elena K. Kostousova. On polyhedral control synthesis for dynamical discrete-time systems under uncertainties and state constraints. Discrete & Continuous Dynamical Systems - A, 2018, 38 (12) : 6149-6162. doi: 10.3934/dcds.2018153 [14] Cristiana J. Silva, Helmut Maurer, Delfim F. M. Torres. Optimal control of a Tuberculosis model with state and control delays. Mathematical Biosciences & Engineering, 2017, 14 (1) : 321-337. doi: 10.3934/mbe.2017021 [15] Guirong Jiang, Qishao Lu. The dynamics of a Prey-Predator model with impulsive state feedback control. Discrete & Continuous Dynamical Systems - B, 2006, 6 (6) : 1301-1320. doi: 10.3934/dcdsb.2006.6.1301 [16] Haiying Jing, Zhaoyu Yang. The impact of state feedback control on a predator-prey model with functional response. Discrete & Continuous Dynamical Systems - B, 2004, 4 (3) : 607-614. doi: 10.3934/dcdsb.2004.4.607 [17] Meng Zhang, Kaiyuan Liu, Lansun Chen, Zeyu Li. State feedback impulsive control of computer worm and virus with saturated incidence. Mathematical Biosciences & Engineering, 2018, 15 (6) : 1465-1478. doi: 10.3934/mbe.2018067 [18] Rohit Gupta, Farhad Jafari, Robert J. Kipka, Boris S. Mordukhovich. Linear openness and feedback stabilization of nonlinear control systems. Discrete & Continuous Dynamical Systems - S, 2018, 11 (6) : 1103-1119. doi: 10.3934/dcdss.2018063 [19] Jérome Lohéac, Jean-François Scheid. Time optimal control for a nonholonomic system with state constraint. Mathematical Control & Related Fields, 2013, 3 (2) : 185-208. doi: 10.3934/mcrf.2013.3.185 [20] Kazimierz Malanowski, Helmut Maurer. Sensitivity analysis for state constrained optimal control problems. Discrete & Continuous Dynamical Systems - A, 1998, 4 (2) : 241-272. doi: 10.3934/dcds.1998.4.241

2018 Impact Factor: 1.025