September  2015, 35(9): 3989-4017. doi: 10.3934/dcds.2015.35.3989

State constrained $L^\infty$ optimal control problems interpreted as differential games

1. 

Laboratoire de Mathematiques, Université de Bretagne Occidentale, 6 Avenue Victor Le Gorgeu, 29200 Brest

Received  April 2014 Revised  October 2014 Published  April 2015

We consider state constrained optimal control problems in which the cost to minimize comprises an $L^\infty$ functional, i.e. the maximum of a running cost along the trajectories. In absence of state constraints, a new approach has been suggested by a recent paper [9]. The main purpose of the present paper is to extend this approach and the related results to state constrained $L^\infty$ optimal control problems. More precisely, using the $(L^\infty, L^1)$-duality, the reference optimal control problem can be seen as a static differential game, in which an extra variable is introduced and plays the role of an opponent player who wants to maximize the cost. Under appropriate assumptions and employing suitable Filippov's type results, this static game turns out to be equivalent to the corresponding dynamic differential game, whose (upper) value function is the unique viscosity solution to a constrained boundary value problem, which involves a Hamilton-Jacobi equation with a continuous Hamiltonian.
Citation: Piernicola Bettiol. State constrained $L^\infty$ optimal control problems interpreted as differential games. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 3989-4017. doi: 10.3934/dcds.2015.35.3989
References:
[1]

J.-P. Aubin and H. Frankowska, Set-valued Analysis,, Birkhäuser Boston, (1990).

[2]

M. Bardi and I. Capuzzo-Dolcetta, Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations,, Systems and Control: Foundations and Applications. Boston, (1997). doi: 10.1007/978-0-8176-4755-1.

[3]

M. Bardi and P. Soravia, A comparison result for Hamilton-Jacobi equations and applications to some differential games lacking controllability,, Funkcial. Ekvac., 37 (1994), 19.

[4]

G. Barles, Solutions de Viscosité des Équations de Hamilton-Jacobi,, (French) [Viscosity solutions of Hamilton-Jacobi equations], (1994).

[5]

E. N. Barron, The Pontryagin maximum principle for minimax problems of optimal control,, Nonlinear Anal., 15 (1990), 1155. doi: 10.1016/0362-546X(90)90051-H.

[6]

E. N. Barron, Viscosity solutions and analysis in $L^{\infty}$,, Nonlinear Analysis, (1999), 1.

[7]

E. N. Barron and H. Ishii, The Bellman equation for minimizing the maximum cost,, Nonlinear Anal., 13 (1989), 1067. doi: 10.1016/0362-546X(89)90096-5.

[8]

P. Bettiol, P. Cardaliaguet and M. Quincampoix, Zero-sum state constrained differential games: Existence of value for Bolza problem,, Int. J. Game Theory, 34 (2006), 495. doi: 10.1007/s00182-006-0030-9.

[9]

P. Bettiol and F. Rampazzo, ($L^\infty$ + Bolza) control problems as dynamic differential games,, Nonlinear Differ. Equ. Appl., 20 (2013), 895. doi: 10.1007/s00030-012-0186-x.

[10]

P. Bettiol, H. Frankowska and R. B. Vinter, $L^{\infty}$ estimates on trajectories confined to a closed subset,, J. Differential Eq., 252 (2012), 1912. doi: 10.1016/j.jde.2011.09.007.

[11]

P. Bettiol and R. B. Vinter, Trajectories satisfying a smooth state constraint: Improved estimates,, IEEE TAC, 56 (2011), 1090. doi: 10.1109/TAC.2010.2088670.

[12]

P. Bettiol and R. B. Vinter, Estimates on trajectories in a closed set with corners for (t,x) dependent data,, Mathematical Control and Related Fields, 3 (2013), 245. doi: 10.3934/mcrf.2013.3.245.

[13]

P. Bettiol and R. B. Vinter, Refined estimates on trajectories of state constrained control problems,, Preprint., ().

[14]

S. C. Di Marco and R. L. V. González, Minimax optimal control problems. Numerical analysis of the finite horizon case,, ESAIM: Mathematical Modelling and Numerical Analysis, 33 (1999), 23. doi: 10.1051/m2an:1999103.

[15]

S. C. Di Marco and R. L. V. González, On a system of Hamilton-Jacobi-Bellman inequalities associated to a minimax problem with additive final cost,, International Journal of Mathematics and Mathematical Sciences Issue, (2003), 4517. doi: 10.1155/S0161171203302108.

[16]

L. C. Evans and P. E. Souganidis, Differential games and representation formulas for solutions of Hamilton-Jacobi-Isaacs equations,, Indiana Un. Math.J., 33 (1984), 773. doi: 10.1512/iumj.1984.33.33040.

[17]

I. J. Fialho and T. T. Georgiou, Worst case analysis of nonlinear systems,, IEEE Trans. Autom. Control, 44 (1999), 1180. doi: 10.1109/9.769372.

[18]

H. Frankowska and M. Mazzola, On relations of the adjoint state to the value function for optimal control problems with state constraints,, Nonlinear Differ. Equ. Appl., 20 (2013), 361. doi: 10.1007/s00030-012-0183-0.

[19]

H. Frankowska and F. Rampazzo, Filippov's and Filippov-Wazewski's theorems on closed domains,, J. Differential Eq., 161 (2000), 449. doi: 10.1006/jdeq.2000.3711.

[20]

J. Lygeros, On reachability and minimum cost optimal control,, Automatica, 40 (2004), 917. doi: 10.1016/j.automatica.2004.01.012.

[21]

F. Rampazzo, Differential games with unbounded versus bounded controls,, SIAM J. Control Optim., 36 (1998), 814. doi: 10.1137/S0363012995294602.

[22]

F. Rampazzo, Continuity of the upper and lower value of slow growth differential games,, J. Math. Anal. Appl., 213 (1997), 15. doi: 10.1006/jmaa.1997.5327.

[23]

O. Serea, Discontinuity differential games and control systems with supremum cost,, J. Math. Anal. Appl., 270 (2002), 519. doi: 10.1016/S0022-247X(02)00087-2.

[24]

R. B. Vinter, Minimax optimal control,, SIAM J. Control Optim., 44 (2005), 939. doi: 10.1137/S0363012902415244.

[25]

J. Warga, Optimal Control of Differential and Functional Equations,, Academic Press, (1972).

show all references

References:
[1]

J.-P. Aubin and H. Frankowska, Set-valued Analysis,, Birkhäuser Boston, (1990).

[2]

M. Bardi and I. Capuzzo-Dolcetta, Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations,, Systems and Control: Foundations and Applications. Boston, (1997). doi: 10.1007/978-0-8176-4755-1.

[3]

M. Bardi and P. Soravia, A comparison result for Hamilton-Jacobi equations and applications to some differential games lacking controllability,, Funkcial. Ekvac., 37 (1994), 19.

[4]

G. Barles, Solutions de Viscosité des Équations de Hamilton-Jacobi,, (French) [Viscosity solutions of Hamilton-Jacobi equations], (1994).

[5]

E. N. Barron, The Pontryagin maximum principle for minimax problems of optimal control,, Nonlinear Anal., 15 (1990), 1155. doi: 10.1016/0362-546X(90)90051-H.

[6]

E. N. Barron, Viscosity solutions and analysis in $L^{\infty}$,, Nonlinear Analysis, (1999), 1.

[7]

E. N. Barron and H. Ishii, The Bellman equation for minimizing the maximum cost,, Nonlinear Anal., 13 (1989), 1067. doi: 10.1016/0362-546X(89)90096-5.

[8]

P. Bettiol, P. Cardaliaguet and M. Quincampoix, Zero-sum state constrained differential games: Existence of value for Bolza problem,, Int. J. Game Theory, 34 (2006), 495. doi: 10.1007/s00182-006-0030-9.

[9]

P. Bettiol and F. Rampazzo, ($L^\infty$ + Bolza) control problems as dynamic differential games,, Nonlinear Differ. Equ. Appl., 20 (2013), 895. doi: 10.1007/s00030-012-0186-x.

[10]

P. Bettiol, H. Frankowska and R. B. Vinter, $L^{\infty}$ estimates on trajectories confined to a closed subset,, J. Differential Eq., 252 (2012), 1912. doi: 10.1016/j.jde.2011.09.007.

[11]

P. Bettiol and R. B. Vinter, Trajectories satisfying a smooth state constraint: Improved estimates,, IEEE TAC, 56 (2011), 1090. doi: 10.1109/TAC.2010.2088670.

[12]

P. Bettiol and R. B. Vinter, Estimates on trajectories in a closed set with corners for (t,x) dependent data,, Mathematical Control and Related Fields, 3 (2013), 245. doi: 10.3934/mcrf.2013.3.245.

[13]

P. Bettiol and R. B. Vinter, Refined estimates on trajectories of state constrained control problems,, Preprint., ().

[14]

S. C. Di Marco and R. L. V. González, Minimax optimal control problems. Numerical analysis of the finite horizon case,, ESAIM: Mathematical Modelling and Numerical Analysis, 33 (1999), 23. doi: 10.1051/m2an:1999103.

[15]

S. C. Di Marco and R. L. V. González, On a system of Hamilton-Jacobi-Bellman inequalities associated to a minimax problem with additive final cost,, International Journal of Mathematics and Mathematical Sciences Issue, (2003), 4517. doi: 10.1155/S0161171203302108.

[16]

L. C. Evans and P. E. Souganidis, Differential games and representation formulas for solutions of Hamilton-Jacobi-Isaacs equations,, Indiana Un. Math.J., 33 (1984), 773. doi: 10.1512/iumj.1984.33.33040.

[17]

I. J. Fialho and T. T. Georgiou, Worst case analysis of nonlinear systems,, IEEE Trans. Autom. Control, 44 (1999), 1180. doi: 10.1109/9.769372.

[18]

H. Frankowska and M. Mazzola, On relations of the adjoint state to the value function for optimal control problems with state constraints,, Nonlinear Differ. Equ. Appl., 20 (2013), 361. doi: 10.1007/s00030-012-0183-0.

[19]

H. Frankowska and F. Rampazzo, Filippov's and Filippov-Wazewski's theorems on closed domains,, J. Differential Eq., 161 (2000), 449. doi: 10.1006/jdeq.2000.3711.

[20]

J. Lygeros, On reachability and minimum cost optimal control,, Automatica, 40 (2004), 917. doi: 10.1016/j.automatica.2004.01.012.

[21]

F. Rampazzo, Differential games with unbounded versus bounded controls,, SIAM J. Control Optim., 36 (1998), 814. doi: 10.1137/S0363012995294602.

[22]

F. Rampazzo, Continuity of the upper and lower value of slow growth differential games,, J. Math. Anal. Appl., 213 (1997), 15. doi: 10.1006/jmaa.1997.5327.

[23]

O. Serea, Discontinuity differential games and control systems with supremum cost,, J. Math. Anal. Appl., 270 (2002), 519. doi: 10.1016/S0022-247X(02)00087-2.

[24]

R. B. Vinter, Minimax optimal control,, SIAM J. Control Optim., 44 (2005), 939. doi: 10.1137/S0363012902415244.

[25]

J. Warga, Optimal Control of Differential and Functional Equations,, Academic Press, (1972).

[1]

Olga Bernardi, Franco Cardin. Minimax and viscosity solutions of Hamilton-Jacobi equations in the convex case. Communications on Pure & Applied Analysis, 2006, 5 (4) : 793-812. doi: 10.3934/cpaa.2006.5.793

[2]

Suxiang He, Yunyun Nie. A class of nonlinear Lagrangian algorithms for minimax problems. Journal of Industrial & Management Optimization, 2013, 9 (1) : 75-97. doi: 10.3934/jimo.2013.9.75

[3]

John A. Morgan. Interception in differential pursuit/evasion games. Journal of Dynamics & Games, 2016, 3 (4) : 335-354. doi: 10.3934/jdg.2016018

[4]

Michael Kühn. Power- and Log-concavity of viscosity solutions to some elliptic Dirichlet problems. Communications on Pure & Applied Analysis, 2018, 17 (6) : 2773-2788. doi: 10.3934/cpaa.2018131

[5]

Yu Zhang, Tao Chen. Minimax problems for set-valued mappings with set optimization. Numerical Algebra, Control & Optimization, 2014, 4 (4) : 327-340. doi: 10.3934/naco.2014.4.327

[6]

Mohamed A. Tawhid, Ahmed F. Ali. A simplex grey wolf optimizer for solving integer programming and minimax problems. Numerical Algebra, Control & Optimization, 2017, 7 (3) : 301-323. doi: 10.3934/naco.2017020

[7]

Junxiang Li, Yan Gao, Tao Dai, Chunming Ye, Qiang Su, Jiazhen Huo. Substitution secant/finite difference method to large sparse minimax problems. Journal of Industrial & Management Optimization, 2014, 10 (2) : 637-663. doi: 10.3934/jimo.2014.10.637

[8]

Chunming Tang, Jinbao Jian, Guoyin Li. A proximal-projection partial bundle method for convex constrained minimax problems. Journal of Industrial & Management Optimization, 2019, 15 (2) : 757-774. doi: 10.3934/jimo.2018069

[9]

Xiao-Bing Li, Qi-Lin Wang, Zhi Lin. Optimality conditions and duality for minimax fractional programming problems with data uncertainty. Journal of Industrial & Management Optimization, 2019, 15 (3) : 1133-1151. doi: 10.3934/jimo.2018089

[10]

Jingzhen Liu, Ka-Fai Cedric Yiu. Optimal stochastic differential games with VaR constraints. Discrete & Continuous Dynamical Systems - B, 2013, 18 (7) : 1889-1907. doi: 10.3934/dcdsb.2013.18.1889

[11]

Alain Bensoussan, Jens Frehse, Christine Grün. Stochastic differential games with a varying number of players. Communications on Pure & Applied Analysis, 2014, 13 (5) : 1719-1736. doi: 10.3934/cpaa.2014.13.1719

[12]

Ellina Grigorieva, Evgenii Khailov. Hierarchical differential games between manufacturer and retailer. Conference Publications, 2009, 2009 (Special) : 300-314. doi: 10.3934/proc.2009.2009.300

[13]

Oliver Juarez-Romero, William Olvera-Lopez, Francisco Sanchez-Sanchez. A simple family of solutions for forest games. Journal of Dynamics & Games, 2017, 4 (2) : 87-96. doi: 10.3934/jdg.2017006

[14]

Anurag Jayswal, Ashish Kumar Prasad, Izhar Ahmad. On minimax fractional programming problems involving generalized $(H_p,r)$-invex functions. Journal of Industrial & Management Optimization, 2014, 10 (4) : 1001-1018. doi: 10.3934/jimo.2014.10.1001

[15]

Shige Peng, Mingyu Xu. Constrained BSDEs, viscosity solutions of variational inequalities and their applications. Mathematical Control & Related Fields, 2013, 3 (2) : 233-244. doi: 10.3934/mcrf.2013.3.233

[16]

Graziano Crasta, Benedetto Piccoli. Viscosity solutions and uniqueness for systems of inhomogeneous balance laws. Discrete & Continuous Dynamical Systems - A, 1997, 3 (4) : 477-502. doi: 10.3934/dcds.1997.3.477

[17]

Inwon C. Kim, Helen K. Lei. Degenerate diffusion with a drift potential: A viscosity solutions approach. Discrete & Continuous Dynamical Systems - A, 2010, 27 (2) : 767-786. doi: 10.3934/dcds.2010.27.767

[18]

Bernd Kawohl, Friedemann Schuricht. First eigenfunctions of the 1-Laplacian are viscosity solutions. Communications on Pure & Applied Analysis, 2015, 14 (1) : 329-339. doi: 10.3934/cpaa.2015.14.329

[19]

Beatris Adriana Escobedo-Trujillo, José Daniel López-Barrientos. Nonzero-sum stochastic differential games with additive structure and average payoffs. Journal of Dynamics & Games, 2014, 1 (4) : 555-578. doi: 10.3934/jdg.2014.1.555

[20]

Beatris Adriana Escobedo-Trujillo, Alejandro Alaffita-Hernández, Raquiel López-Martínez. Constrained stochastic differential games with additive structure: Average and discount payoffs. Journal of Dynamics & Games, 2018, 5 (2) : 109-141. doi: 10.3934/jdg.2018008

2017 Impact Factor: 1.179

Metrics

  • PDF downloads (11)
  • HTML views (0)
  • Cited by (0)

Other articles
by authors

[Back to Top]