2015, 35(9): 4527-4552. doi: 10.3934/dcds.2015.35.4527

Asymptotic problems in optimal control with a vanishing Lagrangian and unbounded data

1. 

Dipartimento di Matematica Pura ed Applicata, Via Trieste, 63, 35121 Padova

2. 

Dipartimento di Matematica, Via Trieste, 63, 35121 Padova, Italy

Received  April 2014 Revised  September 2014 Published  April 2015

In this paper we give a representation formula for the limit of the finite horizon problem as the horizon becomes infinite, with a nonnegative Lagrangian and unbounded data. It is related to the limit of the discounted infinite horizon problem, as the discount factor goes to zero. We give sufficient conditions to characterize the limit function as unique nonnegative solution of the associated HJB equation. We also briefly discuss the ergodic problem.
Citation: Monica Motta, Caterina Sartori. Asymptotic problems in optimal control with a vanishing Lagrangian and unbounded data. Discrete & Continuous Dynamical Systems - A, 2015, 35 (9) : 4527-4552. doi: 10.3934/dcds.2015.35.4527
References:
[1]

O. Alvarez and E. N. Barron, Ergodic control in $L^\infty$. Set-valued analysis in control theory,, Set-Valued Anal., 8 (2000), 51. doi: 10.1023/A:1008766206921.

[2]

M. Arisawa, Ergodic problem for the Hamilton-Jacobi-Bellman equation. II.,, Ann. Inst. H. Poincaré Anal. Non Linéaire, 15 (1998), 1. doi: 10.1016/S0294-1449(99)80019-5.

[3]

M. Arisawa and P. L. Lions, On ergodic stochastic control,, Comm. Partial Differential Equations, 23 (1998), 2187. doi: 10.1080/03605309808821413.

[4]

J. P. Aubin and A. Cellina, Differential Inclusions. Set-valued maps and Viability Theory,, Springer-Verlag, (1984). doi: 10.1007/978-3-642-69512-4.

[5]

A. Bacciotti and L. Rosier, Liapunov Functions and Stability in Control Theory, Second edition,, Communications and Control Engineering Series. Springer-Verlag, (2005). doi: 10.1007/b139028.

[6]

M. Bardi, A boundary value problem for the minimum-time function,, SIAM J. Control Optim., 27 (1989), 776. doi: 10.1137/0327041.

[7]

M. Bardi and I. Capuzzo Dolcetta, Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations,, Ed. Birkhäuser, (1997). doi: 10.1007/978-0-8176-4755-1.

[8]

M. Bardi and F. Da Lio, On the Bellman equation for some unbounded control problems,, NoDEA Nonlinear Differential Equations Appl., 4 (1997), 491. doi: 10.1007/s000300050027.

[9]

G. Barles and J. M. Roquejoffre, Ergodic type problems and large time behavior of unbounded solutions of Hamilton-Jacobi equations,, Comm. Partial Differential Equations, 31 (2006), 1209. doi: 10.1080/03605300500361461.

[10]

A. Bressan and B. Piccoli, Introduction to the Mathematical Theory of Control,, AIMS Series on Applied Mathematics, (2007).

[11]

A. Bressan and F. Rampazzo, On differential systems with vector-valued impulsive controls,, Boll. Un. Mat. Ital. B (7), 2 (1988), 641.

[12]

P. Cannarsa and C. Sinestrari, Convexity properties of the minimum time function,, J. of Calc. Var. Partial Differential Equations, 3 (1995), 273. doi: 10.1007/BF01189393.

[13]

D. A. Carlson, A. Haurie and A. Leizarowitz, Infinite Horizon Optimal Control: Deterministic and Stochastic Systems, , Springer-Verlag, (1991). doi: 10.1007/978-3-642-76755-5.

[14]

F. Da Lio, On the Bellman equation for infinite horizon problems with unbounded cost functional,, Appl. Math. Optim., 41 (2000), 171. doi: 10.1007/s002459911010.

[15]

W. Fleming and H. M. Soner, Controlled Markov Processes and Viscosity Solutions, Second edition,, Stochastic modelling and applied probability, (2006).

[16]

M. Garavello and P. Soravia, Optimality principles and uniqueness for Bellman equations of unbounded control problems with discontinuous running cost,, NoDEA Nonlinear Differential Equations Appl., 11 (2004), 271. doi: 10.1007/s00030-004-1058-9.

[17]

Y. Giga, Q. Liu and H. Mitake, Large-time asymptotics for one-dimensional Dirichlet problems for Hamilton-Jacobi equations with noncoercive Hamiltonians,, J. Differential Equations, 252 (2012), 1263. doi: 10.1016/j.jde.2011.10.010.

[18]

R. Goebel, Duality and uniqueness of convex solutions to stationary Hamilton-Jacobi equations,, Trans. Amer. Math. Soc., 357 (2005), 2187. doi: 10.1090/S0002-9947-05-03817-1.

[19]

B. Miller and E. Rubinovich, Impulsive Control in Continuous and Discrete-Continuous Systems,, Kluwer Academic/Plenum Publishers, (2003). doi: 10.1007/978-1-4615-0095-7.

[20]

M. Motta, Viscosity solutions of HJB equations with unbounded data and characteristic points,, Appl. Math. Optim., 49 (2004), 1. doi: 10.1007/s00245-003-0777-3.

[21]

M. Motta and F. Rampazzo, Asymptotic controllability and optimal control,, J. Differential Equations, 254 (2013), 2744. doi: 10.1016/j.jde.2013.01.006.

[22]

M. Motta and C. Sartori, On asymptotic exit-time control problems lacking coercivity,, ESAIM Control, 20 (2014), 957. doi: 10.1051/cocv/2014003.

[23]

M. Motta and C. Sartori, The value function of an asymptotic exit-time optimal control problem,, NoDEA Nonlinear Differential Equations Appl., 22 (2015), 21. doi: 10.1007/s00030-014-0274-1.

[24]

M. Motta and C. Sartori, Uniqueness results for boundary value problems arising from finite fuel and other singular and unbounded stochastic control problems,, Discrete Contin. Dyn. Syst., 21 (2008), 513. doi: 10.3934/dcds.2008.21.513.

[25]

M. Quincampoix and J. Renault, On the existence of a limit value in some nonexpansive optimal control problems,, SIAM J. Control Optim., 49 (2011), 2118. doi: 10.1137/090756818.

[26]

F. Rampazzo and C. Sartori, Hamilton-Jacobi-Bellman equations with fast gradient-dependence,, Indiana Univ. Math. J., 49 (2000), 1043. doi: 10.1512/iumj.2000.49.1736.

[27]

J. Warga, Optimal Control of Differential and Functional Equations,, Academic Press, (1972).

show all references

References:
[1]

O. Alvarez and E. N. Barron, Ergodic control in $L^\infty$. Set-valued analysis in control theory,, Set-Valued Anal., 8 (2000), 51. doi: 10.1023/A:1008766206921.

[2]

M. Arisawa, Ergodic problem for the Hamilton-Jacobi-Bellman equation. II.,, Ann. Inst. H. Poincaré Anal. Non Linéaire, 15 (1998), 1. doi: 10.1016/S0294-1449(99)80019-5.

[3]

M. Arisawa and P. L. Lions, On ergodic stochastic control,, Comm. Partial Differential Equations, 23 (1998), 2187. doi: 10.1080/03605309808821413.

[4]

J. P. Aubin and A. Cellina, Differential Inclusions. Set-valued maps and Viability Theory,, Springer-Verlag, (1984). doi: 10.1007/978-3-642-69512-4.

[5]

A. Bacciotti and L. Rosier, Liapunov Functions and Stability in Control Theory, Second edition,, Communications and Control Engineering Series. Springer-Verlag, (2005). doi: 10.1007/b139028.

[6]

M. Bardi, A boundary value problem for the minimum-time function,, SIAM J. Control Optim., 27 (1989), 776. doi: 10.1137/0327041.

[7]

M. Bardi and I. Capuzzo Dolcetta, Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations,, Ed. Birkhäuser, (1997). doi: 10.1007/978-0-8176-4755-1.

[8]

M. Bardi and F. Da Lio, On the Bellman equation for some unbounded control problems,, NoDEA Nonlinear Differential Equations Appl., 4 (1997), 491. doi: 10.1007/s000300050027.

[9]

G. Barles and J. M. Roquejoffre, Ergodic type problems and large time behavior of unbounded solutions of Hamilton-Jacobi equations,, Comm. Partial Differential Equations, 31 (2006), 1209. doi: 10.1080/03605300500361461.

[10]

A. Bressan and B. Piccoli, Introduction to the Mathematical Theory of Control,, AIMS Series on Applied Mathematics, (2007).

[11]

A. Bressan and F. Rampazzo, On differential systems with vector-valued impulsive controls,, Boll. Un. Mat. Ital. B (7), 2 (1988), 641.

[12]

P. Cannarsa and C. Sinestrari, Convexity properties of the minimum time function,, J. of Calc. Var. Partial Differential Equations, 3 (1995), 273. doi: 10.1007/BF01189393.

[13]

D. A. Carlson, A. Haurie and A. Leizarowitz, Infinite Horizon Optimal Control: Deterministic and Stochastic Systems, , Springer-Verlag, (1991). doi: 10.1007/978-3-642-76755-5.

[14]

F. Da Lio, On the Bellman equation for infinite horizon problems with unbounded cost functional,, Appl. Math. Optim., 41 (2000), 171. doi: 10.1007/s002459911010.

[15]

W. Fleming and H. M. Soner, Controlled Markov Processes and Viscosity Solutions, Second edition,, Stochastic modelling and applied probability, (2006).

[16]

M. Garavello and P. Soravia, Optimality principles and uniqueness for Bellman equations of unbounded control problems with discontinuous running cost,, NoDEA Nonlinear Differential Equations Appl., 11 (2004), 271. doi: 10.1007/s00030-004-1058-9.

[17]

Y. Giga, Q. Liu and H. Mitake, Large-time asymptotics for one-dimensional Dirichlet problems for Hamilton-Jacobi equations with noncoercive Hamiltonians,, J. Differential Equations, 252 (2012), 1263. doi: 10.1016/j.jde.2011.10.010.

[18]

R. Goebel, Duality and uniqueness of convex solutions to stationary Hamilton-Jacobi equations,, Trans. Amer. Math. Soc., 357 (2005), 2187. doi: 10.1090/S0002-9947-05-03817-1.

[19]

B. Miller and E. Rubinovich, Impulsive Control in Continuous and Discrete-Continuous Systems,, Kluwer Academic/Plenum Publishers, (2003). doi: 10.1007/978-1-4615-0095-7.

[20]

M. Motta, Viscosity solutions of HJB equations with unbounded data and characteristic points,, Appl. Math. Optim., 49 (2004), 1. doi: 10.1007/s00245-003-0777-3.

[21]

M. Motta and F. Rampazzo, Asymptotic controllability and optimal control,, J. Differential Equations, 254 (2013), 2744. doi: 10.1016/j.jde.2013.01.006.

[22]

M. Motta and C. Sartori, On asymptotic exit-time control problems lacking coercivity,, ESAIM Control, 20 (2014), 957. doi: 10.1051/cocv/2014003.

[23]

M. Motta and C. Sartori, The value function of an asymptotic exit-time optimal control problem,, NoDEA Nonlinear Differential Equations Appl., 22 (2015), 21. doi: 10.1007/s00030-014-0274-1.

[24]

M. Motta and C. Sartori, Uniqueness results for boundary value problems arising from finite fuel and other singular and unbounded stochastic control problems,, Discrete Contin. Dyn. Syst., 21 (2008), 513. doi: 10.3934/dcds.2008.21.513.

[25]

M. Quincampoix and J. Renault, On the existence of a limit value in some nonexpansive optimal control problems,, SIAM J. Control Optim., 49 (2011), 2118. doi: 10.1137/090756818.

[26]

F. Rampazzo and C. Sartori, Hamilton-Jacobi-Bellman equations with fast gradient-dependence,, Indiana Univ. Math. J., 49 (2000), 1043. doi: 10.1512/iumj.2000.49.1736.

[27]

J. Warga, Optimal Control of Differential and Functional Equations,, Academic Press, (1972).

[1]

Maciej Smołka. Asymptotic behaviour of optimal solutions of control problems governed by inclusions. Discrete & Continuous Dynamical Systems - A, 1998, 4 (4) : 641-652. doi: 10.3934/dcds.1998.4.641

[2]

Y. Peng, X. Xiang. Second order nonlinear impulsive time-variant systems with unbounded perturbation and optimal controls. Journal of Industrial & Management Optimization, 2008, 4 (1) : 17-32. doi: 10.3934/jimo.2008.4.17

[3]

M. Motta, C. Sartori. Exit time problems for nonlinear unbounded control systems. Discrete & Continuous Dynamical Systems - A, 1999, 5 (1) : 137-156. doi: 10.3934/dcds.1999.5.137

[4]

Catherine Choquet, Ali Sili. Homogenization of a model of displacement with unbounded viscosity. Networks & Heterogeneous Media, 2009, 4 (4) : 649-666. doi: 10.3934/nhm.2009.4.649

[5]

Leszek Gasiński, Nikolaos S. Papageorgiou. Multiplicity of solutions for Neumann problems with an indefinite and unbounded potential. Communications on Pure & Applied Analysis, 2013, 12 (5) : 1985-1999. doi: 10.3934/cpaa.2013.12.1985

[6]

Shihchung Chiang. Numerical optimal unbounded control with a singular integro-differential equation as a constraint. Conference Publications, 2013, 2013 (special) : 129-137. doi: 10.3934/proc.2013.2013.129

[7]

Peter I. Kogut. On approximation of an optimal boundary control problem for linear elliptic equation with unbounded coefficients. Discrete & Continuous Dynamical Systems - A, 2014, 34 (5) : 2105-2133. doi: 10.3934/dcds.2014.34.2105

[8]

Juan C. Jara, Felipe Rivero. Asymptotic behaviour for prey-predator systems and logistic equations with unbounded time-dependent coefficients. Discrete & Continuous Dynamical Systems - A, 2014, 34 (10) : 4127-4137. doi: 10.3934/dcds.2014.34.4127

[9]

Shigeaki Koike, Andrzej Świech. Local maximum principle for $L^p$-viscosity solutions of fully nonlinear elliptic PDEs with unbounded coefficients. Communications on Pure & Applied Analysis, 2012, 11 (5) : 1897-1910. doi: 10.3934/cpaa.2012.11.1897

[10]

Monica Motta, Caterina Sartori. Uniqueness results for boundary value problems arising from finite fuel and other singular and unbounded stochastic control problems. Discrete & Continuous Dynamical Systems - A, 2008, 21 (2) : 513-535. doi: 10.3934/dcds.2008.21.513

[11]

Filomena Pacella, Dora Salazar. Asymptotic behaviour of sign changing radial solutions of Lane Emden Problems in the annulus. Discrete & Continuous Dynamical Systems - S, 2014, 7 (4) : 793-805. doi: 10.3934/dcdss.2014.7.793

[12]

V. Barbu. Periodic solutions to unbounded Hamiltonian system. Discrete & Continuous Dynamical Systems - A, 1995, 1 (2) : 277-283. doi: 10.3934/dcds.1995.1.277

[13]

C. Brändle, E. Chasseigne, Raúl Ferreira. Unbounded solutions of the nonlocal heat equation. Communications on Pure & Applied Analysis, 2011, 10 (6) : 1663-1686. doi: 10.3934/cpaa.2011.10.1663

[14]

C.Z. Wu, K. L. Teo. Global impulsive optimal control computation. Journal of Industrial & Management Optimization, 2006, 2 (4) : 435-450. doi: 10.3934/jimo.2006.2.435

[15]

Giorgio Fusco, Francesco Leonetti, Cristina Pignotti. On the asymptotic behavior of symmetric solutions of the Allen-Cahn equation in unbounded domains in $\mathbb{R}^2$. Discrete & Continuous Dynamical Systems - A, 2017, 37 (2) : 725-742. doi: 10.3934/dcds.2017030

[16]

Helmut Abels. Nonstationary Stokes system with variable viscosity in bounded and unbounded domains. Discrete & Continuous Dynamical Systems - S, 2010, 3 (2) : 141-157. doi: 10.3934/dcdss.2010.3.141

[17]

Matthias Gerdts, Martin Kunkel. Convergence analysis of Euler discretization of control-state constrained optimal control problems with controls of bounded variation. Journal of Industrial & Management Optimization, 2014, 10 (1) : 311-336. doi: 10.3934/jimo.2014.10.311

[18]

Yunfei Peng, X. Xiang. A class of nonlinear impulsive differential equation and optimal controls on time scales. Discrete & Continuous Dynamical Systems - B, 2011, 16 (4) : 1137-1155. doi: 10.3934/dcdsb.2011.16.1137

[19]

Nikolaos S. Papageorgiou, Patrick Winkert. Double resonance for Robin problems with indefinite and unbounded potential. Discrete & Continuous Dynamical Systems - S, 2018, 11 (2) : 323-344. doi: 10.3934/dcdss.2018018

[20]

Hongyong Deng, Wei Wei. Existence and stability analysis for nonlinear optimal control problems with $1$-mean equicontinuous controls. Journal of Industrial & Management Optimization, 2015, 11 (4) : 1409-1422. doi: 10.3934/jimo.2015.11.1409

2017 Impact Factor: 1.179

Metrics

  • PDF downloads (9)
  • HTML views (0)
  • Cited by (1)

Other articles
by authors

[Back to Top]