# American Institute of Mathematical Sciences

October  2010, 6(4): 895-910. doi: 10.3934/jimo.2010.6.895

## A new exact penalty function method for continuous inequality constrained optimization problems

 1 Department of Mathematics and Statistics, Curtin University of Technology, Kent Street, Bentley 6102, WA, Australia, Australia 2 Department of Mathematics, Shanghai University, 99, Shangda Road, 200444, Shanghai, China, China

Received  March 2010 Revised  July 2010 Published  September 2010

In this paper, a computational approach based on a new exact penalty function method is devised for solving a class of continuous inequality constrained optimization problems. The continuous inequality constraints are first approximated by smooth function in integral form. Then, we construct a new exact penalty function, where the summation of all these approximate smooth functions in integral form, called the constraint violation, is appended to the objective function. In this way, we obtain a sequence of approximate unconstrained optimization problems. It is shown that if the value of the penalty parameter is sufficiently large, then any local minimizer of the corresponding unconstrained optimization problem is a local minimizer of the original problem. For illustration, three examples are solved using the proposed method. From the solutions obtained, we observe that the values of their objective functions are amongst the smallest when compared with those obtained by other existing methods available in the literature. More importantly, our method finds solution which satisfies the continuous inequality constraints.
Citation: Changjun Yu, Kok Lay Teo, Liansheng Zhang, Yanqin Bai. A new exact penalty function method for continuous inequality constrained optimization problems. Journal of Industrial & Management Optimization, 2010, 6 (4) : 895-910. doi: 10.3934/jimo.2010.6.895
##### References:
 [1] R. K. Brayton, G. D. Hachtel and A. L. Sangiovanni-Vincentlli, A survey of optimization techniques for integrated circuit design,, Proc. IEEE, 69 (1981), 1334. doi: 10.1109/PROC.1981.12170. Google Scholar [2] A. R. Conn, N. I. M. Gould and Ph. L. Toint, Methods for nonlinear constraints in optimization calculations,, in The State of the Art in Numerical Analysis, (1997), 363. Google Scholar [3] Z. G. Feng, K. L. Teo and V. Rehbock, A smoothing approach for semi-infinite programming with projected Newton-type algorithm,, Journal of Industrial and Management Optimization, 5 (2009), 141. doi: 10.3934/jimo.2009.5.141. Google Scholar [4] G. Gonzaga, E. Polak and R. Trahan, An improved algorithm for optimization problems with functional inequality constraints,, IEEE Transactions on Automatic Control, AC-25 (1980), 49. doi: 10.1109/TAC.1980.1102227. Google Scholar [5] R. Hettich and K. O. Kortanek, Semi-infinite programming: Theory, methods, and applications,, SIAM Review, 35 (1993), 380. doi: 10.1137/1035089. Google Scholar [6] W. Huyer and A. Neumaier, A new exact penalty function,, SIAM J.Optim, 13 (2003), 1141. doi: 10.1137/S1052623401390537. Google Scholar [7] S. Ito, Y. Liu and K. L. Teo, A dual parametrization method for convex semi-infinite programming,, Annals of Operations Research, 98 (2000), 189. doi: 10.1023/A:1019208524259. Google Scholar [8] L. S. Jennings and K. L. Teo, A computational algorithm for functional inequality constrained optimization problems,, Automatica, 26 (1990), 371. doi: 10.1016/0005-1098(90)90131-Z. Google Scholar [9] D. H. Li, L. Q. Qi, J. Tam and S. Y. Wu, A smoothing newton method for semi-infinite programming,, Journal of Global Optimization, 30 (2004), 169. doi: 10.1007/s10898-004-8266-z. Google Scholar [10] Y. Liu, S. Ito, H. W. J. Lee and K. L. Teo, Semi-infinite programming approach to continuously-constrained linear-quadratic optimal control problems,, Journal of Optimization Theory and Applications, 108 (2001), 617. doi: 10.1023/A:1017539525721. Google Scholar [11] Y. Liu and K. L. Teo, An adaptive dual parametrization algorithm for quadratic semi-infinite programming problems,, Journal of Global Optimization, 24 (2002), 205. doi: 10.1023/A:1020234019886. Google Scholar [12] Y. Liu, K. L. Teo and S. Ito, Global optimization in linear-quadratic semi-infinite programming,, Computing, 15 (2001), 119. Google Scholar [13] Y. Liu, K. L. Teo and S. Y. Wu, A new quadratic semi-infinite programming algorithm based on dual parametri,, Journal of Global Optimization, 29 (2004), 401. doi: 10.1023/B:JOGO.0000047910.80739.95. Google Scholar [14] Y. Liu, C. H. Tseng and K. L. Teo, A unified quadratic semi-infinite programming approach to time and frequence domain constrained digital filter design,, Communications in Information and Systems, 2 (2002), 399. Google Scholar [15] Q. Ni, C. Ling, L. Q. Qi and K. L. Teo, A truncated projected Newton-type algorithm for large-scale semi-infinite programming,, SIAM Journal of Optimization, 16 (2006), 1137. doi: 10.1137/040619867. Google Scholar [16] E. Polak and D. Q. Mayne, An algorithm for optimization problems with functional inequality constraints,, IEEE Transactions on Automatic Control, AC-21 (1976), 184. doi: 10.1109/TAC.1976.1101196. Google Scholar [17] E. Polak, D. Q. Mayne and D. M. Stimler, Control system design via semi-infinite optimization: A review,, Proc. IEEE, 72 (1984), 1777. doi: 10.1109/PROC.1984.13086. Google Scholar [18] E. Polak and Y. Wardi, Nondifferential optimization algorithm for designing control systems having singular value inequalities,, Automatica, 18 (1982), 267. doi: 10.1016/0005-1098(82)90087-5. Google Scholar [19] D. F. Shanno and E. M. Simantiraki, Interior point methods for linear and nonlinear programming, in The State of the Art in Numerical Analysis,, I. S. Duff and G. A. Watson, (1997), 339. Google Scholar [20] K. L. Teo, V. Rehbock and L. S. Jennings, A new computational algorithm for functional inequality constrained optimization problems,, Automatica, 29 (1993), 789. doi: 10.1016/0005-1098(93)90076-6. Google Scholar [21] K. L. Teo, X. Q. Yang and L. S. Jennings, Computational discretization algorithms for functional inequality constrained optimization,, Annals of Operations Research, 98 (2000), 215. doi: 10.1023/A:1019260508329. Google Scholar [22] X. J. Tong and S. Z. Zhou, A smoothing projected Newton-type method for semismooth equations with bound constraints,, Journal of Industrial and Management Optimization, 2 (2005), 235. Google Scholar [23] S. Y. Wu, D. H. Li, L. Q. Qi and G. L. Zhou, An iterative method for solving KKT system of the semi-infinite programming,, Optimization Methods and Software, 20 (2005), 629. doi: 10.1080/10556780500094739. Google Scholar [24] X. Q. Yang and K. L. Teo, Nonlinear Lagrangian functions and applications to semi-infinite programs,, Annals of Operations Research, 103 (2001), 235. doi: 10.1023/A:1012911307208. Google Scholar [25] L. S. Zhang, "New Simple Exact Penalty Function for Constrained Minimization on $\mathbbR^n$,", Report in the 4th Australia-China workshop on optimization: Theory, (2009). Google Scholar

show all references

##### References:
 [1] R. K. Brayton, G. D. Hachtel and A. L. Sangiovanni-Vincentlli, A survey of optimization techniques for integrated circuit design,, Proc. IEEE, 69 (1981), 1334. doi: 10.1109/PROC.1981.12170. Google Scholar [2] A. R. Conn, N. I. M. Gould and Ph. L. Toint, Methods for nonlinear constraints in optimization calculations,, in The State of the Art in Numerical Analysis, (1997), 363. Google Scholar [3] Z. G. Feng, K. L. Teo and V. Rehbock, A smoothing approach for semi-infinite programming with projected Newton-type algorithm,, Journal of Industrial and Management Optimization, 5 (2009), 141. doi: 10.3934/jimo.2009.5.141. Google Scholar [4] G. Gonzaga, E. Polak and R. Trahan, An improved algorithm for optimization problems with functional inequality constraints,, IEEE Transactions on Automatic Control, AC-25 (1980), 49. doi: 10.1109/TAC.1980.1102227. Google Scholar [5] R. Hettich and K. O. Kortanek, Semi-infinite programming: Theory, methods, and applications,, SIAM Review, 35 (1993), 380. doi: 10.1137/1035089. Google Scholar [6] W. Huyer and A. Neumaier, A new exact penalty function,, SIAM J.Optim, 13 (2003), 1141. doi: 10.1137/S1052623401390537. Google Scholar [7] S. Ito, Y. Liu and K. L. Teo, A dual parametrization method for convex semi-infinite programming,, Annals of Operations Research, 98 (2000), 189. doi: 10.1023/A:1019208524259. Google Scholar [8] L. S. Jennings and K. L. Teo, A computational algorithm for functional inequality constrained optimization problems,, Automatica, 26 (1990), 371. doi: 10.1016/0005-1098(90)90131-Z. Google Scholar [9] D. H. Li, L. Q. Qi, J. Tam and S. Y. Wu, A smoothing newton method for semi-infinite programming,, Journal of Global Optimization, 30 (2004), 169. doi: 10.1007/s10898-004-8266-z. Google Scholar [10] Y. Liu, S. Ito, H. W. J. Lee and K. L. Teo, Semi-infinite programming approach to continuously-constrained linear-quadratic optimal control problems,, Journal of Optimization Theory and Applications, 108 (2001), 617. doi: 10.1023/A:1017539525721. Google Scholar [11] Y. Liu and K. L. Teo, An adaptive dual parametrization algorithm for quadratic semi-infinite programming problems,, Journal of Global Optimization, 24 (2002), 205. doi: 10.1023/A:1020234019886. Google Scholar [12] Y. Liu, K. L. Teo and S. Ito, Global optimization in linear-quadratic semi-infinite programming,, Computing, 15 (2001), 119. Google Scholar [13] Y. Liu, K. L. Teo and S. Y. Wu, A new quadratic semi-infinite programming algorithm based on dual parametri,, Journal of Global Optimization, 29 (2004), 401. doi: 10.1023/B:JOGO.0000047910.80739.95. Google Scholar [14] Y. Liu, C. H. Tseng and K. L. Teo, A unified quadratic semi-infinite programming approach to time and frequence domain constrained digital filter design,, Communications in Information and Systems, 2 (2002), 399. Google Scholar [15] Q. Ni, C. Ling, L. Q. Qi and K. L. Teo, A truncated projected Newton-type algorithm for large-scale semi-infinite programming,, SIAM Journal of Optimization, 16 (2006), 1137. doi: 10.1137/040619867. Google Scholar [16] E. Polak and D. Q. Mayne, An algorithm for optimization problems with functional inequality constraints,, IEEE Transactions on Automatic Control, AC-21 (1976), 184. doi: 10.1109/TAC.1976.1101196. Google Scholar [17] E. Polak, D. Q. Mayne and D. M. Stimler, Control system design via semi-infinite optimization: A review,, Proc. IEEE, 72 (1984), 1777. doi: 10.1109/PROC.1984.13086. Google Scholar [18] E. Polak and Y. Wardi, Nondifferential optimization algorithm for designing control systems having singular value inequalities,, Automatica, 18 (1982), 267. doi: 10.1016/0005-1098(82)90087-5. Google Scholar [19] D. F. Shanno and E. M. Simantiraki, Interior point methods for linear and nonlinear programming, in The State of the Art in Numerical Analysis,, I. S. Duff and G. A. Watson, (1997), 339. Google Scholar [20] K. L. Teo, V. Rehbock and L. S. Jennings, A new computational algorithm for functional inequality constrained optimization problems,, Automatica, 29 (1993), 789. doi: 10.1016/0005-1098(93)90076-6. Google Scholar [21] K. L. Teo, X. Q. Yang and L. S. Jennings, Computational discretization algorithms for functional inequality constrained optimization,, Annals of Operations Research, 98 (2000), 215. doi: 10.1023/A:1019260508329. Google Scholar [22] X. J. Tong and S. Z. Zhou, A smoothing projected Newton-type method for semismooth equations with bound constraints,, Journal of Industrial and Management Optimization, 2 (2005), 235. Google Scholar [23] S. Y. Wu, D. H. Li, L. Q. Qi and G. L. Zhou, An iterative method for solving KKT system of the semi-infinite programming,, Optimization Methods and Software, 20 (2005), 629. doi: 10.1080/10556780500094739. Google Scholar [24] X. Q. Yang and K. L. Teo, Nonlinear Lagrangian functions and applications to semi-infinite programs,, Annals of Operations Research, 103 (2001), 235. doi: 10.1023/A:1012911307208. Google Scholar [25] L. S. Zhang, "New Simple Exact Penalty Function for Constrained Minimization on $\mathbbR^n$,", Report in the 4th Australia-China workshop on optimization: Theory, (2009). Google Scholar
 [1] Cheng Ma, Xun Li, Ka-Fai Cedric Yiu, Yongjian Yang, Liansheng Zhang. On an exact penalty function method for semi-infinite programming problems. Journal of Industrial & Management Optimization, 2012, 8 (3) : 705-726. doi: 10.3934/jimo.2012.8.705 [2] Yanqun Liu, Ming-Fang Ding. A ladder method for linear semi-infinite programming. Journal of Industrial & Management Optimization, 2014, 10 (2) : 397-412. doi: 10.3934/jimo.2014.10.397 [3] Changjun Yu, Kok Lay Teo, Liansheng Zhang, Yanqin Bai. On a refinement of the convergence analysis for the new exact penalty function method for continuous inequality constrained optimization problem. Journal of Industrial & Management Optimization, 2012, 8 (2) : 485-491. doi: 10.3934/jimo.2012.8.485 [4] Ahmet Sahiner, Gulden Kapusuz, Nurullah Yilmaz. A new smoothing approach to exact penalty functions for inequality constrained optimization problems. Numerical Algebra, Control & Optimization, 2016, 6 (2) : 161-173. doi: 10.3934/naco.2016006 [5] Zhi Guo Feng, Kok Lay Teo, Volker Rehbock. A smoothing approach for semi-infinite programming with projected Newton-type algorithm. Journal of Industrial & Management Optimization, 2009, 5 (1) : 141-151. doi: 10.3934/jimo.2009.5.141 [6] Jinchuan Zhou, Changyu Wang, Naihua Xiu, Soonyi Wu. First-order optimality conditions for convex semi-infinite min-max programming with noncompact sets. Journal of Industrial & Management Optimization, 2009, 5 (4) : 851-866. doi: 10.3934/jimo.2009.5.851 [7] Meixia Li, Changyu Wang, Biao Qu. Non-convex semi-infinite min-max optimization with noncompact sets. Journal of Industrial & Management Optimization, 2017, 13 (4) : 1859-1881. doi: 10.3934/jimo.2017022 [8] Xiaodong Fan, Tian Qin. Stability analysis for generalized semi-infinite optimization problems under functional perturbations. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-13. doi: 10.3934/jimo.2018201 [9] Z.Y. Wu, H.W.J. Lee, F.S. Bai, L.S. Zhang. Quadratic smoothing approximation to $l_1$ exact penalty function in global optimization. Journal of Industrial & Management Optimization, 2005, 1 (4) : 533-547. doi: 10.3934/jimo.2005.1.533 [10] Zhongwen Chen, Songqiang Qiu, Yujie Jiao. A penalty-free method for equality constrained optimization. Journal of Industrial & Management Optimization, 2013, 9 (2) : 391-409. doi: 10.3934/jimo.2013.9.391 [11] Jinchuan Zhou, Naihua Xiu, Jein-Shan Chen. Solution properties and error bounds for semi-infinite complementarity problems. Journal of Industrial & Management Optimization, 2013, 9 (1) : 99-115. doi: 10.3934/jimo.2013.9.99 [12] Burcu Özçam, Hao Cheng. A discretization based smoothing method for solving semi-infinite variational inequalities. Journal of Industrial & Management Optimization, 2005, 1 (2) : 219-233. doi: 10.3934/jimo.2005.1.219 [13] Yongjian Yang, Zhiyou Wu, Fusheng Bai. A filled function method for constrained nonlinear integer programming. Journal of Industrial & Management Optimization, 2008, 4 (2) : 353-362. doi: 10.3934/jimo.2008.4.353 [14] Zhiqing Meng, Qiying Hu, Chuangyin Dang. A penalty function algorithm with objective parameters for nonlinear mathematical programming. Journal of Industrial & Management Optimization, 2009, 5 (3) : 585-601. doi: 10.3934/jimo.2009.5.585 [15] Rafael del Rio, Mikhail Kudryavtsev, Luis O. Silva. Inverse problems for Jacobi operators III: Mass-spring perturbations of semi-infinite systems. Inverse Problems & Imaging, 2012, 6 (4) : 599-621. doi: 10.3934/ipi.2012.6.599 [16] Igor Chueshov. Remark on an elastic plate interacting with a gas in a semi-infinite tube: Periodic solutions. Evolution Equations & Control Theory, 2016, 5 (4) : 561-566. doi: 10.3934/eect.2016019 [17] Roman Chapko, B. Tomas Johansson. An alternating boundary integral based method for a Cauchy problem for the Laplace equation in semi-infinite regions. Inverse Problems & Imaging, 2008, 2 (3) : 317-333. doi: 10.3934/ipi.2008.2.317 [18] Azhar Ali Zafar, Khurram Shabbir, Asim Naseem, Muhammad Waqas Ashraf. MHD natural convection boundary-layer flow over a semi-infinite heated plate with arbitrary inclination. Discrete & Continuous Dynamical Systems - S, 2018, 0 (0) : 1007-1015. doi: 10.3934/dcdss.2020059 [19] Ardeshir Ahmadi, Hamed Davari-Ardakani. A multistage stochastic programming framework for cardinality constrained portfolio optimization. Numerical Algebra, Control & Optimization, 2017, 7 (3) : 359-377. doi: 10.3934/naco.2017023 [20] Songqiang Qiu, Zhongwen Chen. An adaptively regularized sequential quadratic programming method for equality constrained optimization. Journal of Industrial & Management Optimization, 2017, 13 (5) : 1-14. doi: 10.3934/jimo.2019075

2018 Impact Factor: 1.025