2005, 2005(Special): 947-956. doi: 10.3934/proc.2005.2005.947

Notes on the convergence and applications of surrogate optimization

1. 

Department of Electrical and Computer Engineering, University of Dayton, Dayton, OH45469-0226, United States, United States

2. 

Department of Mathematics, Baylor University, Waco, TX76798-7328

Received  September 2004 Revised  April 2005 Published  September 2005

Surrogate optimization is a computational procedure that uses a sequence of approximations of the objective function to predict an optimum. Even in the case when the derivative information of the objective function is not available, the surrogate functions can still be constructed only based on the function values. Moreover, the optimization method may provide required tools for computing the numerical solution of certain nonlinear differential equations in recent engineering applications, such as the optimal determination of the perturbation values in robot control dynamic systems [13, 16, 18]. In this paper, we will present a direct convergence analysis of the surrogate optimization process in one dimensional fashion via polynomial interpolations of objective function values. Numerical experiments will be given to illustrate the effectiveness of the algorithms developed. An application in multi-agent cooperative search problem will be also presented.
Citation: Chunlei Zhang, Qin Sheng, Raúl Ordóñez. Notes on the convergence and applications of surrogate optimization. Conference Publications, 2005, 2005 (Special) : 947-956. doi: 10.3934/proc.2005.2005.947
[1]

Gleb Beliakov. Construction of aggregation operators for automated decision making via optimal interpolation and global optimization. Journal of Industrial & Management Optimization, 2007, 3 (2) : 193-208. doi: 10.3934/jimo.2007.3.193

[2]

Martha Garlick, James Powell, David Eyre, Thomas Robbins. Mathematically modeling PCR: An asymptotic approximation with potential for optimization. Mathematical Biosciences & Engineering, 2010, 7 (2) : 363-384. doi: 10.3934/mbe.2010.7.363

[3]

Xuemei Li, Rafael de la Llave. Convergence of differentiable functions on closed sets and remarks on the proofs of the "Converse Approximation Lemmas''. Discrete & Continuous Dynamical Systems - S, 2010, 3 (4) : 623-641. doi: 10.3934/dcdss.2010.3.623

[4]

Pierre Fabrie, Elodie Jaumouillé, Iraj Mortazavi, Olivier Piller. Numerical approximation of an optimization problem to reduce leakage in water distribution systems. Mathematical Control & Related Fields, 2012, 2 (2) : 101-120. doi: 10.3934/mcrf.2012.2.101

[5]

Luke Finlay, Vladimir Gaitsgory, Ivan Lebedev. Linear programming solutions of periodic optimization problems: approximation of the optimal control. Journal of Industrial & Management Optimization, 2007, 3 (2) : 399-413. doi: 10.3934/jimo.2007.3.399

[6]

Charles Fefferman. Interpolation by linear programming I. Discrete & Continuous Dynamical Systems - A, 2011, 30 (2) : 477-492. doi: 10.3934/dcds.2011.30.477

[7]

Jean Dolbeault, Maria J. Esteban, Michał Kowalczyk, Michael Loss. Improved interpolation inequalities on the sphere. Discrete & Continuous Dynamical Systems - S, 2014, 7 (4) : 695-724. doi: 10.3934/dcdss.2014.7.695

[8]

Weijun Zhou, Youhua Zhou. On the strong convergence of a modified Hestenes-Stiefel method for nonconvex optimization. Journal of Industrial & Management Optimization, 2013, 9 (4) : 893-899. doi: 10.3934/jimo.2013.9.893

[9]

Chunlin Hao, Xinwei Liu. Global convergence of an SQP algorithm for nonlinear optimization with overdetermined constraints. Numerical Algebra, Control & Optimization, 2012, 2 (1) : 19-29. doi: 10.3934/naco.2012.2.19

[10]

Benjamin Jourdain, Julien Reygner. Optimal convergence rate of the multitype sticky particle approximation of one-dimensional diagonal hyperbolic systems with monotonic initial data. Discrete & Continuous Dynamical Systems - A, 2016, 36 (9) : 4963-4996. doi: 10.3934/dcds.2016015

[11]

Narcisse Batangouna, Morgan Pierre. Convergence of exponential attractors for a time splitting approximation of the Caginalp phase-field system. Communications on Pure & Applied Analysis, 2018, 17 (1) : 1-19. doi: 10.3934/cpaa.2018001

[12]

Z.Y. Wu, H.W.J. Lee, F.S. Bai, L.S. Zhang. Quadratic smoothing approximation to $l_1$ exact penalty function in global optimization. Journal of Industrial & Management Optimization, 2005, 1 (4) : 533-547. doi: 10.3934/jimo.2005.1.533

[13]

Changjun Yu, Kok Lay Teo, Liansheng Zhang, Yanqin Bai. On a refinement of the convergence analysis for the new exact penalty function method for continuous inequality constrained optimization problem. Journal of Industrial & Management Optimization, 2012, 8 (2) : 485-491. doi: 10.3934/jimo.2012.8.485

[14]

Jie Shen, Jian Lv, Fang-Fang Guo, Ya-Li Gao, Rui Zhao. A new proximal chebychev center cutting plane algorithm for nonsmooth optimization and its convergence. Journal of Industrial & Management Optimization, 2018, 14 (3) : 1143-1155. doi: 10.3934/jimo.2018003

[15]

Xiaoling Sun, Xiaojin Zheng, Juan Sun. A Lagrangian dual and surrogate method for multi-dimensional quadratic knapsack problems. Journal of Industrial & Management Optimization, 2009, 5 (1) : 47-60. doi: 10.3934/jimo.2009.5.47

[16]

Yvon Maday, Ngoc Cuong Nguyen, Anthony T. Patera, S. H. Pau. A general multipurpose interpolation procedure: the magic points. Communications on Pure & Applied Analysis, 2009, 8 (1) : 383-404. doi: 10.3934/cpaa.2009.8.383

[17]

V. Rehbock, K.L. Teo, L.S. Jennings. Suboptimal feedback control for a class of nonlinear systems using spline interpolation. Discrete & Continuous Dynamical Systems - A, 1995, 1 (2) : 223-236. doi: 10.3934/dcds.1995.1.223

[18]

Silvia Allavena, Michele Piana, Federico Benvenuto, Anna Maria Massone. An interpolation/extrapolation approach to X-ray imaging of solar flares. Inverse Problems & Imaging, 2012, 6 (2) : 147-162. doi: 10.3934/ipi.2012.6.147

[19]

Lucio Boccardo, Daniela Giachetti. A nonlinear interpolation result with application to the summability of minima of some integral functionals. Discrete & Continuous Dynamical Systems - B, 2009, 11 (1) : 31-42. doi: 10.3934/dcdsb.2009.11.31

[20]

Anita Mayo. Accurate two and three dimensional interpolation for particle mesh calculations. Discrete & Continuous Dynamical Systems - B, 2012, 17 (4) : 1205-1228. doi: 10.3934/dcdsb.2012.17.1205

 Impact Factor: 

Metrics

  • PDF downloads (2)
  • HTML views (0)
  • Cited by (0)

Other articles
by authors

[Back to Top]