2007, 2007(Special): 721-730. doi: 10.3934/proc.2007.2007.721

Global convergence of a memory gradient method with closed-form step size formula

1. 

UAE University, Department of Matematical Sciences, P.O. Box 17551, Al-Ain, United Arab Emirates

Received  September 2006 Revised  June 2007 Published  September 2007

The memory gradient method is used to solve large scale unconstrained optimization problems. We investigate a closed-form step size formula given by a finite number of iterates ofWeiszfeld’s algorithm to compute the step size for a memory gradient method. This formula can be classified as a no-line search procedure since no stopping criteria is involved to ensure convergence, unlike the classical line search procedures. We show the global convergence of the memory gradient method, under weaker conditions.
Citation: Nora Merabet. Global convergence of a memory gradient method with closed-form step size formula. Conference Publications, 2007, 2007 (Special) : 721-730. doi: 10.3934/proc.2007.2007.721
[1]

Jacinto Marabel Romo. A closed-form solution for outperformance options with stochastic correlation and stochastic volatility. Journal of Industrial & Management Optimization, 2015, 11 (4) : 1185-1209. doi: 10.3934/jimo.2015.11.1185

[2]

Sigve Hovda. Closed-form expression for the inverse of a class of tridiagonal matrices. Numerical Algebra, Control & Optimization, 2016, 6 (4) : 437-445. doi: 10.3934/naco.2016019

[3]

Azam Chaudhry, Rehana Naz. Closed-form solutions for the Lucas-Uzawa growth model with logarithmic utility preferences via the partial Hamiltonian approach. Discrete & Continuous Dynamical Systems - S, 2018, 11 (4) : 643-654. doi: 10.3934/dcdss.2018039

[4]

Yigui Ou, Yuanwen Liu. A memory gradient method based on the nonmonotone technique. Journal of Industrial & Management Optimization, 2017, 13 (2) : 857-872. doi: 10.3934/jimo.2016050

[5]

Stefan Kindermann. Convergence of the gradient method for ill-posed problems. Inverse Problems & Imaging, 2017, 11 (4) : 703-720. doi: 10.3934/ipi.2017033

[6]

Yanfei Wang, Qinghua Ma. A gradient method for regularizing retrieval of aerosol particle size distribution function. Journal of Industrial & Management Optimization, 2009, 5 (1) : 115-126. doi: 10.3934/jimo.2009.5.115

[7]

C.Y. Wang, M.X. Li. Convergence property of the Fletcher-Reeves conjugate gradient method with errors. Journal of Industrial & Management Optimization, 2005, 1 (2) : 193-200. doi: 10.3934/jimo.2005.1.193

[8]

Yu-Ning Yang, Su Zhang. On linear convergence of projected gradient method for a class of affine rank minimization problems. Journal of Industrial & Management Optimization, 2016, 12 (4) : 1507-1519. doi: 10.3934/jimo.2016.12.1507

[9]

Yulan Lu, Minghui Song, Mingzhu Liu. Convergence rate and stability of the split-step theta method for stochastic differential equations with piecewise continuous arguments. Discrete & Continuous Dynamical Systems - B, 2017, 22 (11) : 1-23. doi: 10.3934/dcdsb.2018203

[10]

Minoru Murai, Waichiro Matsumoto, Shoji Yotsutani. Representation formula for the plane closed elastic curves. Conference Publications, 2013, 2013 (special) : 565-585. doi: 10.3934/proc.2013.2013.565

[11]

Liyan Qi, Xiantao Xiao, Liwei Zhang. On the global convergence of a parameter-adjusting Levenberg-Marquardt method. Numerical Algebra, Control & Optimization, 2015, 5 (1) : 25-36. doi: 10.3934/naco.2015.5.25

[12]

Zhili Ge, Gang Qian, Deren Han. Global convergence of an inexact operator splitting method for monotone variational inequalities. Journal of Industrial & Management Optimization, 2011, 7 (4) : 1013-1026. doi: 10.3934/jimo.2011.7.1013

[13]

Yoonsang Lee, Bjorn Engquist. Variable step size multiscale methods for stiff and highly oscillatory dynamical systems. Discrete & Continuous Dynamical Systems - A, 2014, 34 (3) : 1079-1097. doi: 10.3934/dcds.2014.34.1079

[14]

Gaohang Yu, Lutai Guan, Guoyin Li. Global convergence of modified Polak-Ribière-Polyak conjugate gradient methods with sufficient descent property. Journal of Industrial & Management Optimization, 2008, 4 (3) : 565-579. doi: 10.3934/jimo.2008.4.565

[15]

Timoteo Carletti. The lagrange inversion formula on non--Archimedean fields, non--analytical form of differential and finite difference equations. Discrete & Continuous Dynamical Systems - A, 2003, 9 (4) : 835-858. doi: 10.3934/dcds.2003.9.835

[16]

V. Pata, Sergey Zelik. A result on the existence of global attractors for semigroups of closed operators. Communications on Pure & Applied Analysis, 2007, 6 (2) : 481-486. doi: 10.3934/cpaa.2007.6.481

[17]

Hui Liu, Yiming Long, Yuming Xiao. The existence of two non-contractible closed geodesics on every bumpy Finsler compact space form. Discrete & Continuous Dynamical Systems - A, 2018, 38 (8) : 3803-3829. doi: 10.3934/dcds.2018165

[18]

Xuemei Li, Rafael de la Llave. Convergence of differentiable functions on closed sets and remarks on the proofs of the "Converse Approximation Lemmas''. Discrete & Continuous Dynamical Systems - S, 2010, 3 (4) : 623-641. doi: 10.3934/dcdss.2010.3.623

[19]

Van Hieu Dang. An extension of hybrid method without extrapolation step to equilibrium problems. Journal of Industrial & Management Optimization, 2017, 13 (4) : 1723-1741. doi: 10.3934/jimo.2017015

[20]

Behrouz Kheirfam, Guoqiang Wang. An infeasible full NT-step interior point method for circular optimization. Numerical Algebra, Control & Optimization, 2017, 7 (2) : 171-184. doi: 10.3934/naco.2017011

 Impact Factor: 

Metrics

  • PDF downloads (1)
  • HTML views (0)
  • Cited by (0)

Other articles
by authors

[Back to Top]