Convergence Conditions for Ascent Methods

Abstract

Previous article Next article Convergence Conditions for Ascent MethodsPhilip WolfePhilip Wolfehttps://doi.org/10.1137/1011036PDFBibTexSections ToolsAdd to favoritesExport CitationTrack CitationsEmail SectionsAboutAbstractLiberal conditions on the steps of a “descent” method for finding extrema of a function are given; most known results are special cases.[1] Haskell B. Curry, The method of steepest descent for non-linear minimization problems, Quart. Appl. Math., 2 (1944), 258–261 MR0010667 0061.26801 CrossrefGoogle Scholar[2] Augustine Cauchy, Méthode générale pour la résolution des systèmes d'équations simultanées, C.R. Acad. Sci., 25 (1847), 536–538 Google Scholar[3] A. A. Goldstein, Minimizing functionals on normed-linear spaces, SIAM J. Control, 4 (1966), 81–89 10.1137/0304008 MR0196900 0147.12701 LinkGoogle Scholar[4] A. A. Goldstein, Cauchy's method of minimization, Numer. Math., 4 (1962), 146–150 10.1007/BF01386306 MR0141222 0105.10201 CrossrefGoogle Scholar[5] Alexander Ostrowski, Solution of equations and systems of equations, Second edition. Pure and Applied Mathematics, Vol. 9, Academic Press, New York, 1966xiv+338 MR0216746 0222.65070 Google Scholar[6] G. Zoutehdijk, 1967, Private communication Google Scholar[7] R. Fletcher and , C. M. Reeves, Function minimization by conjugate gradients, Comput. J., 7 (1964), 149–154 10.1093/comjnl/7.2.149 MR0187375 0132.11701 CrossrefISIGoogle Scholar[8] W. Oettli, 1967, Private communication Google Scholar[9] L. V. Kantorovich and , G. P. Akilov, Functional analysis in normed spaces, Translated from the Russian by D. E. Brown. Edited by A. P. Robertson. International Series of Monographs in Pure and Applied Mathematics, Vol. 46, The Macmillan Co., New York, 1964xiii+771, Chap. 15 MR0213845 0127.06104 Google Scholar[10] Hirotugu Akaike, On a successive transformation of probability distribution and its application to the analysis of the optimum gradient method, Ann. Inst. Statist. Math. Tokyo, 11 (1959), 1–16 10.1007/BF01831719 MR0107973 0100.14002 CrossrefISIGoogle Scholar[11] R. Fletcher and , M. J. D. Powell, A rapidly convergent descent method for minimization, Comput. J., 6 (1963/1964), 163–168 MR0152116 0132.11603 CrossrefISIGoogle Scholar[12] M. J. Box, A comparison of several current optimization methods, and the use of transformations in constrained problems, Comput. J., 9 (1966), 67–77 MR0192645 0146.13304 CrossrefISIGoogle Scholar[13] Donald M. Topkis and , Arthur F. Veinott, on the convergence of some feasible direction algorithms for nonlinear programming, J. SIAM control, 5 (1967), 268–274 10.1137/0305018 0158.18805 LinkGoogle Scholar[14] Philip Wolfe, on the convergence of gradient methods under constraints, Rep., RZ-204, IBM watson research center, yorktown heights, new york, 1966 Google Scholar Previous article Next article FiguresRelatedReferencesCited ByDetails Two efficient modifications of AZPRP conjugate gradient method with sufficient descent propertyJournal of Inequalities and Applications, Vol. 2022, No. 1 | 10 January 2022 Cross Ref Optimal Transport Based Seismic Inversion:Beyond Cycle SkippingCommunications on Pure and Applied Mathematics, Vol. 75, No. 10 | 1 April 2021 Cross Ref A robust BFGS algorithm for unconstrained nonlinear optimization problemsOptimization, Vol. 17 | 19 September 2022 Cross Ref Two Methods for the Implicit Integration of Stiff Reaction SystemsComputational Methods in Applied Mathematics, Vol. 0, No. 0 | 14 September 2022 Cross Ref Simple and fast convergent procedure to estimate recursive path analysis modelBehaviormetrika, Vol. 107 | 6 September 2022 Cross Ref Adaptive three-term PRP algorithms without gradient Lipschitz continuity condition for nonconvex functionsNumerical Algorithms, Vol. 91, No. 1 | 20 January 2022 Cross Ref A Hybrid Stochastic Deterministic Algorithm for Solving Unconstrained Optimization ProblemsMathematics, Vol. 10, No. 17 | 23 August 2022 Cross Ref Pseudospectral methods and iterative solvers for optimization problems from multiscale particle dynamicsBIT Numerical Mathematics, Vol. 48 | 11 August 2022 Cross Ref An outlier-resistant κ -generalized approach for robust physical parameter estimationPhysica A: Statistical Mechanics and its Applications, Vol. 600 | 1 Aug 2022 Cross Ref An Active Set Trust-Region Method for Bound-Constrained OptimizationBulletin of the Iranian Mathematical Society, Vol. 48, No. 4 | 27 July 2021 Cross Ref Advancing Three-Dimensional Coupled Water Quality Model of Marine Ranches: Model Development, Global Sensitivity Analysis, and Optimization Based on Observation SystemJournal of Marine Science and Engineering, Vol. 10, No. 8 | 27 July 2022 Cross Ref Robust regression against heavy heterogeneous contaminationMetrika, Vol. 16 | 1 July 2022 Cross Ref A new class of nonlinear conjugate gradient coefficients for unconstrained optimizationAsian-European Journal of Mathematics, Vol. 15, No. 07 | 14 October 2021 Cross Ref New iterative conjugate gradient method for nonlinear unconstrained optimizationRAIRO - Operations Research, Vol. 56, No. 4 | 29 July 2022 Cross Ref Optimizing Oblique Projections for Nonlinear Systems using TrajectoriesSamuel E. Otto, Alberto Padovan, and Clarence W. RowleySIAM Journal on Scientific Computing, Vol. 44, No. 3 | 24 June 2022AbstractPDF (2764 KB)Variational methods for finding periodic orbits in the incompressible Navier–Stokes equationsJournal of Fluid Mechanics, Vol. 941 | 26 April 2022 Cross Ref LMBOPT: a limited memory method for bound-constrained optimizationMathematical Programming Computation, Vol. 14, No. 2 | 10 January 2022 Cross Ref Accelerated memory-less SR1 method with generalized secant equation for unconstrained optimizationCalcolo, Vol. 59, No. 2 | 11 March 2022 Cross Ref DiffPoseNet: Direct Differentiable Camera Pose Estimation2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) | 1 Jun 2022 Cross Ref A modified secant equation quasi-Newton method for unconstrained optimizationJournal of Applied Mathematics and Computing, Vol. 30 | 31 May 2022 Cross Ref Coupled support tensor machine classification for multimodal neuroimaging dataStatistical Analysis and Data Mining: The ASA Data Science Journal, Vol. 10 | 23 May 2022 Cross Ref A new hybrid conjugate gradient method of unconstrained optimization methodsAsian-European Journal of Mathematics, Vol. 15, No. 04 | 18 June 2021 Cross Ref A link between the steepest descent method and fixed-point iterationsOptimization Letters, Vol. 69 | 18 March 2022 Cross Ref A hybrid-line-and-curve search globalization technique for inexact Newton methodsApplied Numerical Mathematics, Vol. 173 | 1 Mar 2022 Cross Ref Development and Evaluation of Geometry Optimization Algorithms in Conjunction with ANI PotentialsJournal of Chemical Theory and Computation, Vol. 18, No. 2 | 12 January 2022 Cross Ref Nonlinear System Identification: Learning While Respecting Physical Models Using a Sequential Monte Carlo MethodIEEE Control Systems, Vol. 42, No. 1 | 1 Feb 2022 Cross Ref Visual analytics for nonlinear programming in robot motion planningJournal of Visualization, Vol. 25, No. 1 | 13 September 2021 Cross Ref Elastic wave full-waveform inversion in the time domain by the trust region methodJournal of Applied Geophysics, Vol. 197 | 1 Feb 2022 Cross Ref Adjoint Waveform Tomography of South AmericaJournal of Geophysical Research: Solid Earth, Vol. 127, No. 2 | 27 January 2022 Cross Ref A conjugate gradient algorithm based on double parameter scaled Broyden–Fletcher–Goldfarb–Shanno update for optimization problems and image restorationNeural Computing and Applications, Vol. 34, No. 1 | 13 August 2021 Cross Ref In-line viscosity identification via thermal-rheological measurements in an annular duct for polymer processingInternational Journal of Heat and Mass Transfer, Vol. 182 | 1 Jan 2022 Cross Ref Regularized elastic full-waveform inversion using deep learningAdvances in Subsurface Data Analytics | 1 Jan 2022 Cross Ref Nonlinear Optimization: A Brief OverviewNumerical Infinities and Infinitesimals in Optimization | 6 July 2022 Cross Ref Leveraging Joint-Diagonalization in Transform-Learning NMFIEEE Transactions on Signal Processing, Vol. 70 | 1 Jan 2022 Cross Ref Backtracking Gradient Descent Method and Some Applications in Large Scale Optimisation. Part 2: Algorithms and ExperimentsApplied Mathematics & Optimization, Vol. 84, No. 3 | 6 September 2020 Cross Ref Optical diffraction tomography from single-molecule localization microscopyOptics Communications, Vol. 499 | 1 Nov 2021 Cross Ref Constrained neural network training and its application to hyperelastic material modelingComputational Mechanics, Vol. 68, No. 5 | 3 August 2021 Cross Ref The Human Lumbar Spine During High-Rate Under Seat Loading: A Combined Metric Injury CriteriaAnnals of Biomedical Engineering, Vol. 49, No. 11 | 23 July 2021 Cross Ref Rayleigh Wave Dispersion Spectrum Inversion Across ScalesSurveys in Geophysics, Vol. 42, No. 6 | 19 October 2021 Cross Ref Pre-conditioned BFGS-based uncertainty quantification in elastic full-waveform inversionGeophysical Journal International, Vol. 228, No. 2 | 21 September 2021 Cross Ref Neural network method for solving parabolic two-temperature microscale heat conduction in double-layered thin films exposed to ultrashort-pulsed lasersInternational Journal of Heat and Mass Transfer, Vol. 178 | 1 Oct 2021 Cross Ref New hyrid conjugate gradient method as a convex combination of HZ and CD methodsAsian-European Journal of Mathematics, Vol. 14, No. 10 | 6 March 2021 Cross Ref Parallel Dislocation Model Implementation for Earthquake Source Parameter Estimation on Multi-Threaded GPUApplied Sciences, Vol. 11, No. 20 | 11 October 2021 Cross Ref Extended full waveform inversion with matching filterGeophysical Prospecting, Vol. 69, No. 7 | 24 June 2021 Cross Ref Full-waveform Inversion Based on q-Laplace DistributionPure and Applied Geophysics, Vol. 178, No. 9 | 24 August 2021 Cross Ref Modifications of Hestenes and Stiefel CG Method for Solving Unconstrained Optimization Problems2021 7th International Conference on Contemporary Information Technology and Mathematics (ICCITM) | 25 Aug 2021 Cross Ref A note on memory-less SR1 and memory-less BFGS methods for large-scale unconstrained optimizationNumerical Algorithms, Vol. 11 | 17 August 2021 Cross Ref A Descent Four-Term Conjugate Gradient Method with Global Convergence Properties for Large-Scale Unconstrained Optimisation ProblemsMathematical Problems in Engineering, Vol. 2021 | 14 Aug 2021 Cross Ref A modified conjugate gradient-based Elman neural networkCognitive Systems Research, Vol. 68 | 1 Aug 2021 Cross Ref On the estimation of destructive cure rate model: A new study with exponentially weighted Poisson competing risksStatistica Neerlandica, Vol. 75, No. 3 | 2 March 2021 Cross Ref A Modified Liu and Storey Conjugate Gradient Method for Large Scale Unconstrained Optimization ProblemsAlgorithms, Vol. 14, No. 8 | 28 July 2021 Cross Ref Robust parameter estimation based on the generalized log-likelihood in the context of Sharma-Taneja-Mittal measurePhysical Review E, Vol. 104, No. 2 | 6 August 2021 Cross Ref Geodesic density regression for correcting 4DCT pulmonary respiratory motion artifactsMedical Image Analysis, Vol. 72 | 1 Aug 2021 Cross Ref Optimisation of Parameters in a German Bight Circulation Model by 4DVAR Assimilation of Current and Water Level ObservationsFrontiers in Marine Science, Vol. 8 | 29 July 2021 Cross Ref ASLR: An Adaptive Scheduler for Learning Rate2021 International Joint Conference on Neural Networks (IJCNN) | 18 Jul 2021 Cross Ref A Convex Combination between Two Different Search Directions of Conjugate Gradient Method and Application in Image RestorationMathematical Problems in Engineering, Vol. 2021 | 13 Jul 2021 Cross Ref An Adaptive Three-Term Conjugate Gradient Method with Sufficient Descent Condition and Conjugacy ConditionJournal of the Operations Research Society of China, Vol. 9, No. 2 | 12 July 2019 Cross Ref Direct Energy Minimization Based on Exponential Transformation in Density Functional Calculations of Finite and Extended SystemsComputer Physics Communications | 1 Jun 2021 Cross Ref A new three-term spectral conjugate gradient algorithm with higher numerical performance for solving large scale optimization problems based on Quasi-Newton equationInternational Journal of Modeling, Simulation, and Scientific Computing | 31 May 2021 Cross Ref Robust approaches for inverse problems based on Tsallis and Kaniadakis generalised statisticsThe European Physical Journal Plus, Vol. 136, No. 5 | 11 May 2021 Cross Ref Stochastic quasi-Newton with line-search regularisationAutomatica, Vol. 127 | 1 May 2021 Cross Ref An Efficient Modified AZPRP Conjugate Gradient Method for Large-Scale Unconstrained Optimization ProblemJournal of Mathematics, Vol. 2021 | 26 Apr 2021 Cross Ref A new hybrid conjugate gradient algorithm as a convex combination of MMWU and RMIL nonlinear problemsJournal of Interdisciplinary Mathematics, Vol. 24, No. 3 | 18 March 2021 Cross Ref Estimation of discrete choice models with hybrid stochastic adaptive batch size algorithmsJournal of Choice Modelling, Vol. 38 | 1 Mar 2021 Cross Ref A Modified Descent Spectral Conjugate Gradient Method for Unconstrained OptimizationIranian Journal of Science and Technology, Transactions A: Science, Vol. 45, No. 1 | 31 October 2020 Cross Ref QSSR Modeling of Bacillus Subtilis Lipase A Peptide Collision Cross-Sections in Ion Mobility Spectrometry: Local Descriptor Versus Global DescriptorThe Protein Journal, Vol. 40, No. 1 | 16 January 2021 Cross Ref Numerical optimization of a multiphysics calculation scheme based on partial convergenceAnnals of Nuclear Energy, Vol. 151 | 1 Feb 2021 Cross Ref A new accelerated diagonal quasi-Newton updating method with scaled forward finite differences directional derivative for unconstrained optimizationOptimization, Vol. 70, No. 2 | 16 January 2020 Cross Ref A Three-Term Gradient Descent Method with Subspace TechniquesMathematical Problems in Engineering, Vol. 2021 | 7 Jan 2021 Cross Ref Implementing and modifying Broyden class updates for large scale optimizationComputational Optimization and Applications, Vol. 78, No. 1 | 9 November 2020 Cross Ref Set-point optimization in wind farms to mitigate effects of flow blockage induced by atmospheric gravity wavesWind Energy Science, Vol. 6, No. 1 | 5 February 2021 Cross Ref Statistics and Numerical MethodsPattern Recognition, Tracking and Vertex Reconstruction in Particle Detectors | 23 November 2020 Cross Ref A training algorithm with selectable search direction for complex-valued feedforward neural networksNeural Networks, Vol. 40 | 1 Jan 2021 Cross Ref A decent three term conjugate gradient method with global convergence properties for large scale unconstrained optimization problemsAIMS Mathematics, Vol. 6, No. 10 | 1 Jan 2021 Cross Ref Adaptive Learning Rate and Momentum for Training Deep Neural NetworksMachine Learning and Knowledge Discovery in Databases. Research Track | 11 September 2021 Cross Ref A Quasi‐Newton Reformulated Geostatistical Approach on Reduced Dimensions for Large‐Dimensional Inverse ProblemsWater Resources Research, Vol. 57, No. 1 | 22 January 2021 Cross Ref Manifold Optimization for High-Accuracy Spatial Location Estimation Using Ultrasound WavesIEEE Transactions on Signal Processing, Vol. 69 | 1 Jan 2021 Cross Ref Basic Descent MethodsLinear and Nonlinear Programming | 20 August 2021 Cross Ref Taking the 4D Nature of fMRI Data Into Account Promises Significant Gains in Data CompletionIEEE Access, Vol. 9 | 1 Jan 2021 Cross Ref Approaching the full configuration interaction ground state from an arbitrary wavefunction with gradient descent and quasi-Newton algorithmsThe Journal of Chemical Physics, Vol. 153, No. 23 | 21 Dec 2020 Cross Ref Customized Federated Learning for accelerated edge computing with heterogeneous task targetsComputer Networks, Vol. 183 | 1 Dec 2020 Cross Ref Hybrid Riemannian conjugate gradient methods with global convergence propertiesComputational Optimization and Applications, Vol. 77, No. 3 | 5 September 2020 Cross Ref A one-parameter class of three-term conjugate gradient methods with an adaptive parameter choiceOptimization Methods and Software, Vol. 35, No. 6 | 13 September 2018 Cross Ref Gaussian Process Regression for Maximum Entropy DistributionJournal of Computational Physics, Vol. 418 | 1 Oct 2020 Cross Ref A new non-linear conjugate gradient algorithm for destructive cure rate model and a simulation study: illustration with negative binomial competing risksCommunications in Statistics - Simulation and Computation, Vol. 6 | 10 September 2020 Cross Ref A double parameter self-scaling memoryless BFGS method for unconstrained optimizationComputational and Applied Mathematics, Vol. 39, No. 3 | 2 June 2020 Cross Ref Adaptive type-2 neural fuzzy sliding mode control of a class of nonlinear systemsNonlinear Dynamics, Vol. 101, No. 4 | 18 August 2020 Cross Ref A modified nonlinear Polak–Ribière–Polyak conjugate gradient method with sufficient descent propertyCalcolo, Vol. 57, No. 3 | 26 August 2020 Cross Ref Semi-discrete optimal transport: a solution procedure for the unsquared Euclidean distance caseMathematical Methods of Operations Research, Vol. 92, No. 1 | 12 February 2020 Cross Ref Probing depth and lateral variations of upper-mantle seismic anisotropy from full-waveform inversion of teleseismic body-wavesGeophysical Journal International, Vol. 222, No. 1 | 20 April 2020 Cross Ref High-resolution reservoir characterization using deep learning-aided elastic full-waveform inversion: The North Sea field data exampleGEOPHYSICS, Vol. 85, No. 4 | 8 May 2020 Cross Ref Estimation of Beta-Pareto Distribution Based on Several Optimization MethodsMathematics, Vol. 8, No. 7 | 1 July 2020 Cross Ref Multi‐parameter reflection waveform inversion for acoustic transversely isotropic media with a vertical symmetry axisGeophysical Prospecting, Vol. 68, No. 6 | 17 June 2020 Cross Ref The application of nonlinear least-squares estimation algorithms in atmospheric density model calibrationAircraft Engineering and Aerospace Technology, Vol. 92, No. 7 | 20 May 2020 Cross Ref Decreasing the uncertainty of classical laser flash analysis using numerical algorithms robust to noise and systematic errorsReview of Scientific Instruments, Vol. 91, No. 6 | 1 Jun 2020 Cross Ref An Efficient Three-Term Iterative Method for Estimating Linear Approximation Models in Regression AnalysisMathematics, Vol. 8, No. 6 | 15 June 2020 Cross Ref Diagonal Approximation of the Hessian by Finite Differences for Unconstrained OptimizationJournal of Optimization Theory and Applications, Vol. 185, No. 3 | 10 May 2020 Cross Ref New conjugate gradient algorithms based on self-scaling memoryless Broyden–Fletcher–Goldfarb–Shanno methodCalcolo, Vol. 57, No. 2 | 18 May 2020 Cross Ref A class of globally convergent three-term Dai-Liao conjugate gradient methodsApplied Numerical Mathematics, Vol. 151 | 1 May 2020 Cross Ref A recalling-enhanced recurrent neural network: Conjugate gradient learning algorithm and its convergence analysisInformation Sciences, Vol. 519 | 1 May 2020 Cross Ref Three-Dimensional Regularized Focusing Migration: A Case Study from the Yucheng Mining Area, Shandong, ChinaMinerals, Vol. 10, No. 5 | 22 May 2020 Cross Ref On Quasi‐Newton methods in fast Fourier transform‐based micromechanicsInternational Journal for Numerical Methods in Engineering, Vol. 121, No. 8 | 23 December 2019 Cross Ref Some three-term conjugate gradient methods with the new direction structureApplied Numerical Mathematics, Vol. 150 | 1 Apr 2020 Cross Ref Analysis of the gradient method with an Armijo–Wolfe line search on a class of non-smooth convex functionsOptimization Methods and Software, Vol. 35, No. 2 | 9 October 2019 Cross Ref Dynamic search trajectory methods for global optimizationAnnals of Mathematics and Artificial Intelligence, Vol. 88, No. 1-3 | 27 August 2019 Cross Ref Adaptive Control of a Two-Link Flexible Manipulator Using a Type-2 Neural Fuzzy SystemArabian Journal for Science and Engineering, Vol. 45, No. 3 | 21 January 2020 Cross Ref A Study on Optimization Algorithms in MPCJournal of Physics: Conference Series, Vol. 1490, No. 1 | 1 Mar 2020 Cross Ref Global Convergence of the (1 + 1) Evolution Strategy to a Critical PointEvolutionary Computation, Vol. 28, No. 1 | 1 Mar 2020 Cross Ref Mineral Potential Mapping Using a Conjugate Gradient Logistic Regression ModelNatural Resources Research, Vol. 29, No. 1 | 27 June 2019 Cross Ref Orientation optimization in anisotropic materials using gradient descent methodComposite Structures, Vol. 234 | 1 Feb 2020 Cross Ref Refinement for single-nanoparticle structure determination from low-quality single-shot coherent diffraction dataIUCrJ, Vol. 7, No. 1 | 1 January 2020 Cross Ref Fast facial expression recognition using local binary features and shallow neural networksThe Visual Computer, Vol. 36, No. 1 | 22 August 2018 Cross Ref NPSOG: A New Hybrid Method for Unconstrained Differentiable OptimizationNumerical Solutions of Realistic Nonlinear Phenomena | 20 February 2020 Cross Ref Quasi-Newton Optimization Methods for Deep Learning ApplicationsDeep Learning Applications | 29 February 2020 Cross Ref Automatic targetless camera–LIDAR calibration by aligning edge with Gaussian mixture modelJournal of Field Robotics, Vol. 37, No. 1 | 9 August 2019 Cross Ref Basics of Mathematical ProgrammingShape Optimization Problems | 1 October 2020 Cross Ref An efficient solution scheme for small-strain crystal-elasto-viscoplasticity in a dual frameworkComputer Methods in Applied Mechanics and Engineering, Vol. 358 | 1 Jan 2020 Cross Ref Image and Depth Estimation with Mask-Based Lensless Cameras2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP) | 1 Dec 2019 Cross Ref A new accelerated conjugate gradient method for large-scale unconstrained optimizationJournal of Inequalities and Applications, Vol. 2019, No. 1 | 20 November 2019 Cross Ref Research of step-length estimation methods for full waveform inversion in time domainExploration Geophysics, Vol. 50, No. 6 | 17 September 2019 Cross Ref Local-crosscorrelation elastic full-waveform inversionGEOPHYSICS, Vol. 84, No. 6 | 16 October 2019 Cross Ref A Hybrid of Quasi-Newton Method with CG Method for Unconstrained OptimizationJournal of Physics: Conference Series, Vol. 1366, No. 1 | 1 Nov 2019 Cross Ref Conjugate gradient-based Takagi-Sugeno fuzzy neural network parameter identification and its convergence analysisNeurocomputing, Vol. 364 | 1 Oct 2019 Cross Ref Regularized elastic full-waveform inversion using deep learningGEOPHYSICS, Vol. 84, No. 5 | 24 August 2019 Cross Ref Incremental and Parallel Machine Learning Algorithms With Automated Learning Rate AdjustmentsFrontiers in Robotics and AI, Vol. 6 | 27 August 2019 Cross Ref Localization of IoT Networks via Low-Rank Matrix CompletionIEEE Transactions on Communications, Vol. 67, No. 8 | 1 Aug 2019 Cross Ref A diagonal quasi-Newton updating method for unconstrained optimizationNumerical Algorithms, Vol. 81, No. 2 | 29 June 2018 Cross Ref A New Diagonal Quasi-Newton Updating Method With Scaled Forward Finite Differences Directional Derivative for Unconstrained OptimizationNumerical Functional Analysis and Optimization, Vol. 6 | 20 May 2019 Cross Ref Efficient Ensemble Refinement by ReweightingJournal of Chemical Theory and Computation, Vol. 15, No. 5 | 2 April 2019 Cross Ref An efficient adaptive three-term extension of the Hestenes–Stiefel conjugate gradient methodOptimization Methods and Software, Vol. 34, No. 3 | 15 October 2018 Cross Ref A Quasi-Newton Algorithm on the Orthogonal Manifold for NMF with Transform LearningICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | 1 May 2019 Cross Ref Simultaneous reconstruction of the perfusion coefficient and initial temperature from time-average integral temperature measurementsApplied Mathematical Modelling, Vol. 68 | 1 Apr 2019 Cross Ref Interface inversion of gravitational data using spherical triangular tessellation: an application for the estimation of the Moon's crustal thicknessGeophysical Journal International, Vol. 217, No. 1 | 17 January 2019 Cross Ref An Advanced Estimation Algorithm for Ground‐Motion Models with Spatial CorrelationBulletin of the Seismological Society of America, Vol. 109, No. 2 | 5 March 2019 Cross Ref The non-convex geometry of low-rank matrix optimizationInformation and Inference: A Journal of the IMA, Vol. 8, No. 1 | 22 March 2018 Cross Ref The Optimal Location of Ground-Based GNSS Augmentation TransceiversGeosciences, Vol. 9, No. 3 | 27 February 2019 Cross Ref Convergence Rate of Descent Method with New Inexact Line-Search on Riemannian ManifoldsJournal of Optimization Theory and Applications, Vol. 180, No. 3 | 24 September 2018 Cross Ref Cooperative Localization in Hybrid Infrared/Visible Light Networks: Theoretical Limits and Distributed AlgorithmsIEEE Transactions on Signal and Information Processing over Networks, Vol. 5, No. 1 | 1 Mar 2019 Cross Ref A new hybrid approach for reliability-based design optimization of structural componentsMaterials Testing, Vol. 61, No. 2 | 24 April 2019 Cross Ref Ensemble Teaching for Hybrid Label PropagationIEEE Transactions on Cybernetics, Vol. 49, No. 2 | 1 Feb 2019 Cross Ref A New Dai-Liao Conjugate Gradient Method with Optimal Parameter ChoiceNumerical Functional Analysis and Optimization, Vol. 40, No. 2 | 20 November 2018 Cross Ref Scalable Inference of Ordinary Differential Equation Models of Biochemical ProcessesGene Regulatory Networks | 14 December 2018 Cross Ref Modelling the distribution of white matter hyperintensities due to ageing on MRI images using Bayesian inferenceNeuroImage, Vol. 185 | 1 Jan 2019 Cross Ref A Structured Quasi-Newton Algorithm for Optimizing with Incomplete Hessian InformationCosmin G. Petra, Naiyuan Chiang, and Mihai AnitescuSIAM Journal on Optimization, Vol. 29, No. 2 | 11 April 2019AbstractPDF (588 KB) 2019 Cross Ref 2019 Cross Ref Unconstrained OptimizationNonlinear Optimization | 10 November 2019 Cross Ref Optimization OverviewModelling and Simulation | 2 January 2020 Cross Ref New Hybrid Conjugate Gradient Method As A Convex Combination of Ls and Fr MethodsActa Mathematica Scientia, Vol. 39, No. 1 | 4 January 2019 Cross Ref Shape optimization via a levelset and a Gauss-Newton methodESAIM: Control, Optimisation and Calculus of Variations, Vol. 25 | 5 April 2019 Cross Ref Cubic regularization in symmetric rank-1 quasi-Newton methodsMathematical Programming Computation, Vol. 10, No. 4 | 12 February 2018 Cross Ref An Accelerated Three-Term Conjugate Gradient Method with Sufficient Descent Condition and Conjugacy ConditionJournal of Optimization Theory and Applications, Vol. 179, No. 3 | 28 August 2018 Cross Ref Measuring the three-dimensional structural properties of topologically associating domains2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) | 1 Dec 2018 Cross Ref A New Correntropy-Based Conjugate Gradient Backpropagation Algorithm for Improving Training in Neural NetworksIEEE Transactions on Neural Networks and Learning Systems, Vol. 29, No. 12 | 1 Dec 2018 Cross Ref Full waveform inversion in time and frequency domain of velocity modeling in seismic imaging: FWISIMAT a Matlab codeEarth Sciences Research Journal, Vol. 22, No. 4 | 1 October 2018 Cross Ref A diagonal quasi-Newton updating method based on minimizing the measure function of Byrd and Nocedal for unconstrained optimizationOptimization, Vol. 67, No. 9 | 17 June 2018 Cross Ref Useful redundancy in parameter and time delay estimation for continuous-time modelsAutomatica, Vol. 95 | 1 Sep 2018 Cross Ref Optimal control of bioprocess systems using hybrid numerical optimization algorithmsOptimization, Vol. 67, No. 8 | 2 May 2018 Cross Ref Faster Independent Component Analysis by Preconditioning With Hessian ApproximationsIEEE Transactions on Signal Processing, Vol. 66, No. 15 | 1 Aug 2018 Cross Ref Toward interactive scanning tunneling microscopy simulations of large-scale molecular systems in real timeJournal of Applied Physics, Vol. 124, No. 4 | 28 Jul 2018 Cross Ref A Reduced-Order Gauss-Newton Method for Nonlinear Problems Based on Compressed Sensing for PDE ApplicationsNonlinear Systems - Modeling, Estimation, and Stability | 18 July 2018 Cross Ref A compressive hybrid conjugate gradient image recovery approach for radial MRIThe Imaging Science Journal, Vol. 66, No. 5 | 16 February 2018 Cross Ref A Novel Fractional Tikhonov Regularization Coupled with an Improved Super-Memory Gradient Method and Application to Dynamic Force Identification ProblemsMathematical Problems in Engineering, Vol. 2018 | 2 Jul 2018 Cross Ref Optimization approach for the Monge-Ampère equationActa Mathematica Scientia, Vol. 38, No. 4 | 1 Jul 2018 Cross Ref A Double-Parameter Scaling Broyden–Fletcher–Goldfarb–Shanno Method Based on Minimizing the Measure Function of Byrd and Nocedal for Unconstrained OptimizationJournal of Optimization Theory and Applications, Vol. 178, No. 1 | 4 May 2018 Cross Ref Designing stellarator coils by a modified Newton method using FOCUSPlasma Physics and Controlled Fusion, Vol. 60, No. 6 | 18 April 2018 Cross Ref A Note on the Morozov Principle via Lagrange DualitySet-Valued and Variational Analysis, Vol. 26, No. 2 | 17 February 2018 Cross Ref Some three-term conjugate gradient methods with the inexact line search conditionCalcolo, Vol. 55, No. 2 | 16 March 2018 Cross Ref Wavelet-based joint CT-MRI reconstructionJournal of X-Ray Science and Technology, Vol. 26, No. 3 | 25 May 2018 Cross Ref Interpretation of deep directi