Abstract
In this paper, we analyse the effects of noise on the gradient methods for solving a convex unconstraint optimization problem. Assuming that the objective function is with Lipschitz continuous gradients, we analyse the convergence properties of the gradient method when the noise is deterministic and bounded. Our theoretical results show that the gradient algorithm converges to the related optimality within some tolerance, where the tolerance depends on the underlying noise, step size, and the gradient Lipschitz continuity constant of the underlying objective function. Moreover, we consider an application of distributed optimization, where the objective function is a sum of two strongly convex functions. Then the related convergences are discussed based on dual decomposition together with gradient methods, where the associated noise is considered as a consequence of quantization errors. Finally, the theoretical results are verified using numerical experiments. Keywords: The gradient method; deterministic and bounded noise; distributed optimization; dual decomposition
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.