Abstract
The goal of this paper is to study the factors that affect the generalization performance and efficiency for neural network learning. First, this paper investigates the effect of initial weight ranges, learning rate, and regularization coefficient on generalization performance and learning speed. Based on this, we propose a hybrid method that simultaneously considers these three factors, and dynamically tunes the learning rate and regularization coefficient. Then we present the results of some experimental comparisons among these kinds of methods in several different problems. Finally, we draw conclusions and make plans for future work.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
