Abstract
A relatively simple stochastic optimization procedure based on the adaptive random search algorithm is presented to train artificial neural networks of the type encountered in applied mechanics applications. After discussing some essential features of the algorithm that influence its search efficiency, a procedure is outlined for replacing the back-propagation training approach by the new method in order to train networks involving high-dimensional parameter vectors. The method is successfully used in conjunction with a multilayer network involving a parameter vector of very high dimension. It is shown that the adaptive random search approach shifts the training effort from the user to the computer by exchanging additional computer search effort for easier training tasks on the part of the user. Extensive simulation studies are presented to provide statistically significant results related to the characteristics of the stochastic training approach. Guidelines are provided for applying the method to generic neural network training episodes.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.