Abstract
Nonlinear transformation is one of the major obstacles to analyzing the properties of multilayer perceptrons. In this paper, we prove that the correlation coefficient between two jointly Gaussian random variables decreases when each of them is transformed under continuous nonlinear transformations, which can be approximated to piecewise linear functions. When the inputs or the weights of a multilayer perceptron are perturbed randomly, the weighted sums to the hidden neurons are asymptotically jointly Gaussian random variables. Since the sigmoidal transformation can be approximated piecewise linearly, the correlations among the weighted sums decrease under the sigmoidal transformations. Based on this result, we can say that the sigmoidal transformation as the transfer function of the multilayer perceptron reduce the redundancy in the information contents of the hidden neurons. >
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
