TITLE:
A New Weight Initialization Method Using Cauchy’s Inequality Based on Sensitivity Analysis
AUTHORS:
Thangairulappan Kathirvalavakumar, Subramanian Jeyaseeli Subavathi
KEYWORDS:
Weight Initialization, Backpropagation, Feedforward Neural Network, Cauchy’s Inequality, Linear System of Equations
JOURNAL NAME:
Journal of Intelligent Learning Systems and Applications,
Vol.3 No.4,
November
29,
2011
ABSTRACT: In this paper, an efficient weight initialization method is proposed using Cauchy’s inequality based on sensitivity analy- sis to improve the convergence speed in single hidden layer feedforward neural networks. The proposed method ensures that the outputs of hidden neurons are in the active region which increases the rate of convergence. Also the weights are learned by minimizing the sum of squared errors and obtained by solving linear system of equations. The proposed method is simulated on various problems. In all the problems the number of epochs and time required for the proposed method is found to be minimum compared with other weight initialization methods.