TITLE:
Least Squares Method from the View Point of Deep Learning
AUTHORS:
Kazuyuki Fujii
KEYWORDS:
Least Squares Method, Statistics, Deep Learning, Learning Rate, Linear Algebra
JOURNAL NAME:
Advances in Pure Mathematics,
Vol.8 No.5,
May
29,
2018
ABSTRACT: The least squares method is one of the most
fundamental methods in Statistics to estimate correlations among various data.
On the other hand, Deep Learning is the heart of Artificial Intelligence and it
is a learning method based on the least squares. In this paper we reconsider
the least squares method from the view point of Deep Learning and we carry out
the computation thoroughly for the gradient descent sequence in a very simple
setting. Depending on the values of the learning rate, an essential parameter
of Deep Learning, the least squares methods of Statistics and Deep Learning
reveal an interesting difference.