BACK TO INDEX
Publications of Eduardo D. Sontag jointly with H. Dewan
|
-
H. Dewan and E.D. Sontag.
Extrapolatory methods for speeding up the BP algorithm.
In Proc. Int. Joint Conf. on Neural Networks, Washington, DC, Jan. 1990, Lawrence Erlbaum Associates, Inc., Publishers, ISBN 0-8058-0775-6,
pages I.613-616,
1990.
[PDF]
Keyword(s): machine learning,
neural networks.
Abstract:
We describe a speedup technique that uses extrapolatory methods to predict the weights in a Neural Network using Back Propagation (BP) learning. The method is based on empirical observations of the way the weights change as a function of time. We use numerical function fitting techniques to determine the parameters of an extrapolation function and then use this function to project weights into the future. Significant computational savings result by using the extrapolated weights to jump over many iterations of the standard algorithm, achieving comparable performance with fewer iterations. |
BACK TO INDEX
Disclaimer:
This material is presented to ensure timely dissemination of
scholarly and technical work. Copyright and all rights therein
are retained by authors or by other copyright holders.
Last modified: Fri Nov 15 15:28:35 2024
Author: sontag.
This document was translated from BibTEX by
bibtex2html