Search

Advanced Search

Find results with:

Add another field

Search by date

to

Searching collections:

Institutional Repository

Add or remove collections

Home Softprop: Softmax Neural Network Backpropagation Learning

Rate

To link to this object, paste this link in email, IM or document

To embed this object, paste this HTML in website

Softprop: Softmax Neural Network Backpropagation Learning

View Description

Download

small (250x250 max)

medium (500x500 max)

large ( > 500x500)

Full Resolution

Print

PDF
Text

Description

Rating
Permanent URL	http://hdl.lib.byu.edu/1877/2440
Title	Softprop: Softmax Neural Network Backpropagation Learning
BYU Creator	Martinez, Tony R. Rimer, Michael E.
Keywords	backpropagation; learning algorithms; softprop; generalization; lazy training
Description/Abstract	Multi-layer backpropagation, like many learning algorithms that can create complex decision surfaces, is prone to overfitting. Softprop is a novel learning approach presented here that is reminiscent of the softmax explore-exploit Q-learning search heuristic It fits the problem while delaying settling into error minima to achieve better generalization and more robust learning. This is accomplished by blending standard SSE optimization with lazy training, a new objective function well suited to learning classification tasks, to form a more stable learning model. Over several machine learning data sets, softprop reduces classification error by 17.1 percent and the variance in results by 38.6 percent over standard SSE minimization.
Source	Rimer, M., and Martinez, T. R., "Softprop: Softmax Neural Network Backpropagation Learning", Proceedings of the IEEE International Joint Conference on Neural Networks IJCNN'04, pp. 979-984, 2004.;
Publisher	IEEE
Date Original	2004
Date Digital	2010-09-09
Language	English eng en
Publication Type	Peer-Reviewed Articles Conference Proceedings
Type	Text
Format	application/pdf
Owning Institution	Brigham Young University
BYU College	College of Physical and Mathematical Sciences
BYU Department	Computer Science
Copyright Status	(c) 2004 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.;
Copyright Use Information	http://www.lib.byu.edu/generic_copyright.html

Tags

Add tags for Softprop: Softmax Neural Network Backpropagation Learning

View as list | View as tag cloud | report abuse

Comments

Post a Comment for Softprop: Softmax Neural Network Backpropagation Learning

you wish to report:

Your comment:

Your Name:

Submit

Cancel

...

Powered by CONTENTdm®