Search

Advanced Search

Find results with:

Add another field

Search by date

to

Searching collections:

Institutional Repository

Add or remove collections

Home Institutional Repository A Noise Filtering Method Using Neural Networks

Rate

To link to this object, paste this link in email, IM or document

To embed this object, paste this HTML in website

A Noise Filtering Method Using Neural Networks

View Description

Download

small (250x250 max)

medium (500x500 max)

large ( > 500x500)

Full Resolution

Print

PDF
Text

Description

Rating
Permanent URL	http://hdl.lib.byu.edu/1877/2410
Title	A Noise Filtering Method Using Neural Networks
BYU Creator	Martinez, Tony R. Zeng, Xinchuan
Keywords	automatic noise reduction; artifical neural networks
Description/Abstract	During the data collecting and labeling process it is possible for noise to be introduced into a data set. As a result, the quality of the data set degrades and experiments and inferences derived from the data set become less reliable. In this paper we present an algorithm, called ANR (automatic noise reduction), as a filtering mechanism to identify and remove noisy data items whose classes have been mislabeled. The underlying mechanism behind ANR is based on a framework of multi-layer artificial neural networks. ANR assigns each data item a soft class label in the form of a class probability vector, which is initialized to the original class label and can be modified during training. When the noise level is reasonably small (< 30%), the non-noisy data is dominant in determining the network architecture and its output, and thus a mechanism for correcting mislabeled data can be provided by aligning class probability vector with the network output. With a learning procedure for class probability vector based on its difference from the network output, the probability of a mislabeled class gradually becomes smaller while that of the correct class becomes larger, which eventually causes a correction of mislabeled data after sufficient training. After training, those data items whose classes have been relabeled are then treated as noisy data and removed from the data set. We evaluate the performance of the ANR based on 12 data sets drawn from the UCI data repository. The results show that ANR is capable of identifying a significant portion of noisy data. An average increase in accuracy of 24.5% can be achieved at a noise levelof 25% by using ANR as a training data filter for a nearest neighbor classifier, as compared to the one without using ANR.
Source	Zeng, X., and Martinez, T. R., "A Noise Filtering Method Using Neural Networks", Proceedings of the IEEE International Workshop on Soft-Computing Techniques in Instrumentation, Measurement, and Related Applications, pp. 26-31, 2003.;
Publisher	IEEE
Date Original	2003
Date Digital	2010-09-09
Language	English eng en
Publication Type	Peer-Reviewed Articles Conference Proceedings
Type	Text
Format	application/pdf
Owning Institution	Brigham Young University
BYU College	College of Physical and Mathematical Sciences
BYU Department	Computer Science
Copyright Status	(c) 2003 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.;
Copyright Use Information	http://www.lib.byu.edu/generic_copyright.html

Tags

Add tags for A Noise Filtering Method Using Neural Networks

View as list | View as tag cloud | report abuse

Comments

Post a Comment for A Noise Filtering Method Using Neural Networks

you wish to report:

Your comment:

Your Name:

Submit

Cancel

...

Powered by CONTENTdm®