Reducing Variance of Committee Prediction with Resampling Techniques
作者:
BAMBANG PARMANTO,
PAUL W MUNRO,
HOWARD R DOYLE,
期刊:
Connection Science
(Taylor Available online 1996)
卷期:
Volume 8,
issue 3-4
页码: 405-426
ISSN:0954-0091
年代: 1996
DOI:10.1080/095400996116848
出版商: Taylor & Francis Group
关键词: Committee;Ensemble;Bias-variance;Regularization;Bootstrap;Crossvalidation;Resampling Techniques
数据来源: Taylor
摘要:
Algorithms for reducing variance in neural network prediction using committee and resampling techniques bootstrap and cross-validation are presented. Their effectiveness is tested on data sets with different levels of noise and on medical diagnosis data sets. The methods are most effective when the noise level in the data is high or the size of the learning set is small, which consequently produces high variance. The algorithms will not be of much help in cases where the error of prediction is mainly due to bias. An increase in bias is observed due to smaller effective learning size in the bootstrap and crossvalidation committee. The impact of increased bias on the performance ranges from negligible to completely undermining the benefit of reducing the variance.
点击下载:
PDF (322KB)
返 回