Robust incremental growing multi-experts network

Document Type

Article

Publication Date

1-1-2006

Abstract

Most supervised neural networks are trained by minimizing the mean square error (MSE) of the training set. In the presence of outliers, the resulting neural network model can differ significantly from the underlying model that generates the data. This paper outlines two robust learning methods for a dynamic structure neural network called incremental growing multi-experts network (IGMN). It is convincingly shown by simulation that by using a scaled robust objective function instead of the least squares function, the influence of the outliers in the training data can be completely eliminated. The network generates a much better approximation in the neighborhood of outliers. Thus, the two proposed robust learning methods namely robust least mean squares (RLMSs) and least mean log squares (LMLSs) are insensitive to the presence of outliers unlike the least mean squares (LMSs) cost function. Moreover, various types of supervised learning algorithms can easily adopt LMLS, which is a parameter-free method.

Keywords

Outliers, Dynamic structure neural network, Robust learning

Publication Title

Applied Soft Computing

ISSN

1568-4946

Divisions

ai

Volume

6

Issue

2

This document is currently not available here.

Share

COinS