ROBUST NEURAL GAS FOR THE ANALYSIS OF DATA WITH OUTLIERS

Abstract

Learning the structure of real world data is difficult both to recognize and describe. The structure may contain high dimensional clusters that are related in complex ways. Furthermore, real data sets may contain several outliers. Vector quantization techniques has been successfully applied as a data mining tool. In particular the neural gas (NG) is a variant of the self organizing map (SOM) where the neighborhoods are adaptively defined during training through the ranking order of the distance of prototypes from the given training sample. Unfortunately, the learning algorithm of the NG is sensitive to the presence of outliers as we show in this paper. Due to the influence of the outliers in the learning process, the topology of the employed network does not conserve the topology of the manifold of the data which is presented. In this paper, we propose to robustify the learning algorithm where the parameter estimation process is resistant to the presence of outliers in the data. We call this algorithm robust neural gas (RNG). We illustrate our technique on synthetic and real data sets.