Evaluation of a new hybrid algorithm for highly imbalanced classification problems

AHUMADA, HERNÁN; GRINBLAT, GUILLERMO L.; UZAL, LUCAS C.; CECCATTO, ALEJANDRO; GRANITTO, PABLO M.

International Journal of Hybrid Intelligent Systems

IOS Press

Lugar: Amsterdam; Año: 2011 vol. 8 p. 199 - 211

1448-5869

Many times in classification problems, in particular in critical real world applications, one of the classes has much less samples than the others (usually know as the class imbalance problem). In this work we discuss and evaluate the use of the REPMAC algorithm to solve imbalanced problems. Using a clustering method, REPMAC recursively splits the majority class in several subsets, creating a decision tree, until the resulting sub-problems are balanced or easy to solve. We use two diverse clustering methods and three different classifiers coupled with REPMAC to evaluate the new method on several benchmark datasets spanning a wide range of number of features, samples and imbalance degree. We also apply our method to a real world problem, the identification of weed seeds. We find that the good performance of REPMAC is almost independent of the classifier or the clustering method coupled to it, which suggest that its success is mostly related to the use of an appropriate strategy to cope with imbalanced problems.