Feature selection for high dimensional imbalanced class data using harmony search

Awduron Sefydliadau
  • Alireza Moayedikia(Awdur)
    Deakin University
  • Kok-Leong Ong(Awdur)
    La Trobe University
  • Yee Ling Boo(Awdur)
    Royal Melbourne Institute of Technology
  • William G. S. Yeoh(Awdur)
    Deakin University
  • Richard Jensen(Awdur)
Math Erthygl
Iaith wreiddiolSaesneg
Tudalennau (o-i)38-49
CyfnodolynEngineering Applications of Artificial Intelligence
Dyddiad ar-lein cynnar28 Hyd 2016
Dangosyddion eitem ddigidol (DOIs)
StatwsCyhoeddwyd - 01 Ion 2017
Arddangos ystadegau lawrlwytho
Gweld graff cysylltiadau
Fformatau enwi


Misclassification costs of minority class data in real-world applications can be very high. This is a challenging problem especially when the data is also high in dimensionality because of the increase in overfitting and lower model interpretability. Feature selection is recently a popular way to address this problem by identifying features that best predict a minority class. This paper introduces a novel feature selection method call SYMON which uses symmetrical uncertainty and harmony search. Unlike existing methods, SYMON uses symmetrical uncertainty to weigh features with respect to their dependency to class labels. This helps to identify powerful features in retrieving the least frequent class labels. SYMON also uses harmony search to formulate the feature selection phase as an optimisation problem to select the best possible combination of features. The proposed algorithm is able to deal with situations where a set of features have the same weight, by incorporating two vector tuning operations embedded in the harmony search process. In this paper, SYMON is compared against various benchmark feature selection algorithms that were developed to address the same issue. Our empirical evaluation on different micro-array data sets using G-Mean and AUC measures confirm that SYMON is a comparable or a better solution to current benchmarks.