Feature Construction and Dimension Reduction Using Genetic Programming

@incollection{Neshatian2007, abstract = {This paper describes a new approach to the use of genetic programming (GP) for feature construction in classification problems. Rather than wrapping a particular classifier for single feature construction as in most of the existing methods, this approach uses GP to construct multiple (high-level) features from the original features. These constructed features are then used by decision trees for classification. As feature construction is independent of classification, the fitness function is designed based on the class dispersion and entropy. This approach is examined and compared with the standard decision tree method, using the original features, and using a combination of the original features and constructed features, on 12 benchmark classification problems. The results show that the new approach outperforms the standard way of using decision trees on these problems in terms of the classification performance, dimension reduction and the learned decision tree size.}, author = {Neshatian, Kourosh and Zhang, Mengjie and Johnston, Mark }, citeulike-article-id = {2764275}, doi = {http://dx.doi.org/10.1007/978-3-540-76928-6\_18}, journal = {AI 2007: Advances in Artificial Intelligence}, pages = {160--170}, posted-at = {2008-05-07 09:15:19}, priority = {2}, title = {Feature Construction and Dimension Reduction Using Genetic Programming}, url = {http://dx.doi.org/10.1007/978-3-540-76928-6\_18}, year = {2007} }

TY - CHAP ID - Neshatian2007 L3 - citeulike-article-id:2764275 N2 - This paper describes a new approach to the use of genetic programming (GP) for feature construction in classification problems. Rather than wrapping a particular classifier for single feature construction as in most of the existing methods, this approach uses GP to construct multiple (high-level) features from the original features. These constructed features are then used by decision trees for classification. As feature construction is independent of classification, the fitness function is designed based on the class dispersion and entropy. This approach is examined and compared with the standard decision tree method, using the original features, and using a combination of the original features and constructed features, on 12 benchmark classification problems. The results show that the new approach outperforms the standard way of using decision trees on these problems in terms of the classification performance, dimension reduction and the learned decision tree size. JF - AI 2007: Advances in Artificial Intelligence EP - 170 TI - Feature Construction and Dimension Reduction Using Genetic Programming SP - 160 AU - Neshatian, Kourosh AU - Zhang, Mengjie AU - Johnston, Mark PY - 2007/// UR - http://dx.doi.org/10.1007/978-3-540-76928-6_18 ER -