A multi-objective genetic programming approach to developing Pareto optimal decision trees

@article{Zhao2007, abstract = {Classification is a frequently encountered data mining problem. Decision tree techniques have been widely used to build classification models as such models closely resemble human reasoning and are easy to understand. Many real-world classification problems are cost-sensitive, meaning that different types of misclassification errors are not equally costly. Since different decision trees may excel under different cost settings, a set of non-dominated decision trees should be developed and presented to the decision maker for consideration, if the costs of different types of misclassification errors are not precisely determined. This paper proposes a multi-objective genetic programming approach to developing such alternative Pareto optimal decision trees. It also allows the decision maker to specify partial preferences on the conflicting objectives, such as false negative vs. false positive, sensitivity vs. specificity, and recall vs. precision, to further reduce the number of alternative solutions. A diabetes prediction problem and a credit card application approval problem are used to illustrate the application of the proposed approach.}, author = {Zhao, Huimin }, booktitle = {Integrated Decision Support}, citeulike-article-id = {2789280}, doi = {http://dx.doi.org/10.1016/j.dss.2006.12.011}, journal = {Decision Support Systems}, month = {April}, number = {3}, pages = {809--826}, posted-at = {2008-05-12 12:42:15}, priority = {2}, title = {A multi-objective genetic programming approach to developing Pareto optimal decision trees}, url = {http://dx.doi.org/10.1016/j.dss.2006.12.011}, volume = {43}, year = {2007} }

TY - JOUR ID - Zhao2007 L3 - citeulike-article-id:2789280 N2 - Classification is a frequently encountered data mining problem. Decision tree techniques have been widely used to build classification models as such models closely resemble human reasoning and are easy to understand. Many real-world classification problems are cost-sensitive, meaning that different types of misclassification errors are not equally costly. Since different decision trees may excel under different cost settings, a set of non-dominated decision trees should be developed and presented to the decision maker for consideration, if the costs of different types of misclassification errors are not precisely determined. This paper proposes a multi-objective genetic programming approach to developing such alternative Pareto optimal decision trees. It also allows the decision maker to specify partial preferences on the conflicting objectives, such as false negative vs. false positive, sensitivity vs. specificity, and recall vs. precision, to further reduce the number of alternative solutions. A diabetes prediction problem and a credit card application approval problem are used to illustrate the application of the proposed approach. IS - 3 JF - Decision Support Systems EP - 826 TI - A multi-objective genetic programming approach to developing Pareto optimal decision trees VL - 43 T2 - Integrated Decision Support SP - 809 AU - Zhao, Huimin PY - 2007/04// UR - http://dx.doi.org/10.1016/j.dss.2006.12.011 ER -