Decision Rules Derived from Optimal Decision Trees with Hypotheses
KAUST DepartmentApplied Mathematics and Computational Science Program
Computer, Electrical and Mathematical Science and Engineering (CEMSE) Division
Extensions of Dynamic Programming, Machine Learning and Discrete Optimization Research Group
Permanent link to this recordhttp://hdl.handle.net/10754/673940
MetadataShow full item record
AbstractConventional decision trees use queries each of which is based on one attribute. In this study, we also examine decision trees that handle additional queries based on hypotheses. This kind of query is similar to the equivalence queries considered in exact learning. Earlier, we designed dynamic programming algorithms for the computation of the minimum depth and the minimum number of internal nodes in decision trees that have hypotheses. Modification of these algorithms considered in the present paper permits us to build decision trees with hypotheses that are optimal relative to the depth or relative to the number of the internal nodes. We compare the length and coverage of decision rules extracted from optimal decision trees with hypotheses and decision rules extracted from optimal conventional decision trees to choose the ones that are preferable as a tool for the representation of information. To this end, we conduct computer experiments on various decision tables from the UCI Machine Learning Repository. In addition, we also consider decision tables for randomly generated Boolean functions. The collected results show that the decision rules derived from decision trees with hypotheses in many cases are better than the rules extracted from conventional decision trees.
CitationAzad, M., Chikalov, I., Hussain, S., Moshkov, M., & Zielosko, B. (2021). Decision Rules Derived from Optimal Decision Trees with Hypotheses. Entropy, 23(12), 1641. doi:10.3390/e23121641
SponsorsResearch funded by King Abdullah University of Science and Technology.