Optimization of approximate decision rules relative to number of misclassifications

Amin, Talha M.; Chikalov, Igor; Moshkov, Mikhail; Zielosko, Beata

Optimization of approximate decision rules relative to number of misclassifications

Type

Article

Authors

Amin, Talha M.

Chikalov, Igor
Moshkov, Mikhail

Zielosko, Beata

KAUST Department

Applied Mathematics and Computational Science Program
Computer Science Program
Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Extensions of Dynamic Programming, Machine Learning and Discrete Optimization Research Group

Date

2012-12-01

Abstract

In the paper, we study an extension of dynamic programming approach which allows optimization of approximate decision rules relative to the number of misclassifications. We introduce an uncertainty measure J(T) which is a difference between the number of rows in a decision table T and the number of rows with the most common decision for T. For a nonnegative real number γ, we consider γ-decision rules that localize rows in subtables of T with uncertainty at most γ. The presented algorithm constructs a directed acyclic graph Δγ(T). Based on this graph we can describe the whole set of so-called irredundant γ-decision rules. We can optimize rules from this set according to the number of misclassifications. Results of experiments with decision tables from the UCI Machine Learning Repository are presented. © 2012 The authors and IOS Press. All rights reserved.