Design and Analysis of Decision Rules via Dynamic Programming

Handle URI:
http://hdl.handle.net/10754/623282
Title:
Design and Analysis of Decision Rules via Dynamic Programming
Authors:
Amin, Talha M. ( 0000-0003-3035-8612 )
Abstract:
The areas of machine learning, data mining, and knowledge representation have many different formats used to represent information. Decision rules, amongst these formats, are the most expressive and easily-understood by humans. In this thesis, we use dynamic programming to design decision rules and analyze them. The use of dynamic programming allows us to work with decision rules in ways that were previously only possible for brute force methods. Our algorithms allow us to describe the set of all rules for a given decision table. Further, we can perform multi-stage optimization by repeatedly reducing this set to only contain rules that are optimal with respect to selected criteria. One way that we apply this study is to generate small systems with short rules by simulating a greedy algorithm for the set cover problem. We also compare maximum path lengths (depth) of deterministic and non-deterministic decision trees (a non-deterministic decision tree is effectively a complete system of decision rules) with regards to Boolean functions. Another area of advancement is the presentation of algorithms for constructing Pareto optimal points for rules and rule systems. This allows us to study the existence of “totally optimal” decision rules (rules that are simultaneously optimal with regards to multiple criteria). We also utilize Pareto optimal points to compare and rate greedy heuristics with regards to two criteria at once. Another application of Pareto optimal points is the study of trade-offs between cost and uncertainty which allows us to find reasonable systems of decision rules that strike a balance between length and accuracy.
Advisors:
Moshkov, Mikhail ( 0000-0003-0085-9483 )
Committee Member:
Bajic, Vladimir B. ( 0000-0001-5435-4750 ) ; Zhang, Xiangliang ( 0000-0002-3574-5665 ) ; Boros, Endre
KAUST Department:
Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Program:
Computer Science
Issue Date:
24-Apr-2017
Type:
Dissertation
Appears in Collections:
Dissertations

Full metadata record

DC FieldValue Language
dc.contributor.advisorMoshkov, Mikhailen
dc.contributor.authorAmin, Talha M.en
dc.date.accessioned2017-04-26T06:57:04Z-
dc.date.available2017-04-26T06:57:04Z-
dc.date.issued2017-04-24-
dc.identifier.urihttp://hdl.handle.net/10754/623282-
dc.description.abstractThe areas of machine learning, data mining, and knowledge representation have many different formats used to represent information. Decision rules, amongst these formats, are the most expressive and easily-understood by humans. In this thesis, we use dynamic programming to design decision rules and analyze them. The use of dynamic programming allows us to work with decision rules in ways that were previously only possible for brute force methods. Our algorithms allow us to describe the set of all rules for a given decision table. Further, we can perform multi-stage optimization by repeatedly reducing this set to only contain rules that are optimal with respect to selected criteria. One way that we apply this study is to generate small systems with short rules by simulating a greedy algorithm for the set cover problem. We also compare maximum path lengths (depth) of deterministic and non-deterministic decision trees (a non-deterministic decision tree is effectively a complete system of decision rules) with regards to Boolean functions. Another area of advancement is the presentation of algorithms for constructing Pareto optimal points for rules and rule systems. This allows us to study the existence of “totally optimal” decision rules (rules that are simultaneously optimal with regards to multiple criteria). We also utilize Pareto optimal points to compare and rate greedy heuristics with regards to two criteria at once. Another application of Pareto optimal points is the study of trade-offs between cost and uncertainty which allows us to find reasonable systems of decision rules that strike a balance between length and accuracy.en
dc.language.isoenen
dc.subjectdecision rulesen
dc.subjectDynamic Programmingen
dc.subjectGreedy heuristicsen
dc.subjectoptimizationen
dc.subjectpareto optimalityen
dc.titleDesign and Analysis of Decision Rules via Dynamic Programmingen
dc.typeDissertationen
dc.contributor.departmentComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Divisionen
thesis.degree.grantorKing Abdullah University of Science and Technologyen_GB
dc.contributor.committeememberBajic, Vladimir B.en
dc.contributor.committeememberZhang, Xiangliangen
dc.contributor.committeememberBoros, Endreen
thesis.degree.disciplineComputer Scienceen
thesis.degree.nameDoctor of Philosophyen
dc.person.id101787en
All Items in KAUST are protected by copyright, with all rights reserved, unless otherwise indicated.