Decision Rules Derived from Optimal Decision Trees with Hypotheses

Mohammad Azad, Igor Chikalov, Shahid Hussain, Mikhail Moshkov, Beata Zielosko

Research output: Contribution to journalArticlepeer-review

Abstract

Conventional decision trees use queries each of which is based on one attribute. In this study, we also examine decision trees that handle additional queries based on hypotheses. This kind of query is similar to the equivalence queries considered in exact learning. Earlier, we designed dynamic programming algorithms for the computation of the minimum depth and the minimum number of internal nodes in decision trees that have hypotheses. Modification of these algorithms considered in the present paper permits us to build decision trees with hypotheses that are optimal relative to the depth or relative to the number of the internal nodes. We compare the length and coverage of decision rules extracted from optimal decision trees with hypotheses and decision rules extracted from optimal conventional decision trees to choose the ones that are preferable as a tool for the representation of information. To this end, we conduct computer experiments on various decision tables from the UCI Machine Learning Repository. In addition, we also consider decision tables for randomly generated Boolean functions. The collected results show that the decision rules derived from decision trees with hypotheses in many cases are better than the rules extracted from conventional decision trees.
Original languageEnglish (US)
Pages (from-to)1641
JournalEntropy
Volume23
Issue number12
DOIs
StatePublished - Dec 7 2021

ASJC Scopus subject areas

  • Physics and Astronomy (miscellaneous)
  • Statistical and Nonlinear Physics

Fingerprint

Dive into the research topics of 'Decision Rules Derived from Optimal Decision Trees with Hypotheses'. Together they form a unique fingerprint.

Cite this