Constructing A Decision Tree Using Information Gain
A decision tree can be constructed top-down using the information gain in the following way:
- begin at the root node
- determine the attribute with the highest information gain which is not already used as an ancestor node
- add a child node for each possible value of that attribute
- attach all examples to the child node where the attribute values of the examples are identical to the attribute value attached to the node
- if all examples attached to the child node can be classified uniquely add that classification to that node and mark it as leaf node
- go back to step two if there are unused attributes left, otherwise add the classification of most of the examples attached to the child node
Read more about this topic: Information Gain In Decision Trees
Famous quotes containing the words constructing, decision, tree, information and/or gain:
“The very hope of experimental philosophy, its expectation of constructing the sciences into a true philosophy of nature, is based on induction, or, if you please, the a priori presumption, that physical causation is universal; that the constitution of nature is written in its actual manifestations, and needs only to be deciphered by experimental and inductive research; that it is not a latent invisible writing, to be brought out by the magic of mental anticipation or metaphysical mediation.”
—Chauncey Wright (1830–1875)
“Because of these convictions, I made a personal decision in the 1964 Presidential campaign to make education a fundamental issue and to put it high on the nation’s agenda. I proposed to act on my belief that regardless of a family’s financial condition, education should be available to every child in the United States—as much education as he could absorb.”
—Lyndon Baines Johnson (1908–1973)
“A pinecone does not fall far from the tree trunk.”
—Estonian. Trans. by Ilse Lehiste (1993)
“The real, then, is that which, sooner or later, information and reasoning would finally result in, and which is therefore independent of the vagaries of me and you. Thus, the very origin of the conception of reality shows that this conception essentially involves the notion of a COMMUNITY, without definite limits, and capable of a definite increase of knowledge.”
—Charles Sanders Peirce (1839–1914)
“They had their fortunes to make, everything to gain and nothing to lose. They were schooled in and anxious for debates; forcible in argument; reckless and brilliant. For them it was but a short and natural step from swaying juries in courtroom battles over the ownership of land to swaying constituents in contests for office. For the lawyer, oratory was the escalator that could lift a political candidate to higher ground.”
—Federal Writers’ Project Of The Wor, U.S. public relief program (1935-1943)