General Definition
In general terms, the expected information gain is the change in information entropy from a prior state to a state that takes some information as given:
Where denotes the information entropy.
Read more about this topic: Information Gain In Decision Trees
Famous quotes containing the words general and/or definition:
“A bill of rights is what the people are entitled to against every government on earth, general or particular, and what no just government should refuse, or rest on inference.”
—Thomas Jefferson (1743–1826)
“Beauty, like all other qualities presented to human experience, is relative; and the definition of it becomes unmeaning and useless in proportion to its abstractness. To define beauty not in the most abstract, but in the most concrete terms possible, not to find a universal formula for it, but the formula which expresses most adequately this or that special manifestation of it, is the aim of the true student of aesthetics.”
—Walter Pater (1839–1894)