General Definition
In general terms, the expected information gain is the change in information entropy from a prior state to a state that takes some information as given:
Where denotes the information entropy.
Read more about this topic: Information Gain In Decision Trees
Famous quotes containing the words general and/or definition:
“I suggested to them also the great desirability of a general knowledge on the Island of the English language. They are under an English speaking government and are a part of the territory of an English speaking nation.... While I appreciated the desirability of maintaining their grasp on the Spanish language, the beauty of that language and the richness of its literature, that as a practical matter for them it was quite necessary to have a good comprehension of English.”
—Calvin Coolidge (1872–1933)
“Perhaps the best definition of progress would be the continuing efforts of men and women to narrow the gap between the convenience of the powers that be and the unwritten charter.”
—Nadine Gordimer (b. 1923)