General Definition
In general terms, the expected information gain is the change in information entropy from a prior state to a state that takes some information as given:
Where denotes the information entropy.
Read more about this topic: Information Gain In Decision Trees
Famous quotes containing the words general and/or definition:
“The general interest of the masses might take the place of the insight of genius if it were allowed freedom of action.”
—Denis Diderot (1713–1784)
“I’m beginning to think that the proper definition of “Man” is “an animal that writes letters.””
—Lewis Carroll [Charles Lutwidge Dodgson] (1832–1898)