General Definition
In general terms, the expected information gain is the change in information entropy from a prior state to a state that takes some information as given:
Where denotes the information entropy.
Read more about this topic: Information Gain In Decision Trees
Famous quotes containing the words general and/or definition:
“At Hayes’ General Store, west of the cemetery, hangs an old army rifle, used by a discouraged Civil War veteran to end his earthly troubles. The grocer took the rifle as payment ‘on account.’”
—Administration for the State of Con, U.S. public relief program (1935-1943)
“... we all know the wag’s definition of a philanthropist: a man whose charity increases directly as the square of the distance.”
—George Eliot [Mary Ann (or Marian)
Related Phrases
Related Words