The ID3 Metrics
To avoid overtraining, smaller decision trees should be preferred over larger ones. This algorithm usually produces small trees, but it does not always produce the smallest possible tree.
The optimization step makes use of information entropy:
Read more about this topic: ID3 Algorithm