No Free Lunch Theorem
In mathematical folklore, the "no free lunch" theorem (sometimes pluralized) of Wolpert and Macready appears in the 1997 "No Free Lunch Theorems for Optimization." Wolpert had previously derived no free lunch theorems for machine learning (statistical inference). In 2005, Wolpert and Macready themselves indicated that the first theorem in their paper "state that any two optimization algorithms are equivalent when their performance is averaged across all possible problems." The 1997 theorems of Wolpert and Macready are mathematically technical and some find them unintuitive. The folkloric "no free lunch" (NFL) theorem is an easily stated and easily understood consequence of theorems Wolpert and Macready actually prove. It is weaker than the proven theorems, and thus does not encapsulate them.
Various investigators have extended the work of Wolpert and Macready substantively. See No free lunch in search and optimization for treatment of the research area.
Read more about No Free Lunch Theorem: Original NFL Theorems, Intelligent Design and The NFL Theorem
Famous quotes containing the words free, lunch and/or theorem:
“Openmindedness should not be fostered because, as Scripture teaches, Truth is great and will prevail, nor because, as Milton suggests, Truth will always win in a free and open encounter. It should be fostered for its own sake.”
—Richard Rorty (b. 1931)
“Lunch? You gotta be kidding. Lunch is for wimps.”
—Stanley Weiser, U.S. screenwriter, and Oliver Stone. Gordon Gekko (Michael Douglas)
“To insure the adoration of a theorem for any length of time, faith is not enough, a police force is needed as well.”
—Albert Camus (1913–1960)