Subgradient-projection & Bundle Methods
During the 1970s, Claude Lemaréchal and Phil. Wolfe proposed "bundle methods" of descent for problems of convex minimization. Their modern versions and full convergence analysis were provided by Kiwiel. Contemporary bundle-methods often use "level control" rules for choosing step-sizes, developing techniques from the "subgradient-projection" method of Boris T. Polyak (1969). However, there are problems on which bundle methods offer little advantage over subgradient-projection methods.
Read more about this topic: Subgradient Method
Famous quotes containing the words bundle and/or methods:
“In the quilts I had found good objects—hospitable, warm, with soft edges yet resistant, with boundaries yet suggesting a continuous safe expanse, a field that could be bundled, a bundle that could be unfurled, portable equipment, light, washable, long-lasting, colorful, versatile, functional and ornamental, private and universal, mine and thine.”
—Radka Donnell-Vogt, U.S. quiltmaker. As quoted in Lives and Works, by Lynn F. Miller and Sally S. Swenson (1981)
“Cold and hunger seem more friendly to my nature than those methods which men have adopted and advise to ward them off.”
—Henry David Thoreau (1817–1862)