CMA-ES - Performance in Practice

Performance in Practice

In contrast to most other evolutionary algorithms, the CMA-ES is, from the users perspective, quasi parameter-free. However, the number of candidate samples λ (population size) can be adjusted by the user in order to change the characteristic search behavior (see above). CMA-ES has been empirically successful in hundreds of applications and is considered to be useful in particular on non-convex, non-separable, ill-conditioned, multi-modal or noisy objective functions. The search space dimension ranges typically between two and a few hundred. Assuming a black-box optimization scenario, where gradients are not available (or not useful) and function evaluations are the only considered cost of search, the CMA-ES method is likely to be outperformed by other methods in the following conditions:

  • on low-dimensional functions, say, for example by the downhill simplex method or surrogate-based methods (like kriging with expected improvement);
  • on separable functions without or with only negligible dependencies between the design variables in particular in the case of multi-modality or large dimension, for example by differential evolution;
  • on (nearly) convex-quadratic functions with low or moderate condition number of the Hessian matrix, where BFGS or NEWUOA are typically ten times faster;
  • on functions that can already be solved with a comparatively small number of function evaluations, say no more than, where CMA-ES is often slower than, for example, NEWUOA or Multilevel Coordinate Search (MCS ).

On separable functions the performance disadvantage is likely to be most significant, in that CMA-ES might not be able to find at all comparable solutions. On the other hand, on non-separable functions that are ill-conditioned or rugged or can only be solved with more than function evaluations, the CMA-ES shows most often superior performance.

Read more about this topic:  CMA-ES

Famous quotes containing the words performance in, performance and/or practice:

    Tennis is more than just a sport. It’s an art, like the ballet. Or like a performance in the theater. When I step on the court I feel like Anna Pavlova. Or like Adelina Patti. Or even like Sarah Bernhardt. I see the footlights in front of me. I hear the whisperings of the audience. I feel an icy shudder. Win or die! Now or never! It’s the crisis of my life.
    Bill Tilden (1893–1953)

    There are people who think that wrestling is an ignoble sport. Wrestling is not sport, it is a spectacle, and it is no more ignoble to attend a wrestled performance of suffering than a performance of the sorrows of Arnolphe or Andromaque.
    Roland Barthes (1915–1980)

    Fine art, that exists for itself alone, is art in a final state of impotence. If nobody, including the artist, acknowledges art as a means of knowing the world, then art is relegated to a kind of rumpus room of the mind and the irresponsibility of the artist and the irrelevance of art to actual living becomes part and parcel of the practice of art.
    Angela Carter (1940–1992)