Cross-entropy Method - Estimation Via Importance Sampling

Estimation Via Importance Sampling

Consider the general problem of estimating the quantity, where is some performance function and is a member of some parametric family of distributions. Using importance sampling this quantity can be estimated as, where is a random sample from . For positive, the theoretically optimal importance sampling density (pdf)is given by . This, however, depends on the unknown . The CE method aims to approximate the optimal pdf by adaptively selecting members of the parametric family that are closest (in the Kullback-Leibler sense) to the optimal pdf .

Read more about this topic:  Cross-entropy Method

Famous quotes containing the words estimation and/or importance:

    A higher class, in the estimation and love of this city- building, market-going race of mankind, are the poets, who, from the intellectual kingdom, feed the thought and imagination with ideas and pictures which raise men out of the world of corn and money, and console them for the short-comings of the day, and the meanness of labor and traffic.
    Ralph Waldo Emerson (1803–1882)

    One’s condition on marijuana is always existential. One can feel the importance of each moment and how it is changing one. One feels one’s being, one becomes aware of the enormous apparatus of nothingness—the hum of a hi-fi set, the emptiness of a pointless interruption, one becomes aware of the war between each of us, how the nothingness in each of us seeks to attack the being of others, how our being in turn is attacked by the nothingness in others.
    Norman Mailer (b. 1923)