Let be a sequence of independent identically distributed random variables with values in the state space S with probability measure P.
Definition
- The empirical measure is defined for measurable subsets of S and given by
- where is the indicator function and is the Dirac measure.
For a fixed measurable set A, nPn(A) is a binomial random variable with mean nP(A) and variance nP(A)(1 − P(A)). In particular, is an unbiased estimator of P(A).
Definition
- is the empirical measure indexed by, a collection of measurable subsets of S.
To generalize this notion further, observe that the empirical measure Pn maps measurable functions to their empirical mean,
In particular, the empirical measure of A is simply the empirical mean of the indicator function, .
For a fixed measurable function f, is a random variable with mean and variance .
By the strong law of large numbers, converges to P(A) almost surely for fixed A. Similarly converges to almost surely for a fixed measurable function f. The problem of uniform convergence of to P was open until Vapnik and Chervonenkis solved it in 1968.
If the class (or ) is Glivenko–Cantelli with respect to P then converges to P uniformly over (or ). In other words, with probability 1 we have
Read more about this topic: Empirical Measure
Famous quotes containing the word definition:
“Was man made stupid to see his own stupidity?
Is God by definition indifferent, beyond us all?
Is the eternal truth man’s fighting soul
Wherein the Beast ravens in its own avidity?”
—Richard Eberhart (b. 1904)
“Although there is no universal agreement as to a definition of life, its biological manifestations are generally considered to be organization, metabolism, growth, irritability, adaptation, and reproduction.”
—The Columbia Encyclopedia, Fifth Edition, the first sentence of the article on “life” (based on wording in the First Edition, 1935)
“Mothers often are too easily intimidated by their children’s negative reactions...When the child cries or is unhappy, the mother reads this as meaning that she is a failure. This is why it is so important for a mother to know...that the process of growing up involves by definition things that her child is not going to like. Her job is not to create a bed of roses, but to help him learn how to pick his way through the thorns.”
—Elaine Heffner (20th century)