The First Step in The Proof of Chernoff Bounds
The Chernoff bound for a random variable X, which is the sum of n independent random variables, is obtained by applying etX for some well-chosen value of t. This method was first applied by Sergei Bernstein to prove the related Bernstein inequalities.
From Markov's inequality and using independence we can derive the following useful inequality:
For any t > 0,
In particular optimizing over t and using independence we obtain,
-
(1)
Similarly,
and so,
Read more about this topic: Chernoff Bound
Famous quotes containing the words the first, step, proof and/or bounds:
“As the end of the century approaches, all our culture is like the culture of flies at the beginning of winter. Having lost their agility, dreamy and demented, they turn slowly about the window in the first icy mists of morning. They give themselves a last wash and brush-up, their ocellated eyes roll, and they fall down the curtains.”
—Jean Baudrillard (b. 1929)
“... one of the blind spots of most Negroes is their failure to realize that small overtures from whites have a large significance ... I now realize that this feeling inevitably takes possession of one in the bitter struggle for equality. Indeed, I share it. Yet I wonder how we can expect total acceptance to step full grown from the womb of prejudice, with no embryo or infancy or childhood stages.”
—Sarah Patton Boyle, U.S. civil rights activist and author. The Desegregated Heart, part 1, ch. 10 (1962)
“It comes to pass oft that a terrible oath, with a swaggering accent sharply twanged off, gives manhood more approbation than ever proof itself would have earned him.”
—William Shakespeare (1564–1616)
“Great Wits are sure to Madness near alli’d
And thin Partitions do their Bounds divide;
Else, why should he, with Wealth and Honour blest,
Refuse his Age the needful hours of Rest?”
—John Dryden (1631–1700)