Chernoff Bound - The First Step in The Proof of Chernoff Bounds

The First Step in The Proof of Chernoff Bounds

The Chernoff bound for a random variable X, which is the sum of n independent random variables, is obtained by applying etX for some well-chosen value of t. This method was first applied by Sergei Bernstein to prove the related Bernstein inequalities.

From Markov's inequality and using independence we can derive the following useful inequality:

For any t > 0,

In particular optimizing over t and using independence we obtain,

(1)

Similarly,

and so,

Read more about this topic:  Chernoff Bound

Famous quotes containing the words step, proof and/or bounds:

    The glorious dream of full father involvement in infant care will not become a widespread reality overnight. But it can happen, and it eventually will happen,... A lot of progress may take place in a short period of time if we just lighten up, step back, and give the guys a decent chance.
    Michael K. Meyerhoff (20th century)

    If any proof were needed of the progress of the cause for which I have worked, it is here tonight. The presence on the stage of these college women, and in the audience of all those college girls who will some day be the nation’s greatest strength, will tell their own story to the world.
    Susan B. Anthony (1820–1906)

    Nature seems at each man’s birth to have marked out the bounds of his virtues and vices, and to have determined how good or how wicked that man shall be capable of being.
    François, Duc De La Rochefoucauld (1613–1680)