Example: Exponential Distribution
Let X be an exponentially distributed random variable with parameter λ, that is, with probability density function
Its differential entropy is then
Here, was used rather than to make it explicit that the logarithm was taken to base e, to simplify the calculation.
Read more about this topic: Differential Entropy
Famous quotes containing the word distribution:
“My topic for Army reunions ... this summer: How to prepare for war in time of peace. Not by fortifications, by navies, or by standing armies. But by policies which will add to the happiness and the comfort of all our people and which will tend to the distribution of intelligence [and] wealth equally among all. Our strength is a contented and intelligent community.”
—Rutherford Birchard Hayes (1822–1893)