Exponential Family

In probability and statistics, an exponential family is an important class of probability distributions sharing a certain form, specified below. This special form is chosen for mathematical convenience, on account of some useful algebraic properties, as well as for generality, as exponential families are in a sense very natural distributions to consider. The concept of exponential families is credited to E. J. G. Pitman, G. Darmois, and B. O. Koopman in 1935–6. The term exponential class is sometimes used in place of "exponential family".

The exponential families include many of the most common distributions, including the normal, exponential, gamma, chi-squared, beta, Dirichlet, Bernoulli, categorical, Poisson, Wishart, Inverse Wishart and many others. A number of common distributions are exponential families only when certain parameters are considered fixed and known, e.g. binomial (with fixed number of trials), multinomial (with fixed number of trials), and negative binomial (with fixed number of failures). Examples of common distributions that are not exponential families are Student's t, most mixture distributions, and even the family of uniform distributions with unknown bounds. See the section below on examples for more discussion.

Consideration of exponential-family distributions provides a general framework for selecting a possible alternative parameterisation of the distribution, in terms of natural parameters, and for defining useful sample statistics, called the natural statistics of the family. See below for more information.

Read more about Exponential Family:  Definition, The Meaning of "exponential Family", Interpretation, Properties, Examples, Table of Distributions, Maximum Entropy Derivation

Famous quotes containing the word family:

    “In former times and in less complex societies, children could find their way into the adult world by watching workers and perhaps giving them a hand; by lingering at the general store long enough to chat with, and overhear conversations of, adults...; by sharing and participating in the tasks of family and community that were necessary to survival. They were in, and of, the adult world while yet sensing themselves apart as children.”
    —Dorothy H. Cohen (20th century)