Algorithmic Inference - The General Inversion Problem Solving The Fisher Question

The General Inversion Problem Solving The Fisher Question

With insufficiently large samples, the approach: fixed sample – random properties suggests inference procedures in three steps:

1. Sampling mechanism. It consists of a pair, where the seed Z is a random variable without unknown parameters, while the explaining function is a function mapping from samples of Z to samples of the random variable X we are interested in. The parameter vector is a specification of the random parameter . Its components are the parameters of the X distribution law. The Integral Transform Theorem ensures the existence of such a mechanism for each (scalar or vector) X when the seed coincides with the random variable U uniformly distributed in .
Example. For X following a Pareto distribution with parameters a and k, i.e.

a sampling mechanism for X with seed U reads:

or, equivalently,

2. Master equations. The actual connection between the model and the observed data is tossed in terms of a set of relations between statistics on the data and unknown parameters that come as a corollary of the sampling mechanisms. We call these relations master equations. Pivoting around the statistic, the general form of a master equation is:
.

With these relations we may inspect the values of the parameters that could have generated a sample with the observed statistic from a particular setting of the seeds representing the seed of the sample. Hence, to the population of sample seeds corresponds a population of parameters. In order to ensure this population clean properties, it is enough to draw randomly the seed values and involve either sufficient statistics or, simply, well-behaved statistics w.r.t. the parameters, in the master equations.

For example, the statistics and prove to be sufficient for parameters a and k of a Pareto random variable X. Thanks to the (equivalent form of the) sampling mechanism we may read them as

respectively.
3. Parameter population. Having fixed a set of master equations, you may map sample seeds into parameters either numerically through a population bootstrap, or analytically through a twisting argument. Hence from a population of seeds you obtain a population of parameters.
Example. From the above master equation we can draw a pair of parameters, compatible with the observed sample by solving the following system of equations:

where and are the observed statistics and a set of uniform seeds. Transferring to the parameters the probability (density) affecting the seeds, you obtain the distribution law of the random parameters A and K compatible with the statistics you have observed.

Compatibility denotes parameters of compatible populations, i.e. of populations that could have generated a sample giving rise to the observed statistics. You may formalize this notion as follows:

Read more about this topic:  Algorithmic Inference

Famous quotes containing the words general, problem, solving, fisher and/or question:

    “The general Mistake among us in the Educating of our Children, is, That in our Daughters we take Care of their Persons and neglect their Minds; in our Sons, we are so intent upon adorning their Minds, that we wholly neglect their Bodies.”
    —Richard Steele (1672–1729)

    “A curious thing about the ontological problem is its simplicity. It can be put in three Anglo-Saxon monosyllables: ‘What is there?’ It can be answered, moveover, in a word—‘Everything.’”
    —Willard Van Orman Quine (b. 1908)

    “If we parents accept that problems are an essential part of life’s challenges, rather than reacting to every problem as if something has gone wrong with universe that’s supposed to be perfect, we can demonstrate serenity and confidence in problem solving for our kids....By telling them that we know they have a problem and we know they can solve it, we can pass on a realistic attitude as well as empower our children with self-confidence and a sense of their own worth.”
    —Barbara Coloroso (20th century)

    “It seems to me that our three basic needs, for food and security and love, are so mixed and mingled and entwined that we cannot straightly think of one without the others. So it happens that when I write of hunger, I am really writing about love and the hunger for it, and warmth and the love of it and the hunger for it ... and then the warmth and richness and fine reality of hunger satisfied ... and it is all one.”
    —M.F.K. Fisher (b. 1908)

    “People who live in the post-totalitarian system know only too well that the question of whether one or several political parties are in power, and how these parties define and label themselves, is of far less importance than the question of whether or not it is possible to live like a human being.”
    —Václav Havel (b. 1936)