Credible Interval - Contrasts With Confidence Interval

Contrasts With Confidence Interval

A frequentist 95% confidence interval of 35–45 means that with a large number of repeated samples, 95% of the calculated confidence intervals would include the true value of the parameter. The probability that the parameter is inside the given interval (say, 35–45) is either 0 or 1 (the non-random unknown parameter is either there or not). In frequentist terms, the parameter is fixed (cannot be considered to have a distribution of possible values) and the confidence interval is random (as it depends on the random sample). Antelman (1997, p. 375) summarizes a confidence interval as "... one interval generated by a procedure that will give correct intervals 95 % of the time".

In general, Bayesian credible intervals do not coincide with frequentist confidence intervals for two reasons:

  • credible intervals incorporate problem-specific contextual information from the prior distribution whereas confidence intervals are based only on the data;
  • credible intervals and confidence intervals treat nuisance parameters in radically different ways.

For the case of a single parameter and data that can be summarised in a single sufficient statistic, it can be shown that the credible interval and the confidence interval will coincide if the unknown parameter is a location parameter (i.e. the forward probability function has the form ), with a prior that is a uniform flat distribution; and also if the unknown parameter is a scale parameter (i.e. the forward probability function has the form ), with a Jeffreys' prior — the latter following because taking the logarithm of such a scale parameter turns it into a location parameter with a uniform distribution. But these are distinctly special (albeit important) cases; in general no such equivalence can be made.

Read more about this topic:  Credible Interval

Famous quotes containing the words contrasts, confidence and/or interval:

    A tattered copy of Johnson’s large Dictionary was a great delight to me, on account of the specimens of English versifications which I found in the Introduction. I learned them as if they were so many poems. I used to keep this old volume close to my pillow; and I amused myself when I awoke in the morning by reciting its jingling contrasts of iambic and trochaic and dactylic metre, and thinking what a charming occupation it must be to “make up” verses.
    Lucy Larcom (1824–1893)

    For this invention of yours will produce forgetfulness in the minds of those who learn it, by causing them to neglect their memory, inasmuch as, from their confidence in writing, they will recollect by the external aid of foreign symbols, and not by the internal use of their own faculties. Your discovery, therefore, is a medicine not for memory, but for recollection,—for recalling to, not for keeping in mind.
    Plato (c. 427–347 B.C.)

    [I have] been in love with one princess or another almost all my life, and I hope I shall go on so, till I die, being firmly persuaded, that if ever I do a mean action, it must be in some interval betwixt one passion and another.
    Laurence Sterne (1713–1768)