Statistical Conclusion Validity

Statistical conclusion validity refers to the appropriate use of statistics to infer whether the presumed independent and dependent variables covary (Cook & Campbell, 1979). It concerns two related statistical inferences: (1) whether the presumed cause and effect covary and (2) how strongly they covary.

The most common threats to statistical conclusion validity are:

  • Low statistical power
  • Violated assumptions of the test statistics
  • Fishing and the error rate problem
  • Unreliability of measures
  • Restriction of range
  • Unreliability of treatment implementation
  • Extraneous variance in the experimental setting
  • Heterogeneity of the units under study
  • Inaccurate effect size estimation

Read more about Statistical Conclusion Validity:  See Also

Famous quotes containing the words conclusion and/or validity:

    Girls who put out are tramps. Girls who don’t are ladies. This is, however, a rather archaic usage of the word. Should one of you boys happen upon a girl who doesn’t put out, do not jump to the conclusion that you have found a lady. What you have probably found is a lesbian.
    Fran Lebowitz (b. 1951)

    The hardiest skeptic who has seen a horse broken, a pointer trained, or has visited a menagerie or the exhibition of the Industrious Fleas, will not deny the validity of education. “A boy,” says Plato, “is the most vicious of all beasts;” and in the same spirit the old English poet Gascoigne says, “A boy is better unborn than untaught.”
    Ralph Waldo Emerson (1803–1882)