FWER Definition
Suppose we have m null hypotheses, denoted by: H1, H2, ..., Hm.
Using a statistical test, each hypothesis is declared significant/non-significant.
Summing the test results over Hi will give us the following table and related random variables:
Null hypothesis is True | Alternative hypothesis is True | Total | |
---|---|---|---|
Declared significant | |||
Declared non-significant | |||
Total |
- is the number of true null hypotheses, an unknown parameter
- is the number of true alternative hypotheses
- is the number of false positives (Type I error)
- is the number of true positives
- is the number of false negatives (Type II error)
- is the number of true negatives
- is the number of rejected null hypotheses
- is an observable random variable, while, and are unobservable random variables.
The FWER is the probability of making even one type I error In the family,
or equivalently,
Thus, by assuring, the probability of making even one type I error in the family is controlled at level .
A procedure controls the FWER in the weak sense if the FWER control at level is guaranteed only when all null hypotheses are true (i.e. when = so the global null hypothesis is true)
A procedure controls the FWER in the strong sense if the FWER control at level is guaranteed for any configuration of true and non-true null hypotheses (including the global null hypothesis)
Read more about this topic: Familywise Error Rate
Famous quotes containing the word definition:
“... if, as women, we accept a philosophy of history that asserts that women are by definition assimilated into the male universal, that we can understand our past through a male lensif we are unaware that women even have a historywe live our lives similarly unanchored, drifting in response to a veering wind of myth and bias.”
—Adrienne Rich (b. 1929)