FWER Definition
Suppose we have m null hypotheses, denoted by: H1, H2, ..., Hm.
Using a statistical test, each hypothesis is declared significant/non-significant.
Summing the test results over Hi will give us the following table and related random variables:
| Null hypothesis is True | Alternative hypothesis is True | Total | |
|---|---|---|---|
| Declared significant | |||
| Declared non-significant | |||
| Total |
- is the number of true null hypotheses, an unknown parameter
- is the number of true alternative hypotheses
- is the number of false positives (Type I error)
- is the number of true positives
- is the number of false negatives (Type II error)
- is the number of true negatives
- is the number of rejected null hypotheses
- is an observable random variable, while, and are unobservable random variables.
The FWER is the probability of making even one type I error In the family,
or equivalently,
Thus, by assuring, the probability of making even one type I error in the family is controlled at level .
A procedure controls the FWER in the weak sense if the FWER control at level is guaranteed only when all null hypotheses are true (i.e. when = so the global null hypothesis is true)
A procedure controls the FWER in the strong sense if the FWER control at level is guaranteed for any configuration of true and non-true null hypotheses (including the global null hypothesis)
Read more about this topic: Familywise Error Rate
Famous quotes containing the word definition:
“Mothers often are too easily intimidated by their children’s negative reactions...When the child cries or is unhappy, the mother reads this as meaning that she is a failure. This is why it is so important for a mother to know...that the process of growing up involves by definition things that her child is not going to like. Her job is not to create a bed of roses, but to help him learn how to pick his way through the thorns.”
—Elaine Heffner (20th century)