Worked Example
| 1 | 2 | 3 | 4 | 5 | ||
|---|---|---|---|---|---|---|
| 1 | 0 | 0 | 0 | 0 | 14 | 1.000 |
| 2 | 0 | 2 | 6 | 4 | 2 | 0.253 |
| 3 | 0 | 0 | 3 | 5 | 6 | 0.308 |
| 4 | 0 | 3 | 9 | 2 | 0 | 0.440 |
| 5 | 2 | 2 | 8 | 1 | 1 | 0.330 |
| 6 | 7 | 7 | 0 | 0 | 0 | 0.462 |
| 7 | 3 | 2 | 6 | 3 | 0 | 0.242 |
| 8 | 2 | 5 | 3 | 2 | 2 | 0.176 |
| 9 | 6 | 5 | 2 | 1 | 0 | 0.286 |
| 10 | 0 | 2 | 2 | 3 | 7 | 0.286 |
| Total | 20 | 28 | 39 | 21 | 32 | |
| 0.143 | 0.200 | 0.279 | 0.150 | 0.229 |
In the following example, fourteen raters assign ten "subjects" to a total of five categories . The categories are presented in the columns, while the subjects are presented in the rows. Each cell is filled with the number of raters who agreed that a certain subject belongs to a certain category.
Read more about this topic: Fleiss' Kappa
Famous quotes containing the word worked:
“An artist’s originality is balanced by a corresponding conservatism, a superstitiousness, about it; which might be boiled down to “What worked before will work again.””
—Nancy Hale (b. 1908)
“Imagination of my kind is most caught, most fired, most worked upon by the unfamiliar: I have thriven ... on the changes and chances, the dislocations and ... contrasts which have made up so much of my life.”
—Elizabeth Bowen (1899–1973)