Worked Example
| 1 | 2 | 3 | 4 | 5 | ||
|---|---|---|---|---|---|---|
| 1 | 0 | 0 | 0 | 0 | 14 | 1.000 |
| 2 | 0 | 2 | 6 | 4 | 2 | 0.253 |
| 3 | 0 | 0 | 3 | 5 | 6 | 0.308 |
| 4 | 0 | 3 | 9 | 2 | 0 | 0.440 |
| 5 | 2 | 2 | 8 | 1 | 1 | 0.330 |
| 6 | 7 | 7 | 0 | 0 | 0 | 0.462 |
| 7 | 3 | 2 | 6 | 3 | 0 | 0.242 |
| 8 | 2 | 5 | 3 | 2 | 2 | 0.176 |
| 9 | 6 | 5 | 2 | 1 | 0 | 0.286 |
| 10 | 0 | 2 | 2 | 3 | 7 | 0.286 |
| Total | 20 | 28 | 39 | 21 | 32 | |
| 0.143 | 0.200 | 0.279 | 0.150 | 0.229 |
In the following example, fourteen raters assign ten "subjects" to a total of five categories . The categories are presented in the columns, while the subjects are presented in the rows. Each cell is filled with the number of raters who agreed that a certain subject belongs to a certain category.
Read more about this topic: Fleiss' Kappa
Famous quotes containing the word worked:
“Imagination of my kind is most caught, most fired, most worked upon by the unfamiliar: I have thriven ... on the changes and chances, the dislocations and ... contrasts which have made up so much of my life.”
—Elizabeth Bowen (1899–1973)
“I think it’s unfair for people to try to make successful blacks feel guilty for not feeling guilty.... We’re unique in that we’re not supposed to enjoy the things we’ve worked so hard for.”
—Patricia Grayson, African American administrator. As quoted in Time magazine, p. 59 (March 13, 1989)