Worked Example
| 1 | 2 | 3 | 4 | 5 | ||
|---|---|---|---|---|---|---|
| 1 | 0 | 0 | 0 | 0 | 14 | 1.000 |
| 2 | 0 | 2 | 6 | 4 | 2 | 0.253 |
| 3 | 0 | 0 | 3 | 5 | 6 | 0.308 |
| 4 | 0 | 3 | 9 | 2 | 0 | 0.440 |
| 5 | 2 | 2 | 8 | 1 | 1 | 0.330 |
| 6 | 7 | 7 | 0 | 0 | 0 | 0.462 |
| 7 | 3 | 2 | 6 | 3 | 0 | 0.242 |
| 8 | 2 | 5 | 3 | 2 | 2 | 0.176 |
| 9 | 6 | 5 | 2 | 1 | 0 | 0.286 |
| 10 | 0 | 2 | 2 | 3 | 7 | 0.286 |
| Total | 20 | 28 | 39 | 21 | 32 | |
| 0.143 | 0.200 | 0.279 | 0.150 | 0.229 |
In the following example, fourteen raters assign ten "subjects" to a total of five categories . The categories are presented in the columns, while the subjects are presented in the rows. Each cell is filled with the number of raters who agreed that a certain subject belongs to a certain category.
Read more about this topic: Fleiss' Kappa
Famous quotes containing the word worked:
“Oh, I realize it’s a penny here and a penny there, but look at me: I’ve worked myself up from nothing to a state of extreme poverty.”
—Arthur Sheekman, U.S. screenwriter. Norman McLeod. Groucho Marx as himself, in Monkey Business (film)
“Along with the lazy man ... the dying man is the immoral man: the former, a subject that does not work; the latter, an object that no longer even makes itself available to be worked on by others.”
—Michel de Certeau (1925–1986)