Worked Example
| 1 | 2 | 3 | 4 | 5 | ||
|---|---|---|---|---|---|---|
| 1 | 0 | 0 | 0 | 0 | 14 | 1.000 |
| 2 | 0 | 2 | 6 | 4 | 2 | 0.253 |
| 3 | 0 | 0 | 3 | 5 | 6 | 0.308 |
| 4 | 0 | 3 | 9 | 2 | 0 | 0.440 |
| 5 | 2 | 2 | 8 | 1 | 1 | 0.330 |
| 6 | 7 | 7 | 0 | 0 | 0 | 0.462 |
| 7 | 3 | 2 | 6 | 3 | 0 | 0.242 |
| 8 | 2 | 5 | 3 | 2 | 2 | 0.176 |
| 9 | 6 | 5 | 2 | 1 | 0 | 0.286 |
| 10 | 0 | 2 | 2 | 3 | 7 | 0.286 |
| Total | 20 | 28 | 39 | 21 | 32 | |
| 0.143 | 0.200 | 0.279 | 0.150 | 0.229 |
In the following example, fourteen raters assign ten "subjects" to a total of five categories . The categories are presented in the columns, while the subjects are presented in the rows. Each cell is filled with the number of raters who agreed that a certain subject belongs to a certain category.
Read more about this topic: Fleiss' Kappa
Famous quotes containing the word worked:
“... how often the Presidency has simply meant that a man shall be abused, distrusted, and worked to death while he is filling the great office, and that he should drop into unmerited oblivion when he has left the White House ...”
—M. E. W. Sherwood (1826–1903)
“He worked for twenty years to get his contemporaries to believe—and in the end he succeeded. Meanwhile, however, his adversaries also succeeded: he could no longer believe in himself.”
—Friedrich Nietzsche (1844–1900)