Fleiss' Kappa - Worked Example

Worked Example

1 2 3 4 5
1 0 0 0 0 14 1.000
2 0 2 6 4 2 0.253
3 0 0 3 5 6 0.308
4 0 3 9 2 0 0.440
5 2 2 8 1 1 0.330
6 7 7 0 0 0 0.462
7 3 2 6 3 0 0.242
8 2 5 3 2 2 0.176
9 6 5 2 1 0 0.286
10 0 2 2 3 7 0.286
Total 20 28 39 21 32
0.143 0.200 0.279 0.150 0.229
Table of values for computing the worked example

In the following example, fourteen raters assign ten "subjects" to a total of five categories . The categories are presented in the columns, while the subjects are presented in the rows. Each cell is filled with the number of raters who agreed that a certain subject belongs to a certain category.

Read more about this topic:  Fleiss' Kappa

Famous quotes containing the word worked:

    Tailor’s work—the finishing of men’s outside garments—was the “trade” learned most frequently by women in [the 1820s and 1830s], and one or more of my older sisters worked at it; I think it must have been at home, for I somehow or somewhere got the idea, while I was a small child, that the chief end of woman was to make clothing for mankind.
    Lucy Larcom (1824–1893)

    I will never accept that I got a free ride. It wasn’t free at all. My ancestors were brought here against their will. They were made to work and help build the country. I worked in the cotton fields from the age of seven. I worked in the laundry for twenty- three years. I worked for the national organization for nine years. I just retired from city government after twelve-and-a- half years.
    Johnnie Tillmon (b. 1926)