Sources of Inter-rater Disagreement
Different raters can disagree about measurement results from the same object by e.g. variations in the procedures of carrying out the experiment, interpreting the results and, subsequently, presenting them. All these stages may be affected by experimenter's bias, that is, a tendency to deviate towards what is expected by the rater. When interpreting and presenting the results, there may be inter-rater variations in digit preference, that is, preferences differ whether to round off a value to a lower one or a higher one.
Read more about this topic: Inter-rater Reliability
Famous quotes containing the words sources of, sources and/or disagreement:
“On board ship there are many sources of joy of which the land knows nothing. You may flirt and dance at sixty; and if you are awkward in the turn of a valse, you may put it down to the motion of the ship. You need wear no gloves, and may drink your soda-and-brandy without being ashamed of it.”
—Anthony Trollope (1815–1882)
“Even healthy families need outside sources of moral guidance to keep those tensions from imploding—and this means, among other things, a public philosophy of gender equality and concern for child welfare. When instead the larger culture aggrandizes wife beaters, degrades women or nods approvingly at child slappers, the family gets a little more dangerous for everyone, and so, inevitably, does the larger world.”
—Barbara Ehrenreich (20th century)
“For as the interposition of a rivulet, however small, will occasion the line of the phalanx to fluctuate, so any trifling disagreement will be the cause of seditions; but they will not so soon flow from anything else as from the disagreement between virtue and vice, and next to that between poverty and riches.”
—Aristotle (384–322 B.C.)