Sources of Inter-rater Disagreement
Different raters can disagree about measurement results from the same object by e.g. variations in the procedures of carrying out the experiment, interpreting the results and, subsequently, presenting them. All these stages may be affected by experimenter's bias, that is, a tendency to deviate towards what is expected by the rater. When interpreting and presenting the results, there may be inter-rater variations in digit preference, that is, preferences differ whether to round off a value to a lower one or a higher one.
Read more about this topic: Inter-rater Reliability
Famous quotes containing the words sources of, sources and/or disagreement:
“The American grips himself, at the very sources of his consciousness, in a grip of care: and then, to so much of the rest of life, is indifferent. Whereas, the European hasn’t got so much care in him, so he cares much more for life and living.”
—D.H. (David Herbert)
“The sources of poetry are in the spirit seeking completeness.”
—Muriel Rukeyser (1913–1980)
“For as the interposition of a rivulet, however small, will occasion the line of the phalanx to fluctuate, so any trifling disagreement will be the cause of seditions; but they will not so soon flow from anything else as from the disagreement between virtue and vice, and next to that between poverty and riches.”
—Aristotle (384–322 B.C.)