Shortcomings of Classical Test Theory
One of the most important or well known shortcomings of Classical Test Theory is that examinee characteristics and test characteristics cannot be separated: each can only be interpreted in the context of the other. Another shortcoming lies in the definition of Reliability that exists in Classical Test Theory, which states that reliability is "the correlation between test scores on parallel forms of a test". The problem with this is that there are differing opinions of what parallel tests are. Various reliability coefficients provide either lower bound estimates of reliability or reliability estimates with unknown biases. A third shortcoming involves the standard error of measurement. The problem here is that, according to Classical Test Theory, the standard error of measurement is assumed to be the same for all examinees. However, as Hambleton explains in his book, scores on any test are unequally precise measures for examinees of different ability, thus making the assumption of equal errors of measurement for all examinees implausible (Hambleton, Swaminathan, Rogers, 1991, p.4). A fourth, and final shortcoming of the Classical Test Theory is that it is test oriented, rather than item oriented. In other words, Classical Test Theory cannot help us make predictions of how well an individual or even a group of examinees might do on a test item.
Read more about this topic: Classical Test Theory
Famous quotes containing the words shortcomings of, shortcomings, classical, test and/or theory:
“No shortcomings of other people cause us to be more intolerant than those which are caricatures of our own.”
—Franz Grillparzer (1791–1872)
“One of the most highly valued functions of used parents these days is to be the villains of their children’s lives, the people the child blames for any shortcomings or disappointments. But if your identity comes from your parents’ failings, then you remain forever a member of the child generation, stuck and unable to move on to an adulthood in which you identify yourself in terms of what you do, not what has been done to you.”
—Frank Pittman (20th century)
“Culture is a sham if it is only a sort of Gothic front put on an iron building—like Tower Bridge—or a classical front put on a steel frame—like the Daily Telegraph building in Fleet Street. Culture, if it is to be a real thing and a holy thing, must be the product of what we actually do for a living—not something added, like sugar on a pill.”
—Eric Gill (1882–1940)
“It is commonly said, and more particularly by Lord Shaftesbury, that ridicule is the best test of truth; for that it will not stick where it is not just. I deny it. A truth learned in a certain light, and attacked in certain words, by men of wit and humour, may, and often doth, become ridiculous, at least so far, that the truth is only remembered and repeated for the sake of the ridicule.”
—Philip Dormer Stanhope, 4th Earl Chesterfield (1694–1773)
“The whole theory of modern education is radically unsound. Fortunately in England, at any rate, education produces no effect whatsoever. If it did, it would prove a serious danger to the upper classes, and probably lead to acts of violence in Grosvenor Square.”
—Oscar Wilde (1854–1900)