Principled Test Design
The AHM uses a construct-centered approach to test development and analysis. Construct-centered emphasizes the central role of the construct in directing test development activities and analysis. The advantage of this approach is that the inferences made about student performance are firmly grounded in the construct specified. Principled test design encompasses 3 broad stages:
- cognitive model development
- test development
- psychometric analysis.
Cognitive model development comprises the first stage in the test design process. During this stage, the cognitive knowledge, processes, and skills are identified and organized into an attribute hierarchy or cognitive model. This stage also encompasses validation of the cognitive model prior to the test development stage.
Test development comprises the second stage in the test design process. During this stage, items are created to measure each attribute within the cognitive model while also maintaining any dependencies modeled among the attributes.
Psychometric analysis comprises the third stage in the test design process. During this stage, the fit of the cognitive model relative to observed examinee responses is evaluated to ascertain the appropriateness of the model to explain test performance. Examinee test item responses are then analyzed and diagnostic skill profiles created highlighting examinee cognitive strengths and weaknesses.
Read more about this topic: Attribute Hierarchy Method
Famous quotes containing the words test and/or design:
“The test of an adventure is that when you’re in the middle of it, you say to yourself, “Oh, now I’ve got myself into an awful mess; I wish I were sitting quietly at home.” And the sign that something’s wrong with you is when you sit quietly at home wishing you were out having lots of adventure.”
—Thornton Wilder (1897–1975)
“The reason American cars don’t sell anymore is that they have forgotten how to design the American Dream. What does it matter if you buy a car today or six months from now, because cars are not beautiful. That’s why the American auto industry is in trouble: no design, no desire.”
—Karl Lagerfeld (b. 1938)