Principled Test Design
The AHM uses a construct-centered approach to test development and analysis. Construct-centered emphasizes the central role of the construct in directing test development activities and analysis. The advantage of this approach is that the inferences made about student performance are firmly grounded in the construct specified. Principled test design encompasses 3 broad stages:
- cognitive model development
- test development
- psychometric analysis.
Cognitive model development comprises the first stage in the test design process. During this stage, the cognitive knowledge, processes, and skills are identified and organized into an attribute hierarchy or cognitive model. This stage also encompasses validation of the cognitive model prior to the test development stage.
Test development comprises the second stage in the test design process. During this stage, items are created to measure each attribute within the cognitive model while also maintaining any dependencies modeled among the attributes.
Psychometric analysis comprises the third stage in the test design process. During this stage, the fit of the cognitive model relative to observed examinee responses is evaluated to ascertain the appropriateness of the model to explain test performance. Examinee test item responses are then analyzed and diagnostic skill profiles created highlighting examinee cognitive strengths and weaknesses.
Read more about this topic: Attribute Hierarchy Method
Famous quotes containing the words test and/or design:
“I am willing, for a money consideration, to test this physical strength, this nervous force, and muscular power with which I’ve been gifted, to show that they will bear a certain strain. If I break down, if my brain gives way under want of sleep, my heart ceases to respond to the calls made on my circulatory system, or the surcharged veins of my extremities burst—if, in short, I fall helpless, or it may be, dead on the track, then I lose my money.”
—Ada Anderson (1860–?)
“I begin with a design for a hearse.
For Christ’s sake not black—
nor white either—and not polished!
Let it be weathered—like a farm wagon—”
—William Carlos Williams (1883–1963)