Fair, unbiased, and accurate scoring
All raters are required to:
- participate in a rigorous training program that includes demonstration of understanding of the standards, task directions, rubrics, and more
- demonstrate mastery of the scoring process through multiple practice sessions conducted by experts who are trained in qualifying raters
- take and pass a certification test verifying their mastery of accurate scoring processes every time they score
All identifying information provided by you at registration is removed from responses to prevent raters from knowing your identity. When scoring resubmitted tasks, raters don’t have access to any prior scores.
Scoring follows a conditional double scoring model in that each task will be single scored, but if a total task score is within a defined proximity of reaching the overall passing requirement, at least one additional rater will independently score the task.
Scoring leaders are assigned to supervise all scoring activity. As part of this work, scoring leaders also conduct random back readings of tasks that were scored. If an error in scoring is detected, the error will be corrected.