A tutorial method for teaching the scoring of open-ended questions holistically
includes displaying a student response to a scorer and permitting the scorer to
access a rubric containing the rules for scoring that response. The scorer can
choose a display form from a handwritten form and a typed text form that retains
and originally present errors. Following the scorer's having entered a score, a
model score is displayed so that a scoring efficacy may be determined. Annotations
prepared by expert scorers may be accessed to enhance the learning process. In
addition, a running correlation between the model and entered scores is calculated
and displayed for the scorer over a tutorial session that includes attempts at
scoring different responses. The system includes a processor, a workstation, and
software for performing the above-described method.