OSCAR - QC Setup: Adding a Validity Set

Back to QC Overview 

During operational scoring, scoring supervisors configure validity papers into a scorers’ workflow. Validity papers are papers for which the “true score” is already known. The paper is embedded into the workflow of each scorer and the scorer is expected to get the score “correct.” Validity papers are identified and annotated by expert staff as a part of the rangefinding process and are used throughout operational scoring.

Rule

This value is configured in Item settings and displayed here.  The options set up in Item settings are:

1. Exact Agreement, By Response - each response must have the exact same score as the true score
2. Exact Agreement, By Trait - each trait must have the exacts same score as the true score
3. Exact/Adjacent, By Response - each response score must be within 1 point of the true score
4. Exact/Adjacent, By Trait - each trait score must be within 1 point of the true score

Feedback Options

• Show Negative Feedback
• Show Positive Feedback 
• Active - toggles on or off the validity set