OSCAR - QC Setup: Adding a Calibration Set

Back to QC Overview 

Often in conjunction with validity papers, calibration sets are created and delivered to individual scorers when validity thresholds are missed or to deliver to an entire scoring team when drift begins to occur.

When setting up a calibration set users have the ability to deliver the calibration as “Blind” and determine if the specific set should be auto delivered or not.

Calibration sets can be ‘auto-delivered’ which means it’s used as a part of validity corrective action; automatically sent once a scorer reaches a predetermined threshold. If auto-deliver is turned off, the administrator can manually deliver the calibration set to an individual or scoring team.

Rule

There are four settings available in the Calibration set:

1. Exact Agreement, By Response - each response must have the exact same score as the true score
2. Exact Agreement, By Trait - each trait must have the exact same score as the true score
3. Exact/Adjacent, By Response - each response score must be within 1 point of the true score
4. Exact/Adjacent, By Trait - each trait score must be within 1 point of the true score

Overall Set

Pass Percent can be set when Exact Agreement, By Response and Exact/Adjacent, By Response rules are selected.

Percentage of Scores Overall and Minimum for each Trait can be set when Exact Agreement, By Trait and Exact/Adjacent, By Trait rules are selected.

Additional Settings

• Auto-Deliver - When turned on, automatically sent once a scorer reaches a predetermined. If auto-deliver is turned off, the administrator can manually deliver the calibration set. 
• Blind - Scorers will not be notified when they start or pass the set.
• Reviewable - Review immediately after completing the set
• Active - Toggle on/off to make the set available.