Metadata is information that may be stored in a response when it is loaded from an external API.
Tenant Setup: If you know that responses will be loaded with certain metadata values, you can add a metadata key for each type of metadata value during tenant setup.
The screenshot below is an example were three metadata keys are added to the tenant. The metadata values can be displayed during scoring and in the Auditing page if the Show When Blank or Admin Only role permissions are selected.
Item Setup: Reliability controls what percent of the responses will require a second read.
Selecting and configuring the Metadata Reliability property will result in responses with certain metadata values marked for reliability. Responses are marked for reliability when they are loaded into OSCAR and will be randomly selected for reliability based on the Metadata key chosen. Each Metadata Key will always come with a value. For example, a metadata value of the key "CourseID" might be "101." When selecting responses for reliability, OSCAR will apply the reliability percentage to each unique value. For example, if the reliability percentage is set to 20%, 20% of the responses that have a CourseID value of "101" would be selected for reliability, and 20% of the responses that have a value of "102" would be selected for reliability, and so on... Note, responses that do not contain the specified metadata key will be ignored for reliability when using this setting.
Comments
0 comments
Please sign in to leave a comment.