Understanding the COMPLETION REPORT
Overview – This report is designed to show a real status of every response loaded into the system. A scoring supervisor or admin can quickly see the state of the responses and how close an item/project is to completion. Found within Quality Management | Reporting | Completion.
The Completion Report allows scoring supervisors to monitor the status of every response loaded into the scoring platform. A scoring supervisor or administrator can monitor the state of the responses and determine how close an item/project is to completion. The Completion Report also presents a view of the number of responses requiring resolution reads as well as the number of back read scores that have been applied. This report allows the administrator and supervisor to know at what point to move scorers from one item to another as scoring is completed, and it ensures that back reads are not overlooked. If scoring a field test or research items, the report can be used to show a summary of responses that have been flagged because of difficulties in scoring
| Completion Report Table | |
| Keyword | Definition |
| Total | The total number of responses per item |
| Unscored | The number of responses that have not received a score |
| Withheld | The number of responses that have been flagged as non-scorable or have been flagged due to a scorer’s question regarding the scoring of that response. Responses remain in the withheld stage until they are released to the pool by a scoring supervisor. If a response is released to the pool, the flag information is retained with the response unless the flag is deleted by a supervisor. |
| Reliability | The number of responses awaiting a second score |
| Resolution | The number of responses awaiting a third read by a scoring supervisor as required by a project’s resolution scoring rules |
| Flagged | The number of responses that have a flag associated with it (reviewed or not). A flag will remain with the response through all states unless deleted by a supervisor. As an example a response can be complete but still have a flag associated with it. |
| Reviewed | The number of responses with flags that have the flag reviewed. If you see 50 in the flagged column and only 30 in the reviewed column that means there are 20 responses with flags that have not had the flag reviewed. |
| Complete | The number of scorable responses that have completed the scoring process and have received either one or two scores depending on the requirements of the project |
| Backread | The number of responses that have received a backread score by a scoring supervisor |
| Res. Required | The total number of responses that had a third read applied as required by a project’s resolution scoring rules |
| Rescore | The number of responses flagged for rescore |
Comments
0 comments
Please sign in to leave a comment.