Judges

Overview

The Judges section of the CMS is where you can manage judges, judge assignments, judge evaluations, settings, and view your judge evaluations live dashboard.

There are five sub-tabs of the Judges management interface:

• Management: Manage judges, download access keys, and activate/deactivate judge user accounts.
• Assignments: View and assign judges to events, rounds, and scoring categories.
• Evaluations: View and manage all evaluations for student entries, view the judge's evaluation status, post scores to CMS, release back to judges, and more.
• Settings: Configure judge settings, such as judge scoring methods, judge scoring categories, and judge scoring weights.
• Dashboard: View the status of all evaluations and judges. Perfect for a tabulation center to keep track of your competition floor.
• Refresh: Refresh the page to see the latest updates.
• Event Code: The Event Code is the unique code that judges will use, conbined with their access key, to log in and evaluate student entries.

Judge Management

You can manage judges by clicking the Management button at the top. You will be presented with a list of all judges for your conference.

Add a Judge

To add a judge, click the Add Judge button at the top. Enter the required information and click Create to add the judge.

When judges are created, they are assigned a unique access key. Judges will use this access key, combined with the Event Code, to log in to the Evaluations Portal at https://evaluations.ctsocentral.com.

Edit a Judge

To edit a judge, click the icon next to the judge's name. You can then edit their information and click Save to update.

If a judge lost their access key, or if you need to reset their access key for any reason, click the icon next to the judge's name. This will generate a new access key and update it for you.

You can also deactivate a judge by clicking the icon next to the judge's name. This will deactivate the judge's account and they will no longer be able to log in to the Evaluations Portal.

Delete a Judge

If you need to delete a judge, click the icon next to the judge's name. You will be asked to confirm the deletion.

Judge Assignments

Before a judge can evaluate student entries, they must be assigned to particular events. You can assign judges to events and specify which scoring categories and which sections they will be evaluating.

To assign a judge, first select the competitive event from the dropdown you wish to assign them to. Then, select the round from the different tabs.

Assign a Judge

To assign a judge, click the dropdown underneath "Add Judge". You can either select a judge from the dropdown or begin typing their name to search for them. Once you've found the judge you wish to assign, click the Assign button.

After you've assigned a judge, you'll now need to select the scoring categories and section(s) they will be evaluating. You can select both from the dropdowns underneath "categories" and "section".

You can go back to this step at any time if you need to re-assign a judge.

Unassign a Judge

To unassign a judge, simply remove all of their category and section assignments. This will remove them from the event and you can assign another judge in their place.

Enabling/Disabling a Judge

To enable or disable a judge, click the or icon next to the judge's name. This will enable or disable the judge's account and they will no longer be able to evaluate their assignments.

Deleting a Judge Assignment

If you need to delete a judge assignment, simply click the icon next to the judge's name. This will remove them from the assignment, but the judge will still remain in the system if you need to re-assign them later.

Judge Evaluations

Once you've assigned a judge to an event, evaluations will be available for them to work on. You can interact with the evaluations by clicking the Evaluations button at the top.

At the top, you'll be able to filter the evaluations by event, round, category, section, status, judge, and chapter. You can also control how the rows are grouped & sorted by clicking on the Group by button.

You can also search for a specific evaluation by typing the participant name, chapter, or event into the Search bar.

Each row in the evaluations table represents a single evaluation (for example, John Smith & Jane Doe competing in the Business Management event, Written Report category, Section 1, Judge A).

Six buttons at the top of the evaluations table allow you to do various things with the evaluations:

• Submit: Finalizes and submits evaluations in a judge's control to the tabulation team for review.
• Approve All: If you've configured approvals to be required before evaluations can be posted to CMS, "Approve All" will allow you to approve all outstanding evaluations (or those that you've selected with the checkboxes).
• Post to CMS: If you have not configured evaluations to auto-post to CMS once submitted/approved, you can manually post all outstanding evaluations to the CMS (or those that you've selected with the checkboxes).
• Unpost: This will unpost all evaluations (or those that you've selected with the checkboxes) from the CMS. Helpful if you need to re-evaluate a student's entries or you accidentally sent scores to CMS before they were ready to be finalized by the tabulation team.
• Release to Judge: If evaluations have been finalized by a judge, but you need to allow them to log back in to revise an evaluation, you can release evaluations back into their control for edits.

  Evaluations can't be released to a judge if they've been posted to CMS. You will need to first unpost, then release to the judge.

• Regenerate Missing: If you have deleted an evaluation or are missing any for students, you can have the system double-check for missing evaluations and regenerate them for you. Helpful if you've made changes to event entries while your conference is in progress.

Viewing & Taking Action on an Evaluation

You can see an individual evaluation's scores, status, and detailed rubric information by clicking the button next to the evaluation's name. Clicking the row will also open a popup with this information.

Judge Settings

The Judge Settings tab is where you can control the settings for submissions, what informatiuon to display to judges, whether judges can mark students as no-shows/disqualified, and more. To access the Judge Settings, click the Settings button at the top.

You can select an event from the dropdown or type the event name (or acronym) into the search bar. Once you've selected an event, you'll be able to configure the settings for that event.

As you make changes to the settings, you can click the Save Settings button to save your changes.

Submission Mode: By default, once a judge submits an evaulation, it requires approval from a user with access to the Judge Evaluations module before it can be posted to CMS. If you prefer, you can configure the system to auto-post evaluations to CMS once a judge submits them.

Display Information: You can control what information is displayed to judges when they view their evaluations. By default, judges can see student names, chapter names, participant IDs, and any attachments, but each of these can be hidden or shown by clicking the checkbox next to the item.

Entry Status Option: By default, judges can mark students as no-shows/disqualified, but this can be disabled by clicking each checkbox next to "Entry Status Option".

Judge Dashboard

The Dashboard is a perfect tool for your tabulation center to keep track of the status of your competition floor. The Dashboard updates in real-time as judges complete evaluations, submit them, and as scores are posted to your CMS. You can access the Dashboard by clicking the Dashboard button at the top.

The dashboard will show you the following information:

• Total Entries: The total number of entries for all competitive events at your conference.
• Not Started: The number of entries that have not yet been evaluated by a judge.
• In Progress: The number of entries that are currently being evaluated by a judge.
• Submitted: The number of entries that have been evaluated by a judge and are awaiting approval from the tabulation team. (if approval is configured)
• Completion: The percentage of entries that have been evaluated by a judge, approved (if configured for events), and posted to CMS.

The dashboard shows a progress breakdown by judge and by event with further drill-downs available.