Signing up judges
Choosing the number of judgements for each judge
The more judgements that are made by judges, the more reliable (precise) your results will be.
As a general rule, we would suggest carrying out 10 judgements per candidate, spread across all of your judges.
For national tasks (as opposed to in-house tasks), you cannot change the Candidate Judgements value from 10, and you cannot change the Expected Candidates value. You can only change the Expected Judges value.
For example, if you have 60 candidates to judge, you would need around 600 judgements.
You would divide this number by the number of judges you have, to find the required number judgements per judge. So if you have 12 judges, this would mean 600/12 = 50 judgements per judge. Or if you have 10 judges, this would mean 600/10 = 60 judgements per judge, and so on.
To save you time, our system works out most of this information for you, based on the number of candidates with scripts uploaded into the task.
Setting the judge quota
In your task, select the Run judging session option.
Enter the expected number of judges:
When you are happy with the information, press the 'Adjust' button - this will calculate the default number of judgements each judge will need to carry out.
A Copy link button will appear on screen for you to copy:
Click the ‘Copy link’ button, then paste the link into an email and send it to each of your judges.
This judging sign-up link is unique to your school and that particular task.
When they click on the link, your judges will be asked to register as a judge for that task:
After entering their email address and clicking Submit, judges can either get straight into judging, or at any point they can click on the unique judging link that will have been sent to them in an automated email message.
Please remember, this link that they will have been emailed is unique to the individual judge and that particular task.
To start or resume judging the judge can click on their direct web link.
To stop judging at any point they can simply close their browser window.
Adjusting judging allocations
To change the default number of judgements per judge for the task before signing them up as judges, you can amend the information in the calculation boxes (e.g. the number of judgements per candidate, or your expected number of judges) and press the 'Adjust' button.
You can also adjust the quota for each existing judge individually, after they have signed up as a judge. To do this, select the judge(s) by clicking on their check-box(es), press the 'Update Quota' button and then amend the quota as appropriate:
Updated on: 04/09/2024
Thank you!