How do I invite judges to my NMM task?
Once your task is checked and ready for judging, you may invite judges to your NMM task. Here's how:
Log in to your NMM account
Open the relevant task
Click a. Run judging session. to access the Judges page as shown on the screenshot below:
Type the number of your expected judges for the task and click the Adjust button as shown on the screenshot below:Few readersSigning up judges
Choosing the number of judgements for each judge
The more judgements that are made by judges, the more reliable (precise) your results will be.
As a general rule, we would suggest carrying out 10 judgements per candidate, spread across all of your judges.
For examFew readersLocal judgements and moderation judgements
When you take part in tasks that are moderated across other tasks and schools, a judge will be making moderation judgements as well as judgements on their particular task as part of their allocation.
For example, in our national assessments such as Assessing Primary Writing (APW) or Improving Secondary Writing (ISW), a judge will judge scripts from other schools as well as from their own school. In APW, every 5th judgement is a moderation judgement of scripts from other schools; for ISW it is eFew readersExploring the decisions made by each judge
Exploring the judgements made by a given judge
Here is how to explore more deeply the judgements made by a particular judge
To explore the judgements that were made by a particular judge more deeply, we can look at the decisions made by that judge, whose scripts they were comparing, and the probability that the decision was 'correct'.
After the judging is completed, go to the Run judging session section and then highlight the judge you want to look at by clicking on the box next toFew readersReporting a safeguarding issue
To report an issue with a script you encounter while judging, please click the tab between the decisions button,
Choose the better script button
specify if it's the script on the left or right side,
left or right
and type a comment- Note: you can type freely for yourFew readers