• How do I invite judges to my NMM task?

  Once your task is checked and ready for judging, you may invite judges to your NMM task. Here's how: Log in to your NMM account Open the relevant task Click a. Run judging session. to access the Judges page as shown on the screenshot below: Type the number of your expected judges for the task and click the Adjust button as shown on the screenshot below:Popular

• How to re- allocate judging items to other judges?

  Here's how to do it: Log in to your NMM account. Open the relevant task. Click a. Run judging session. to access the Judges page as shown on the screenshot below: Tick the tiny box before a judge'sFew readers

• Signing up judges

  Choosing the number of judgements for each judge The more judgements that are made by judges, the more reliable (precise) your results will be. As a general rule, we would suggest carrying out 10 judgements per candidate, spread across all of your judges. For examSome readers

• Local judgements and moderation judgements

  When you take part in tasks that are moderated across other tasks and schools, a judge will be making moderation judgements as well as judgements on their particular task as part of their allocation. For example, in our national assessments such as Assessing Primary Writing (APW) or Improving Secondary Writing (ISW), a judge will judge scripts from other schools as well as from their own school. In APW, every 5th judgement is a moderation judgement of scripts from other schools; for ISW it is eFew readers

• Exploring the decisions made by each judge

  Exploring the judgements made by a given judge Here is how to explore more deeply the judgements made by a particular judge To explore the judgements that were made by a particular judge more deeply, we can look at the decisions made by that judge, whose scripts they were comparing, and the probability that the decision was 'correct'. After the judging is completed, go to the Run judging session section and then highlight the judge you want to look at by clicking on the box next toFew readers

• Reporting a safeguarding issue

  To report an issue with a script you encounter while judging, please click the tab between the decisions button, Choose the better script button specify if it's the script on the left or right side, left or right and type a comment- Note: you can type freely for yourFew readers

• Judge Infit

  Judge infit The infit for a judge is a measure of how far a judge agrees with the other judges in how they make their decisions. High values may indicate disagreement, but care must be taken with infit as it is sensitive to the nature of what is being judged, how many judges are judging, and how many decisions each judge makes. Our empirical data suggests the following values. Primary school judging (short texts, lots of judges)Some readers