Q: Getting started with No More Marking for the very first time

Welcome to No More Marking! No More Marking allows you to use Comparative Judgement to improve your assessment of open-ended assessments. You may be assessing essays on a scale of quality, photographs on a scale of beauty, examinations on a scale of difficulty, or endless other examples. Traditional methods involve developing rubrics and then scoring each artefact against the rubric. However this is time-consuming, resource-intensive and often we capture the letter of what we want to capture at the cost of killing the spirit. No More Marking can help. Instead of rubrics and scoring, expert judges make direct comparisons of artefacts, resulting in a reliable and unidimensional scale. To understand how it works, we recommend starting with this video which explains the concepts of Comparative Judgement. ${vimeo}<a href="982483080">Getting started with No More Marking</a> You may wish to start with a free account that allows you to use Comparative Judgement within your own workplace for your own projects, or if you are a school you may wish to consider a subscription to give you access to standardised assessments.

Q: AI Feedback FAQs

Who can use the AI Feedback? At the moment only schools who have registered an interest can participate, and only for APW Year 5. Following the trial we may make the feedback more widely accessible. Which AI platform will be used? We use two AI platforms. To transcribe the audio we are using OpenAI. To summarise the teachers' comments we use Anthropic. What data will be sent and stored? The audio recordings will be sent to OpenAI for transcription. The transcriptions of the recordings will be sent to Anthropic. No other data will be shared with OpenAI or Anthropic. If teachers are not comfortable they may simply choose not to record any comments. How much time will this add? We think if you keep comments short and to the point this won't add much time. We will use our initial trials to try to model how much time it does add. How many teachers can use it? Does it need to be every teacher? All teachers within a school that have opted in can use the recording feature. Comments are, however, entirely optional for teachers within schools that have opted in. Is it still possible for staff to judge without leaving comments Yes. Comments are entirely optional for teachers within schools that have opted in. <hr /> I'm interested in the time efficiency element - if and how it will save time. We hope that the short audio clips will be an efficient way of combining feedback from different teachers. <hr /> **Are all teachers comments including those from other

Question 1

Getting started with No More Marking for the very first time

Accepted Answer

Welcome to No More Marking!

No More Marking allows you to use Comparative Judgement to improve your assessment of open-ended assessments. You may be assessing essays on a scale of quality, photographs on a scale of beauty, examinations on a scale of difficulty, or endless other examples. Traditional methods involve developing rubrics and then scoring each artefact against the rubric. However this is time-consuming, resource-intensive and often we capture the letter of what we want to capture at the cost of killing the spirit. No More Marking can help. Instead of rubrics and scoring, expert judges make direct comparisons of artefacts, resulting in a reliable and unidimensional scale.

To understand how it works, we recommend starting with this video which explains the concepts of Comparative Judgement.

${vimeo}Getting started with No More Marking

You may wish to start with a free account that allows you to use Comparative Judgement within your own workplace for your own projects, or if you are a school you may wish to consider a subscription to give you access to standardised assessments.

Question 2

What is our AI Enhanced Feedback?

Accepted Answer

One of the biggest questions we get about Comparative Judgement is: can it provide feedback?

We've developed an AI-enabled tool that allows you to record a few comments about a piece of writing while you are judging. The AI will transcribe your spoken comments and combine them with the comments of other teachers to produce a paragraph of written feedback.

We think the process will be efficient and the results will represent an accurate summary of what your teachers value in their pupils' writing.

To use the tool, teachers will need to be able to judge in a silent environment on computers that have a built in microphone. Here is a video of Daisy demonstrating the process.

${vimeo}AI Enhanced Feedback

Question 3

AI Feedback FAQs

Accepted Answer

Who can use the AI Feedback? At the moment only schools who have registered an interest can participate, and only for APW Year 5. Following the trial we may make the feedback more widely accessible.

Which AI platform will be used? We use two AI platforms. To transcribe the audio we are using OpenAI. To summarise the teachers' comments we use Anthropic.

What data will be sent and stored? The audio recordings will be sent to OpenAI for transcription. The transcriptions of the recordings will be sent to Anthropic. No other data will be shared with OpenAI or Anthropic. If teachers are not comfortable they may simply choose not to record any comments.

How much time will this add? We think if you keep comments short and to the point this won't add much time. We will use our initial trials to try to model how much time it does add.

How many teachers can use it? Does it need to be every teacher? All teachers within a school that have opted in can use the recording feature. Comments are, however, entirely optional for teachers within schools that have opted in.

Is it still possible for staff to judge without leaving comments Yes. Comments are entirely optional for teachers within schools that have opted in.

I'm interested in the time efficiency element - if and how it will save time. We hope that the short audio clips will be an efficient way of combining feedback from different teachers.

**Are all teachers comments including those from other

Question 4

How do I invite judges to my NMM task?

Accepted Answer

Once your task is checked and ready for judging, you may invite judges to your NMM task. Here's how:

Log in to your NMM account
Open the relevant task
Click a. Run judging session. to access the Judges page as shown on the screenshot below:

Type the number of your expected judges for the task and click the Adjust button as shown on the screenshot below:

||| Please note that you should not edit the Expected Candidates and Candidate Judgments section because this is pre- set and changing the numbers could cause major issues to your task.

Click the Copy Link button as shown on the screenshot below:

Paste the link to an email or message board, give instructions to click the link to register as a judge, and send it to the persons you wish to participate in the judging session.

Question 5

How do I create a candidate file?

Accepted Answer

These are the instructions on how to create a candidate file for importing pupil details to your NMM task.

Log in to your school's NMM paid subscription account.
Open the relevant task by clicking the task name.
On the Candidates page, click the a. Populate, generate, download & print coded sheets tab referred to as Step 1 on the screenshot below:
Next, click the Candidate Upload tab referred to as Step 2 on the screenshot below:
Then, click the Download Candidates Template referred to as Step 3 on the screenshot below:

Once you have the template, delete the sample data and replace it with your own.

**These are all required fields and could not be left empty: **

Candidate: A candidate number (eg. A1234567). If you don't use candidate numbers you can ignore this field. PP: (UK only) Pupil Premium Status eg. Y / N. FirstName: First name eg. Chris LastName: Last name eg. Harding DOB: Date of birth eg. 31/01/2000 Gender: M / F. We do not present this data to the student, but we do provide a breakdown for national tasks. Year_Group: eg. 7 for Year 7 Group: The teaching, class or registration group. Results will be grouped by this field for national tasks.

||| IMPORTANT NOTICE ||| 1.) Please do not change any of the column titles or move the columns and follow the data formattin

Question 6

How do I generate and then download test sheets?

Accepted Answer

To generate and download your task' s coded test sheets, please do the following:

| You need to import a candidate file to your task before proceeding.

Go to the No More Marking website.
Log in to your school's NMM account.
On the My Tasks page, open the relevant task by clicking the task name.
On the Candidates page, choose one of 3 options to download the coded test sheets as shown on the screenshot below:

 A. To download the coded test sheets for all the candidates of the task,  **click** the **All** button  *or*
 B. To download individual coded test sheets, click the square boxes before the candidate's code then **click** the **Selected** button *or*
 C. To download test sheets per class/ group, **click** the  **Groups** button.

| Please print the coded test sheets in A4 size paper, single- side only.

||| The template cannot be changed for national tasks.

The option to modify the test sheet template is only available to custom tasks ( via Settings --> Script Generation )

Featured & Frequently Read Articles

Browse All Categories