• What is AI-Enhanced Comparative Judgement (CJ)?

  AI-Enhanced CJ is a specific method for assessing student writing that combines the strengths of human judgment with the speed of Artificial Intelligence, using the established technique of Comparative Judgement. Here's how it works: Core Method - Comparative Judgement: Instead of assigning an absolute mark (like 7/10 or Grade B), judges (both human and AI) are shown two pieces of student writing side-by-side and simply decide which one is "better." This process is repeated many times. 2Few readers

• Human judging with AI transcriptions

  Some students' handwriting can be hard to read, which can lead to human teachers judging their work unfairly. We have a new AI feature that will help overcome this human bias. Human judges can now easily view a typed transcript of each students' response. The transcript is generated by AI. At the bottom left of each response are two new buttons, which look like this. Click on them to toggle beFew readers

• Setting Up AI Judging

  If you are taking part in a national task with AI judging, you need to Accept the AI GDPR and then you can request that some proportion of your decisions are completed by AI. Here is what you need to do. Click on your judging panel: (https://storage.crisp.chat/users/helpdesk/website/-/2/d/5/d/2d5d0b5095261a00/screenshot-2025-04-30-at-12464y9aj3t.png =400x92) You will now see a slider. By default, if you have acceptedFew readers

• Monitoring AI Agreement

  Whereas in the past we used a statistic called judge infit to monitor judging quality, when you only make a few judgements and the majority are made by AI, the infit statistic is no longer reliable. We propose instead that you use the AI agreement report to monitor judging quality. You can see the agreement per teacher on the judging dashboard: (https://storage.crisp.chat/users/helpdesk/website/-/2/d/5/d/2d5d0b5095261a00/screenshot-2025-06-09-at-155053y63nk.png =400x371) The column AI agreeFew readers

• AI-enhanced Custom Tasks

  AI-Enhanced Custom Tasks: Teacher Guide Welcome to the Custom Tasks feature! This new tool allows you to use AI-enhanced Comparative Judgement on any open-ended tasks. What are Custom Tasks? Custom Tasks allow teachers to create personalised prompts tailored to specific learning objectives. The system uses AI to assist in evaluating student responses while maintaining your assessment criteria. GDPR In order to use AI-EnhancedFew readers