How does AI Enhanced Feedback work?
Our AI Enhanced Feedback service is available for subscribers to all national tasks. It is turned off by default, so you need to turn it on if you wish to use it.
If you set up with task with AI Feedback Assistance then the judging interface will feature two recording buttons.
While your judges are judging, they can click on the buttons to record snippets of feedback for the pupils. The numbers on the buttons show how many comments have already been made on a script.
Recording can only be done when the teachers are judging their own pupils, not for moderation decisions, so the feedback comes from your teachers only.
We use two AI services to process the feedback. We use OpenAI to transcribe the audio, and we use Anthropic to summarise the feedback at different levels. At the pupil level we use the following prompt:
I’d like you to summarise some comments made on a piece of writing. I would like the feedback in a certain format - one sentence saying something good, one sentence with a suggestion for improvement, and a final sentence saying something nice and generic. If the comments mention specific aspects of the writing, make sure to include them.
Whenever you refresh your results we send the snippets to the AI service to summarise them.
Judging
If you set up with task with AI Feedback Assistance then the judging interface will feature two recording buttons.
While your judges are judging, they can click on the buttons to record snippets of feedback for the pupils. The numbers on the buttons show how many comments have already been made on a script.Recording can only be done when the teachers are judging their own pupils, not for moderation decisions, so the feedback comes from your teachers only.
Summarisation
We use two AI services to process the feedback. We use OpenAI to transcribe the audio, and we use Anthropic to summarise the feedback at different levels. At the pupil level we use the following prompt:
I’d like you to summarise some comments made on a piece of writing. I would like the feedback in a certain format - one sentence saying something good, one sentence with a suggestion for improvement, and a final sentence saying something nice and generic. If the comments mention specific aspects of the writing, make sure to include them.
Whenever you refresh your results we send the snippets to the AI service to summarise them.
Updated on: 04/12/2024
Thank you!