Open the test in the builder. On the ‘Settings’ tab, find ‘Open-ended answer review’. If an administrator will mark the answers manually, you can leave the settings as they are. If AI will mark the answers, set the marking criteria.
The ‘Open-ended answer review’ settings appear only when the test includes at least one ‘Free answer’, ‘Audio answer’, ‘Video answer’ or ‘Upload file’ question. Otherwise, this section stays hidden.
Which questions need marking?
Questions need marking when learners write an answer in their own words, record audio or video, or upload a file. A reviewer or AI marks each of these answers.
Once a learner completes a test with one of these questions, an administrator can see the report in the Review centre. To find the right attempt and publish the mark, see ‘How do I use the Review centre to mark tests?’. The learner first sees ‘Under review’. Their final mark appears once the answers have been marked and the result published. In ‘Automatic AI’ mode, this usually takes a few minutes. With either of the other methods, the learner gets their mark once a reviewer has checked the answers and published the result.
Which grading method should I choose?
Use ‘Grading method’ to choose who marks the answers and whether someone needs to check the marks before the learner sees them.
| Method | How the learner gets their result |
|---|---|
| ‘Manual review’ | An administrator or an assigned department manager reads, watches or listens to each open-ended answer and awards a mark. Once they have marked all the answers, they publish the result for the learner. |
| ‘AI with confirmation’ | AI suggests marks and comments based on your criteria. A reviewer can accept or edit the suggestions, then publish the result. The learner sees the marks only after publication. |
| ‘Automatic AI’ | AI marks the answers against your criteria. When all the marks are ready, the system publishes the result automatically. If AI cannot finish marking, the report appears under ‘Needs attention’. |
If a department manager will mark the answers, give them access to review this test. They can then review answers from their direct reports.
How do I set up AI marking?
-
Open the ‘Questions’ tab. For each question that AI will mark, set the points and describe the criteria. You can write them yourself or generate a draft from an example and edit it. See ‘How do I set marking criteria and points for open-ended answers in a test?’ for both methods.
-
Select ‘Save’ on the ‘Questions’ tab so AI can use those criteria.
-
Go back to ‘Settings’ and select ‘AI with confirmation’ or ‘Automatic AI’.
Frequently asked questions
Why can’t I select AI marking?
AI marking is unavailable if any open-ended question is missing saved marking criteria. The learning management system lists the question numbers and tells you which fields to complete.
Open the listed questions on the ‘Questions’ tab, enter the missing criteria and select ‘Save’. Then return to the test settings and choose the AI marking method you want.
What happens if the test draws questions at random?
It depends on the questions the learner receives. For example, if their attempt includes a ‘Video answer’ question, their test results report goes to the Review centre when they finish. If they only receive questions that ask them to select the correct answer, their report won’t appear there.