Test Builder

17 articles Support By Support

Question Types in the Smart Way LMS Test Builder

In the Smart Way LMS Test Builder, the question type defines how an employee answers, how the system checks the answer and whether the result is calculated automatically or manually. For reliable staff testing, choose the question type so it matches the purpose of the check. If you need automatic result calculation, use these question types: Multiple correct answers, One correct answer, True / false, Fill-in, Numeric answer, Matching, Sequencing or Hotspot. If you need to collect an explanation, a video answer, an audio answer, a case file, a document or a self-assessment without an automatic mark, use Free answer, Video answer, Audio answer, Upload file or Likert scale. In this guide, "type" means the type of an individual question in a test, not the type of the whole test. A test can contain questions of different types. Where do I choose the question type? 1. Go to Test Builder. 2. Open the test you need or create a new one. 3. Add a question with the Add question button. 4. In the question card, click Change question type. 5. Choose the required type from the menu. 6. Fill in the question text, answers or special settings. 7. Click Save. If users have already taken the test, the LMS platform blocks structural changes: questions or answers cannot be added or deleted. This prevents existing results and reports from being disrupted. In that test, you can still correct text or images, but to change the structure you need to create a new test: you can copy the current one and make the required changes. Quick Type Table | Menu type | What it is useful for | How it is marked | | -------------------------- | ------------------------------------------------------------------------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------ | | Multiple correct answers | A question with several correct options. | Automatically; a partial mark is possible if the user selected some of the correct answers and did not select any incorrect answers. | | One correct answer | A classic question with one correct option. | Automatically. | | Free answer | An open text answer without a file. | Not marked by the system. Administrators need to assess this answer manually. | | Video answer | An answer as a video recording. | Not marked by the system. Administrators need to assess this answer manually. | | Audio answer | An answer as an audio recording. | Not marked by the system. Administrators need to assess this answer manually. | | Upload file | A one-file answer: a document, spreadsheet, presentation, PDF, media file or another supported format. | Not marked by the system. Administrators need to assess this answer manually. | | True / false | A quick check of a statement: true or false. | Automatically, with exactly one correct option. | | Fill-in | A short text answer: a term, word, phrase, code or name. | Automatically, against a list of accepted answers. | | Matching | Matching left-hand and right-hand items. | Automatically, on an all-or-nothing basis. | | Sequencing | Placing steps or items in the correct order. | Automatically, on an all-or-nothing basis. | | Likert scale | A survey, self-assessment, level of agreement or satisfaction. | Not marked by the system. Administrators need to assess this answer manually. | | Numeric answer | A number, calculation, quantity or value within a range. | Automatically. | | Hotspot | Selecting one or several areas on an image. | Automatically, based on the exact set of correct areas. | Which question types affect the testing result calculation? The test result calculation includes questions that the LMS platform can check automatically: - Multiple correct answers; - One correct answer; - True / false; - Fill-in; - Numeric answer; - Matching; - Sequencing; - Hotspot. Free answer, Video answer, Audio answer, Upload file and Likert scale are not included in the automatic result calculation and need to be assessed manually. If a test contains only these unmarked question types, reports may show the result as -, because the system cannot calculate a result for these question types automatically. General Rules for All Questions Questions can contain text and an image. For some answer options, you can also add an image to a specific answer. Images in a question, answer or sequence item have a 4.99 MB limit. If an image is larger, the system will not upload it and will show an error. For questions with answer options, each option should be either text or an image. After changing the question type, check the settings again. For example, if you changed a question with multiple correct answers into a question with one correct answer, you need to select the correct option again. Free answer is a text-only type without file attachment. If you need a video answer, audio answer or file, choose the separate type: Video answer, Audio answer or Upload file. For file, video or audio answers, the limit is 500 MB. During file upload, the system pauses the test timer for the upload period. How do I choose the right type? | Scenario | Best choice | | ------------------------------------------------------------------------------------ | -------------------------- | | There is exactly one correct option. | One correct answer | | There are several correct options. | Multiple correct answers | | You need to check a statement quickly. | True / false | | The user needs to insert the right word, code, term or short phrase into a sentence. | Fill-in | | The answer must be a number or range. | Numeric answer | | You need to check the relationship between concepts. | Matching | | The order of steps matters. | Sequencing | | The answer is tied to an image. | Hotspot | | You need an opinion, a level of agreement or a self-assessment. | Likert scale | | You need a text explanation or manual review without a file. | Free answer | | You need a camera recording. | Video answer | | You need a voice answer. | Audio answer | | You need a case file, document, spreadsheet, presentation or another file. | Upload file | Common Mistakes When Choosing a Type - Do not use Free answer, Video answer, Audio answer, Upload file or Likert scale if you need the testing result to be calculated automatically. - Do not use Fill-in for long answers: the system checks text against a list of accepted spellings. Menu of Guides for Each Question Type For convenience, each specific question type is described in a separate guide. To go to the guide you need, click the relevant menu item. - Multiple correct answers - One correct answer - Free answer - Video answer - Audio answer - Upload file - True / false - Fill-in - Matching - Sequencing - Likert scale - Numeric answer - Hotspot

Question Types in the Test Builder: Multiple Correct Answers

The Multiple correct answers type is used when more than one answer can be correct. When taking the test, the user sees a list of checkboxes and can select several options. This format is useful when you need staff assessment against several criteria at the same time. In courses for employee training, it helps check whether the user remembers not just one fact, but the full set of required actions. When Should You Use the Multiple correct answers Question Type? Choose this type if the question has several correct answers. Examples: - "Select all signs of a phishing email"; - "Which actions should be completed before starting the equipment?". If the question has only one correct option, it is better to use the One correct answer question type. How Do You Set It Up? 1. Choose the Multiple correct answers question type. 2. Add the answer options. 3. Tick all correct options. 4. Add an image to the question or to individual answers if needed. 5. Click Save. How Is It Marked? The question is marked automatically. If the user selects incorrect options, the question receives 0. If the user selects some of the correct options and does not select any incorrect options, the result may be a partial mark, for example 0.75. What Should You Check Before Publishing? - all correct options are ticked; - incorrect options have not been ticked by mistake; - the answer text is clear and is not duplicated unnecessarily; - the question genuinely requires several correct answers.

Question Types in the Test Builder: One Correct Answer

The One correct answer type is used for classic test questions where the user needs to choose one correct option. This format works well for employee testing when you need to quickly check knowledge of a specific rule, term or procedure. When Should You Use It? Choose this type if the question has only one correct answer. Examples: - "Which document confirms that the briefing has been completed?"; - "What is the retention period for this record?"; - "Which action comes first in the procedure?". How Do You Set It Up? 1. Choose the One correct answer type. 2. Add the answer options. 3. Mark one correct option with the radio button. 4. Add an image to the question or answer if needed. 5. Click Save. How Is It Marked? The question is marked automatically and is included in the test percentage result. The system allows only one correct option to be marked. When taking the test, the user can also choose only one answer. What Should You Check Before Publishing the Test? - exactly one correct option is marked; - the question wording does not allow several correct answers; - the options do not make the answer too obvious.

Question Types in the Test Builder: Fill-in

The Fill-in question type is suitable for a short text answer. The user enters the missing text in their answer, and Smart Way LMS compares it with the list of accepted answers. If you need to run cognitive ability testing for candidates or check terms, codes and names, this type gives you precise automatic checking for a short answer. In training courses delivered through an LMS platform, it helps check whether key concepts have been understood. When Should You Use It? Choose this type if the answer is short and can be checked against an exact list of accepted spellings. Examples: - "Enter the document name"; - "Which word is missing from the sentence?"; - "Enter the department code"; - "Write the name of the capital city". How Do You Set It Up? 1. Choose the Fill-in question type. 2. In the Accepted answers block, add one or more accepted answers. 3. If there are several correct spellings, add each one on a separate line. 4. Set Trim spaces if spaces at the beginning and end should be ignored. 5. Set Case sensitive if letter case matters. 6. Click Save. How Is It Marked? The question is marked automatically. Smart Way LMS compares the user's answer with each accepted answer after applying the spacing and case rules. Nuances and Limitations - Trim spaces is usually worth keeping switched on; - Case sensitive is best enabled only where letter case genuinely matters; - you can add several accepted answers, for example London and LONDON; - automatic checking does not understand synonyms unless you add them to the accepted answers list. What Should You Check Before Publishing the Test? - all accepted spellings of the answer have been added; - letter case has been configured deliberately.

Question Types in the Test Builder: Numeric Answer

The Numeric answer question type is used when the answer should be a number: a quantity, calculation, metric or value within a range. When a company introduces automation for employee learning and development, numeric questions are useful where an employee needs to calculate a value, standard or quantity correctly. When Should You Use It? Choose this type if the correct answer needs to be checked as a numeric value. Examples: - "Calculate the sum 3*(7-2)+4"; - "How many minutes does the procedure take?"; - "What is the minimum acceptable value?". Checking Modes Exact value with tolerance - the correct value with an allowed deviation. For example, if the correct value is 10 and the tolerance is 0.5, answers from 9.5 to 10.5 will be marked as correct. If you want an exact numeric answer, for example 2+2=4, leave the tolerance value as zero. Accepted range - an accepted range. For example, minimum 5, maximum 15: any number from 5 to 15, inclusive, will be accepted as the correct answer. How Do You Set It Up? 1. Choose the Numeric answer type. 2. Choose the marking mode. 3. For an exact value, fill in Correct value and Tolerance. 4. For a range, fill in Minimum value and Maximum value. 5. Click Save. How Is It Marked? The question is marked automatically. The user enters a number in a numeric field. The system accepts a numeric value, not free text. Nuances and Limitations - for the exact mode, the correct value must be filled in; - tolerance cannot be negative; - for a range, the minimum and maximum must be filled in; - the maximum must be greater than or equal to the minimum; - if units of measurement matter, include them in the question text. What Should You Check Before Publishing the Test? - the correct marking mode has been selected; - the tolerance or range matches the purpose; - units of measurement are stated in the question if they matter.

Question Types in the Test Builder: Hotspot

The Hotspot question type is used when the user needs to choose one or several areas on an image as the answer. This format works well when you need a practical staff assessment and it is important to see whether an employee knows the correct area on a diagram, photo or interface. The Hotspot question type can make the check more visual and closer to a real workplace situation. When Should You Use the Hotspot Question Type? Choose this type if the answer is tied to a specific area on a diagram, photo or interface image. Examples: - find the correct element on a diagram; - select hazardous areas in a photo; - mark the required parts of equipment; - identify the correct area in an interface. How Do You Set It Up? 1. Choose the Hotspot type. 2. Add an image to the question through the question action menu (the three dots to the right of the question field). 3. Click Add hotspot. 4. Move the marker to the required area of the image. 5. Give the marker a name in the Hotspot name (not shown during test) field. 6. Mark the correct markers with the Correct checkbox. 7. Set the X/Y coordinates or marker transparency if needed. 8. Click Save. What Does the User See in the LMS Platform? - the user sees an image with numbered markers; - they click the required markers; - the Hotspot marker name is not shown to the user during the test, but is used in reports. How Is It Marked? The question is marked automatically and is included in the test percentage result. Marking is based on the exact set of correct markers. The order of selection does not matter. If the user selects not all correct markers, an extra marker or an unknown marker, the answer will be incorrect. Nuances and Limitations - Hotspot requires an image in the question; - there can be one or several correct markers; - every Hotspot must have a name; - there must be at least one correct marker; - markers must remain within the image; - round markers are supported; - marker transparency can be set from 0% to 80%; - if the question image is changed, the Hotspot settings need to be checked or configured again. What Should You Check Before Publishing? - an image has been added to the question; - all markers are positioned accurately; - every marker has a name; - correct markers are marked with the Correct checkbox; - extra markers are not marked as correct.

Question Types in the Test Builder: Likert Scale

The Likert scale type is used for surveys, self-assessment or collecting feedback. It is not a type for automatic knowledge checking. In scenarios where psychological testing of employees or post-training surveys are used, the scale helps collect a level of agreement, confidence or self-assessment. For processes where employee onboarding matters, it is useful as a feedback tool rather than an automatic check of answer correctness. When Should You Use It? Choose this type if you need to collect an opinion, level of agreement, confidence or satisfaction. Examples: - "Rate how much you agree with the statement"; - "How useful was the course?"; - "Rate your level of confidence in carrying out this procedure"; - "How clear was the material?". How Do You Set It Up? 1. Choose the Likert scale type. 2. Fill in Value for each option. 3. Fill in the text label for the option. 4. Add or delete options if needed. 5. Click Save. By default, the scale has 5 options: from strongly disagree to strongly agree. You can adjust them to your terminology and task. How Is It Marked? Likert scale is not included in the test percentage result. The user chooses one option, and the answer is saved and shown in reports. Nuances and Limitations - at least two scale options are required; - each option must have Value and a label filled in; - do not use Likert scale for knowledge checks if a pass mark is required; - if the test contains only Likert scales, there will be no automatic test result. What Should You Check Before Publishing? - all options have a value and label; - the scale endpoints are clear to the user; - you do not expect an automatic mark for this question.

Question Types in the Test Builder: Matching

The Matching question type is used to create relationships between two elements: a left-hand element and the correct matching right-hand element. This type is useful when you need staff competency assessment through relationships between concepts, roles, documents or actions. A learning management system can use matching to check that an employee understands not only terms, but also the correct relationships between them. When Should You Use It? Choose this type if you need to check the relationship between two sets of concepts. Examples: - term - definition; - role - area of responsibility; - action - responsible employee. How Do You Set It Up? 1. Choose the Matching type. 2. Fill in the Prompt and Match pairs. 3. Add as many pairs as needed. 4. Make sure each left-hand and right-hand part is filled in. 5. Click Save. What Does the User See? - the left-hand elements are shown as tasks; - for each left-hand element, the user chooses the correct match from the list of provided options. How Is It Marked? The question is marked automatically and is included in the test percentage result. Marking works on an all-or-nothing basis: all pairs must be matched correctly. If at least one pair is incorrect, the answer is considered incorrect. Nuances and Limitations - at least two pairs are required; - do not create two identical right-hand answers, as this can confuse the user; What Should You Check Before Publishing? - all pairs are filled in; - there are no accidental duplicates in the right-hand answers; - each match is unambiguous; - the list is not too large for one question.

Question Types in the Test Builder: Sequencing

The Sequencing question type is used when the user needs to place items in the correct order. In practical staff testing scenarios, you often need to check not a single fact, but the correct sequence of actions. When a learning management system is being set up, this question type helps reinforce knowledge of the order of steps, instructions and workplace scenarios. When Should You Use It? Choose this type when the sequence of actions, stages or decisions matters. Examples: - checking knowledge of the correct sequence of procedure stages; - the order of actions in an emergency; - the sequence for approving a document; - steps for working with a client. How Do You Set It Up? 1. Choose the Sequencing type. 2. Add the items in the correct order. 3. For each item, enter text or add an image. 4. To change the sequence, move items up or down using the controls. 5. Click Save. What Does the User See? - the user sees the sequence items; - they change the order of items using the up or down controls; - after the answer is submitted, the system compares the answer order with the order configured in the builder. How Is It Marked? The question is marked automatically and is included in the test percentage result. Marking works on an all-or-nothing basis. If one item is not in the correct position, the answer is considered incorrect. Nuances and Limitations - at least two items are required; - an item can be text, an image, or both text and an image; - if the order is not unambiguous, it is better to choose a different question type. What Should You Check Before Publishing? - the items are in the correct order; - each item has text or an image; - the sequence does not allow several correct versions.

Question Types in the Test Builder: True / False

The True / False question type is used for statements that need to be assessed as true or false. This type is useful when you need a quick staff knowledge check and the question has one clear correct answer. When a company develops staff learning and development, these statements help quickly check understanding of rules, policies and basic procedures. When Should You Use It? Choose this type if the question can be written as a short, unambiguous statement. Examples: - "An employee may start work without induction training"; - "A file containing personal data can be sent in an open chat"; - "After completing a course, the test can be retaken if the settings allow it". How Do You Set It Up? 1. Choose the True / False type. 2. The system creates two options: True and False. 3. If needed, change the option text to something clearer, for example Yes and No. 4. Mark one correct option. 5. Click Save. How Is It Marked? The question is marked automatically and is included in the test percentage result. This type must always have exactly two options, and only one option can be correct. Nuances and Limitations - do not use this type for ambiguous wording; - avoid double negatives, as they confuse users; - if the statement contains several conditions, it is better to split it into several separate questions; - do not use this type if more than one correct option needs to be selected. What Should You Check Before Publishing? - the statement is short and unambiguous; - there are two answer options; - one correct option is marked.

Question Types in the Test Builder: Video Answer

The Video answer question type is used when the user needs to answer in video format: recording their response through a camera and microphone. This format is suitable for practical staff assessment when it is important to see not only whether the answer is correct, but also the process, communication or demonstration of a skill. When Should You Use It? Choose Video answer if the answer needs to be seen, not only read. Examples: - "Record a video showing how you complete the practical task"; - "Show how you work with the equipment or interface"; - "Record a short presentation of the solution"; - "Demonstrate how you would explain the rules or product to a client". If you only need written reasoning, it is better to choose Free answer. If you need a completed document or spreadsheet, use Upload file. How Do You Set It Up? 1. Choose the Video answer type. 2. In the question text, explain exactly what should be shown in the video. 3. If needed, specify the recommended duration or marking criteria. 4. Click Save. With this type, you do not need to create answer options or mark a correct answer. What Does the User See? During the test, the user can click Record video answer and record video in the browser. Before recording, they can choose the quality: Standard or Lower quality for a longer recording. During recording, the user sees a real-time preview. After stopping the recording, they can review the video, record the answer again or submit it. If browser recording is unavailable, or the browser does not have access to the camera or microphone, the system shows a message and lets the user click Upload prepared file. Formats and Limit Supported video formats: .mp4, .mov, .ogg, .webm. The maximum video file size is 500 MB. If the recording approaches this limit, the system automatically stops recording with a technical buffer and shows a message that the limit has been reached. The user can save this answer or record it again. Recording is performed locally in the browser. The system tries to record MP4 if the browser supports it. If MP4 recording is unavailable, WebM or another browser-supported format is used without server-side transcoding. How Is It Marked? Video answer is not marked automatically and is not included in the test percentage result. After submission, the video is saved as an answer file. In the PDF report, this answer shows the links Open file and Download file. If you delete the video answer file from the file manager, the links to it automatically disappear from the test report. Nuances and Limitations - recording requires browser permission for the camera and microphone; - if the browser does not support recording, the user can upload a prepared video file; - while the file is uploading, the system pauses the test timer for the upload period; - during video recording itself, the timer is not paused; - the answer must fit within the 500 MB limit. What Should You Check Before Publishing? - the question clearly says what must be shown in the video; - the user understands the expected duration and marking criteria; - you have accounted for the 500 MB limit; - you do not expect automatic score calculation.

Question Types in the Test Builder: Audio Answer

The Audio answer question type is used when the user needs to give an oral answer: recording audio through a microphone. This format is useful for staff testing when you need to assess an oral explanation, response logic, speech or reasoning without video. When Should You Use It? Choose Audio answer when the oral answer matters, but video is not needed. Examples: - "Give an oral explanation of the solution"; - "Record a short self-presentation"; - "Explain the rules to a client in simple words"; - "Comment on the risks you see in the case". If you need to see the user's actions or a demonstration of a skill, it is better to choose Video answer. If the answer should be a document or spreadsheet, use Upload file. How Do You Set It Up? 1. Choose the Audio answer type. 2. In the question text, explain exactly what the user should say. 3. If needed, specify the recommended duration or marking criteria. 4. Click Save. With this type, you do not need to create answer options or mark a correct answer. What Does the User See? During the test, the user clicks Record audio answer and records their answer through the microphone. After stopping the recording, they can listen to the audio, record the answer again or submit it. If browser recording is unavailable, or the browser does not have access to the microphone, the system shows a message and lets the user click Upload prepared file. Formats and Limit Supported audio formats: .mp4, .mp3, .ogg, .webm, .wav. The maximum audio file size is 500 MB. If the recording approaches this limit, the system automatically stops recording with a technical buffer and shows a message that the limit has been reached. The user can save this answer or record it again. How Is It Marked? Audio answer is not marked automatically and is not included in the test percentage result. After submission, the audio is saved as an answer file. In the PDF report with test results, this answer shows the links Open file and Download file. If you delete the audio answer file from the file manager, the links to it automatically disappear from the test report. Nuances and Limitations - recording requires browser permission for the microphone; - if the browser does not support recording, the user can upload a prepared audio file; - while the file is uploading, the system pauses the test timer for the upload period; - during audio recording itself, the timer is not paused; - the answer must fit within the 500 MB limit. What Should You Check Before Publishing? - the question makes it clear what the user should say; - the expected answer duration does not conflict with the 500 MB limit; - the manual marking criteria are clear to the administrator; - you do not expect automatic score calculation.

Question Types in the Test Builder: Upload File

The Upload file question type is used when the user needs to attach one file as the answer to a question. This type is useful for staff testing when the result should be a completed document, calculation, solution presentation, case file or another material for manual review. When Should You Use It? Choose Upload file if the answer should be a separate file. Examples: - "Upload the completed template"; - "Attach the case file with your solution"; - "Upload the spreadsheet with calculations"; - "Add a presentation or PDF with the completed task". If you need a text answer without a file, use Free answer. If you need a camera or microphone recording, use Video answer or Audio answer. How Do You Set It Up? 1. Choose the Upload file type. 2. In the question text, write which file needs to be attached. 3. If the format matters, state it directly in the question text. 4. Click Save. With this type, you do not need to create answer options or mark a correct answer. What Does the User See? During the test, the user clicks Attach file, selects a file on their device and submits the answer. If the wrong file has been selected, it can be removed with Remove file and replaced with another one. The answer button is available only after a valid file has been selected. During upload, the system shows the message Please wait, the file is uploading.... Formats and Limit Supported formats: .doc, .docx, .pdf, .xls, .xlsx, .ppt, .pptx, .txt, .csv, .mp4, .mov, .ogg, .webm, .mp3, .wav. The maximum file size is 500 MB. How Is It Marked? Upload file is not marked automatically and is not included in the test percentage result. After submission, the file is saved as an answer file. In the PDF report, this answer shows the links Open file and Download file. If you delete the answer file from the file manager, the links to it automatically disappear from the test report. Nuances and Limitations - one answer file is allowed in one question; - if you need to receive several materials, ask the user to combine them into one document; - the file must match a supported format; - the file must fit within the 500 MB limit; - saving the file requires free space on the company's file storage; - while the file is uploading, the system pauses the test timer for the upload period. What Is the File Called in the File Manager? Answer files are saved on the company's file storage in the test folder. The folder name matches the test name. The file name is generated as follows: - if the user has a surname and first name, the name is generated as surname_firstname_UUID.ext; - if there is only one part of the full name, that part is used; - if there is no full name, only UUID.ext is used. In the file manager side panel, answer files do not show a URL, so they are not accidentally added to lessons as learning materials. What Should You Check Before Publishing? - the question makes it clear which file needs to be uploaded; - if a specific format is required, it is written in the question text; - the expected file can fit within the 500 MB limit; - you do not expect automatic score calculation.

Question Types in the Test Builder: Free Answer

The Free answer question type is used when the user needs to write a text answer in their own words. It is a format for explanations, reasoning, short essays, descriptions of experience or answers that an administrator reviews manually. This type is useful when staff testing needs to assess not only the choice of the correct option, but also the logic of the answer, reasoning or way of thinking. If you need to collect media or a document, use a separate question type: - Video answer - for a video recording or a prepared video file; - Audio answer - for an audio recording or a prepared audio file; - Upload file - for a document, spreadsheet, presentation, PDF or another supported file. When Should You Use It? Choose Free answer if the answer should be text and cannot be checked reliably by the system. Examples: - "Describe how you will apply the rule in your work"; - "Explain why this solution option is the best"; - "Write a short conclusion after the case"; - "Describe the risks in this situation". How Do You Set It Up? 1. Choose the Free answer type. 2. Write the question text. 3. If needed, add an image to the question. 4. Click Save. With this type, you do not need to create answer options or mark a correct answer. What Does the User See? During the test, the user sees a text input field. The answer button becomes available only after the user enters text. How Is It Marked? Free answer is not marked automatically and is not included in the test percentage result. The answer is saved in the report as text. An administrator must review it manually and make their own judgement about the quality of the answer. If the test consists only of manually reviewed, unmarked questions, the automatic result in the report may appear as -. Nuances and Limitations - this type is for text only; - files, video and audio are not added in this type; - the question wording should explain how detailed the answer should be. What Should You Check Before Publishing? - the wording makes it clear exactly what the user should write; - you do not expect automatic score calculation.

How do I set up marking for open-ended answers?

Open the test in the builder. On the ‘Settings’ tab, find ‘Open-ended answer review’. If an administrator will mark the answers manually, you can leave the settings as they are. If AI will mark the answers, set the marking criteria. The ‘Open-ended answer review’ settings appear only when the test includes at least one ‘Free answer’, ‘Audio answer’, ‘Video answer’ or ‘Upload file’ question. Otherwise, this section stays hidden. Which questions need marking? Questions need marking when learners write an answer in their own words, record audio or video, or upload a file. A reviewer or AI marks each of these answers. Once a learner completes a test with one of these questions, an administrator can see the report in the Review centre. To find the right attempt and publish the mark, see ‘How do I use the Review centre to mark tests?’. The learner first sees ‘Under review’. Their final mark appears once the answers have been marked and the result published. In ‘Automatic AI’ mode, this usually takes a few minutes. With either of the other methods, the learner gets their mark once a reviewer has checked the answers and published the result. Which grading method should I choose? Use ‘Grading method’ to choose who marks the answers and whether someone needs to check the marks before the learner sees them. | Method | How the learner gets their result | | ---------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | ‘Manual review’ | An administrator or an assigned department manager reads, watches or listens to each open-ended answer and awards a mark. Once they have marked all the answers, they publish the result for the learner. | | ‘AI with confirmation’ | AI suggests marks and comments based on your criteria. A reviewer can accept or edit the suggestions, then publish the result. The learner sees the marks only after publication. | | ‘Automatic AI’ | AI marks the answers against your criteria. When all the marks are ready, the system publishes the result automatically. If AI cannot finish marking, the report appears under ‘Needs attention’. | If a department manager will mark the answers, give them access to review this test. They can then review answers from their direct reports. How do I set up AI marking? 1. Open the ‘Questions’ tab. For each question that AI will mark, set the points and describe the criteria. You can write them yourself or generate a draft from an example and edit it. See ‘How do I set marking criteria and points for open-ended answers in a test?’ for both methods. 2. Select ‘Save’ on the ‘Questions’ tab so AI can use those criteria. 3. Go back to ‘Settings’ and select ‘AI with confirmation’ or ‘Automatic AI’. Frequently asked questions Why can’t I select AI marking? AI marking is unavailable if any open-ended question is missing saved marking criteria. The learning management system lists the question numbers and tells you which fields to complete. Open the listed questions on the ‘Questions’ tab, enter the missing criteria and select ‘Save’. Then return to the test settings and choose the AI marking method you want. What happens if the test draws questions at random? It depends on the questions the learner receives. For example, if their attempt includes a ‘Video answer’ question, their test results report goes to the Review centre when they finish. If they only receive questions that ask them to select the correct answer, their report won’t appear there.

How do I set marking criteria and points for open-ended answers in a test?

You can write the marking criteria for an open-ended answer yourself or ask AI to draft them. If you have a good example of a correct answer to the test question, give it to AI. Check the criteria it suggests and edit them if needed. Where can I find the fields for marking a test answer? The ‘Points’ and ‘Content assessment criteria’ fields are below the question text. They appear for ‘Free answer’, ‘Audio answer’, ‘Video answer’ and ‘Upload file’ questions. For audio and video answers, you can also turn on sound assessment to see the ‘Criteria for grading sound’ field. For a video answer, you can separately turn on assessment of visible actions and fill in ‘Criteria for grading visible actions’. How do I set the points and write my own criteria? Each part of the answer has its own ‘Points’ field. Enter the most a learner can earn for that part. The field starts at 1 and accepts any whole number from 1 to 100. Give more points to the skill that matters most for the task. Suppose you’re training sales advisers and ask a learner to present a pair of trainers to a customer. In ‘Content assessment criteria’, write what you want to hear from the adviser. For example, “Explains which surfaces the trainers suit and how the flexible sole benefits the customer.” If a full explanation is worth 4 points, enter 4 in the ‘Points’ field beside it. There’s no need to repeat the number in the criteria. When should I mark sound or actions on camera? Use content criteria alone if you only want AI to mark the substance of the answer. If delivery matters, use ‘Criteria for grading sound’ to describe what to listen for, such as intonation, confidence in the learner’s voice or where they pause. If you also want to mark what the learner shows on camera, fill in ‘Criteria for grading visible actions’. In the example with the trainers, you might want to mark how the adviser speaks and demonstrates the product as well as what they say about it. - How the presentation sounds. For an audio or video answer, select ‘Sound affects the grade (optional)’. A ‘Criteria for grading sound’ field appears below, with its own ‘Points’ field. You could write “The adviser speaks clearly and pauses after the explanation to give the customer time to ask a question” and allow 2 points for delivery. - What the customer sees. For a video answer, select ‘Assess visible actions (optional)’. In ‘Criteria for grading visible actions’, you could write “The adviser bends the sole and turns the trainer towards the customer to show where it flexes.” Enter 4 in the ‘Points’ field beside it for the demonstration. For video answers, you can select either option or both. Analysing sound or video frames can use substantially more AI tokens. How do the marks add up? AI marks each part from zero up to its maximum, then adds the marks together. It can award a fractional mark if the learner meets some of the requirements. In our example, the adviser explains the benefits of the trainers (4 out of 4) and speaks clearly, pausing for a question (2 out of 2). They bend the sole, but the customer can’t see where it flexes. If AI awards 1.5 out of 4 for the demonstration, the total is 7.5 out of 10. AI explains the marks in its comment. How do I use AI to generate marking criteria from a sample answer? Prepare an example of a correct answer to the question. | Question type | What to use as the example | Format and limits | | ----------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------- | | ‘Free answer’ | A written answer. For example, write what an adviser might say to explain the benefits of the trainers to a customer. | Up to 30,000 characters. | | ‘Audio answer’ | A recording of a spoken answer. For example, record an adviser presenting the trainers to a customer. | MP3, WAV, MP4 with audio, OGG or WebM, up to 500 MB. | | ‘Video answer’ | A video of someone carrying out the task. If you’re marking a product demonstration, make sure the recording shows how the learner should present the product. | MP4, WebM or MOV, up to 500 MB and up to 10 minutes long. | | ‘Upload file’ | An example of the finished document you expect from the learner, such as a product presentation for a customer. | PDF, DOCX, PPTX, XLSX or TXT, up to 500 MB. | 1. If you want criteria for sound or actions on camera, tick the relevant boxes. Below the criteria fields, select ‘Generate grading criteria from an example’. 2. For a ‘Free answer’ question, type or paste the text into ‘Example of a correct response’. For the other question types, choose ‘Select file’. Wait for the upload and file check to finish. The filename will appear beside the button. 3. Select ‘Generate’. When you see ‘AI is preparing draft instructions’, you can close the tab or go to another page. AI will carry on preparing the draft. Return to the question after a few minutes to check the result. How do I check the criteria and save the question? The draft appears in the content criteria field and in the fields for any options you selected. If you’ve already written some criteria, AI adds its suggestions below yours, leaving a blank line between them. It keeps the points you set. Read through the combined text, remove any repetition and keep only what the task asks the learner to do. If AI couldn’t draft criteria for one part, you’ll see a message beneath that field. Write the missing criteria there. Once the criteria are ready, check the points and select ‘Save’ below the list of questions. If you want AI to mark learners’ answers, open the test’s ‘Settings’ tab and choose the marking method. What if a learner has already started the test? That attempt keeps the criteria and points that applied when the learner started. If you change the wording or the points and save the question, the changes apply to subsequent attempts. How do I reopen a finished draft? Open the same question using the same account within 30 days. The date beside the generation button tells you how long the draft is available. If you have since changed the settings, select ‘Restore draft with its settings’. This recovers the existing text without generating it again or using more AI tokens. If you have changed the question wording or type, prepare new criteria for the revised task. What happens to the example file? The system removes files uploaded more than a day ago once they are no longer needed for generation. It keeps the draft separately, so you can still reopen it after the file has been removed. What if the upload or generation was interrupted? If you refreshed the page while the file was uploading, select the same file again in the same tab. If you closed the tab, reopen the question and check whether you need to attach the example again. If the upload finished but generation stopped with a message about insufficient AI credits, top up the balance. Then return to the question and select ‘Generate’ again.

How do I give a department manager access to review open-ended answers in tests?

For a department manager to review their team’s answers, an administrator must add them in the test settings. Where do I find the access settings? 1. In the side menu, find ‘Testing’ and open ‘Test Builder’. Find your test in the list and select ‘Edit’ in the same row. 2. Below the test title, open ‘Settings’, next to the ‘Questions’ tab. Look for ‘Open-ended answer review’. This section appears when the test contains at least one ‘Free answer’, ‘Audio answer’, ‘Video answer’ or ‘Upload file’ question. 3. In that section, look below ‘Grading method’ for ‘Give department managers access to review answers’. Below the heading, you’ll see which managers have already been added and the fields for finding and adding others. Which option should I choose under ‘Search type’? ‘Search type’ gives you two options. Choose ‘Recommended’ to see managers whose teams have access to courses that use this test. Choose ‘All managers’ to find any manager with an active account in your company, regardless of course access. If the test isn’t linked to any courses, or if at least one linked course is open to all teams, both options show the same list of managers. How do I add a manager or withdraw access? 1. Select the empty ‘Enter a first name or surname’ field to open the list. If there are lots of names, type at least two letters of the manager’s first name or surname. You can also select the manager’s department in ‘Department’. 2. Select the manager’s name in the search results. Once their name appears above ‘Search type’, they have access to review answers for this test. 3. To withdraw access to this test, select the cross beside the manager’s name. Whose answers will the manager see in the Review centre? In ‘Review centre’, the manager will see test results reports only for employees who report to them. Managers cannot review their own answers. Suppose you’re training a small team across two shops. One course is open only to the shop in Podil. Another course uses the same test and is open to employees whose job title is sales adviser. Both shops employ sales advisers, so both managers appear under ‘Recommended’. If you add only the manager of the Podil shop, they’ll see answers from staff in their own department. They won’t see answers from sales advisers in the other shop. Why does the search field show ‘No managers found’? Check the spelling of the manager’s name. To broaden the search, choose ‘All managers’ and set ‘Department’ to ‘All departments’. If the person still doesn’t appear, check that they have an active account with the manager role in your company. Who can see test results reports for job applicants? Only administrators can see job applicants’ test results reports in ‘Review centre’.