Assessments are a great way to gauge where your learners are at and get a feel for the effectiveness of your content. Read more to learn about test page set up, how they differ from other assessment types, and when to use them.
Use Case Information
A test is the most stringent of the assessment page types. Use tests for high-stakes exams or when you do not want learners to take advantage of rejoinders (hints) as part of an assessment since rejoinders are not available in tests. Tests are different from quizzes because, once they’ve answered all questions, learners see the answer choice the they selected, but not the correct answer. The system tracks all responses/results on the back end so instructors and managers can view them.
Note
When learners take an assessment built on the Test Page, the question order is always randomized. If you'd like to avoid this, use a quiz page instead.
How to Create a Test Page
- From your homepage, select Courses > All Courses.
- Click the Content Title for to the course you want to alter.
- Within the course outline, go to the lesson where you'd like to add a test.
- Click the plus sign in your course outline > hover over the Add Page icon and click.
- Find the Assessment Pages section, then click Test.
- Add a page title > click Save.
- Click Create New Question. From here, you have the option to add multiple choice, true/false, image comparison, open ended, file submission, or essay question types.
If there are questions saved in the Question Library, these questions can be added as well.
Read more below to learn about each question type:-
Multiple Choice: Learners select one or more answer choices in response to a question.
-
True/False: Learners decide if a statement is true or false.
-
Image Comparison: Learners decide which one of two images most accurately relates to the question.
-
Open Ended: Learners provide text a response in an open text field.
-
File Submission: Learners provide a file submission in response to a question or prompt. Some acceptable file types include PNG, JPG, GIF, PDF, and MP3. Files that contain extensions with executable scripts, like .html, .svg, and .exe, are not allowed to be uploaded. File size limit is 20MB. File submissions are found under the Grading tab of the admin interface.
-
Essay: Learners submit a text response in a text field (WYSIWYG) in response to given prompts. A Content to Review field can be used to give context or essay instructions. The Question prompt is used define the learner's task.
-
Multiple Choice: Learners select one or more answer choices in response to a question.
- If a question requires a correct answer, be sure to click the star next to the correct answer on a given question. You can click Add a New Choice to create more answer fields, if applicable.
- Toggle whether or not you require learners to select all correct answers to receive credit for this question. Be sure to click the star next to each correct answer, if more than one answer exists.
- Click Add Question to add your question to the test.
- Repeat until all of your questions have been added.
- Next, select and save your Test Options, which are located under the question list. The following are the available test options:
-
Enter a minimum passing percentage: Learners must get this percentage of questions correct in order to pass the assessment. If no minimum is entered, the test will not indicate that the learner has passed or failed, and the learner is considered to have passed the test upon test completion.
-
Prevent learner from progressing if not passed: This toggle appears if you enter a minimum passing percentage. Once enabled, a learner must pass the test by meeting the criteria set in "enter a minimum passing percentage" in order to continue progressing through the course. The page navigation is grayed out until the learner passes the test.
-
Add a maximum number of attempts: This is the maximum number of attempts allowed before a learner must reach out to your organization to have their attempts forgiven (or other action you require of them if they use all test attempts, which can be noted in your fail message). The default setting is unlimited attempts.
-
Set number of randomly selected questions per test attempt: The number entered in this field dictates the number of test questions that are presented to a learner when they take the test.
-
Enable a time limit: Enter a time limit for the test. If this is enabled, learners see a suggested time per question, average time per question, time limit, and total time on the results screen at the end of the test.
- Randomize question choice order: The choices available to learners will be randomized. For example, if the choices for a multiple choice question are A: Red B: Orange C: Yellow, then the system will randomize these choices when the learner takes the test, so they might appear as A: Orange B: Yellow C: Red, so choices are different across learners who take the test.
-
Hide individual question results: When reviewing a completed test, learners will not see whether their answers are correct or incorrect. However, if the toggle is disabled, this information will be visible.
-
Add a start of test message: This message appears when learners start the test. The start message field has WYSIWYG options when you highlight your text input. Feel free to add imagery, colored text, etc. to create a clear and useful set of instructions for learners to complete the test. When specific features are enabled (number of attempts, time limit, etc.), they will display to the learner on the start message.
-
Add a pass message and a fail message: These message appears when a learner passes or fails a test. A pass message might congratulate the learner, while a fail message might tell the learner their next steps (retake the test, review a particular course, contact your team for next steps, etc.). The pass/fail message fields have WYSIWYG options when you highlight your text input.
-
Enter an estimated time per question: When enabled, the time you set during test setup will appear on the test results page. Learners will see a suggested time per question, the average time per question, the time limit, and the total time on the results screen at the end of the test.
-
Allow learner to skip questions: When disabled, learners will not see the Skip button while they take the test. When enabled, learners can review and update all test questions, including skipped ones, before submitting. See the Learner Test Review Options section in this article for details.
-
Instructor takes test on behalf of learner: An admin or instructor role can use this setting to take a test on behalf of a learner through the admin or instructor interface. For example, this is useful when learners need to complete practical assessments, like a forklift test, so an admin or instructor can input answers to a test as the learner performs the assessment with the instructor. The learner will see a message that says "The Instructor will take the test on your behalf."
-
Manually grade test: An instructor will manually grade the test.
-
Allow learner to resume an in-progress test?: Learner is able to resume where they left off on a test if the test is incomplete. For example, if a learner leaves the test when on question #3, the learner returns to question #3 when they resume the test.
-
Enable question pools: Question pools allow you to sort questions into custom-named categories. For example, you might create three different question pools, then add existing test questions into a particular category (e.g. Level 1 Questions, Level 2 Questions, etc.).
At the end of a test, a learner will see how many test questions they got correct per test pool category to help them understand which types of test pool questions they have mastered or might need help with. Once a test question has been added to a pool category, it can be moved, edited, or deleted.
-
Enter a minimum passing percentage: Learners must get this percentage of questions correct in order to pass the assessment. If no minimum is entered, the test will not indicate that the learner has passed or failed, and the learner is considered to have passed the test upon test completion.
- Select and save any applicable Advanced Settings:
- Unlocking for editing by children?: This allows any page that is unlocked to be edited by a Client Admin in Panorama. The Client Admin will be able to make changes to the unlocked page in a course in their Panorama only (other Panoramas will not see these changes).
- Add an Audio Narration File: Add an mp3 file here if you would like learners to have the option of playing an audio file on a given page.
-
# of seconds required for completion: This settings requires learners to be on this page for the number of seconds you require in order to mark the page as complete. Times is entered in seconds only (e.g. enter 180 seconds to represent three minutes).
- Click Save.
Learner Test Review Options
Learners can review and update all test questions, including skipped ones, before submitting.
To enable this experience, the test must have the Allow Learner to Skip Questions toggle, under Test Options, turned on.
Once the toggle is enabled, this is what the experience is like for your learners:
- Learners go through the test and can skip questions throughout.
- After the last test question, learners will view a NEW Question Summary Page.
- This page allows the user to scan all test questions to view which ones have been answered or unanswered (skipped). From here, they have the ability to go back to specific question(s) to review or revise their answers.
- The Question Summary Page gives learners 4 Options:
- Review All Questions - user is presented all test questions again
- Review Skipped Questions - user is only presented the skipped questions
- Review an Individual Question - user is only presented that one question
- Submit
- In any of the Review flows, the learner has the ability to update their answer choice or Skip
- The Review flows are accessed prior to the Test Results Page. Therefore, any changes the learner makes is counted as part of the current test attempt.
- Users can go through these flows as many times as they want
- After learner clicks Submit, the Test Results Page displays
- The Review Skipped Questions button (formerly called ‘Review All Unanswered Questions’) is no longer present because it’s now on the Question Summary page
- The See All Results button has been renamed for clarity (formerly called Review All Question Results)
Warning
The Allow Learner to Skip Questions setting cannot be enabled at the same time as the Time Limit setting on Tests. When an Admin enables one setting, the other setting will become automatically disabled and greyed out.
- In the rare case that a test had both the timer setting and skip setting enabled (prior to this release), the timer setting will be maintained. The skip functionality will be hidden to learners. Admins can clear the timer setting in order to make changes to the skip setting.
- This limitation will not affect other assessment types, like quizzes.
Note
All other test behavior will be maintained (including behavior of various test settings). There is no change to other assessment types with this enhancement.
Reporting on Test Results
Test results will populate in the Assessment Results Overview report. Find how to generate this report in the Generating Assessment Reports article.
Notes, Tips, and Considerations
- Text Blocks: When using a test page, you have the ability to add additional information in text blocks. This can be helpful if you need to separate information, add images, or give directions for a specific question, etc.
- Automated Grading: To help streamline your evaluation, consider using questions that require a correct answer (multiple choice, true/false, and image comparison) to remove the need to manually grade test elements.
- Question Body: The question body is a WYSIWYG, so you are free to add images, HTML, links, and more in order to create a robust question experience. Note that answer choices are not WYSIWYGs.
- Question Library: To build a Question Library of common questions that will be used throughout your courses, go to Choose From Question Library > Create New Question. These questions will be available when creating future quiz and test pages in place of manually creating individual questions.
- Best Practice: Create a test learner so you can sign in as a learner and take the test to get the full learner experience. Refine your test settings based on your experience as a test learner.
- Test Experience: While taking the test, a colored rectangle (that reflects your site's theme color) will appear when the learner hovers over the answer options of a multiple choice, true/false, and image comparison questions. A colored rectangle will surround the selected answer when the learner selects the answer, then the learner clicks Next Question to continue on the test. Learners receive feedback about whether a question is correct or incorrect after the whole test is complete, but are not told which answer is correct if they answered incorrectly.
- Translations: You can update the term "test" in translations if you prefer to use a different term. For example, you might use the word "exam" instead. From your homepage, navigate to Settings > Translations, then search for the term you wish to update. Remember that this term will update globally across your instance.