Bulletproofing Online Assessments

Assessments that are properly designed and implemented indicate the degree to which a student met the related learning outcome for a course. For some assessment types, such as research papers, the absence of invigilation does not impact the validity of the assessment. Other assessment types that are open to easy methods of cheating may not yield a high confidence level in the exam results.

Choosing the Assessment Type

The types of assignments students say they are least likely to cheat on are reflections on practicums, vivas, personalized and unique tasks, and in-class tasks (Bretag et al., 2019).

The following assessments types are easy to implement online and have inherent or configurable settings that can reduce cheating.

Presentations

Assignments where students have to prepare a presentation and present it, in person or virtually, can reduce the potential to cheat because the instructor can see the presenter.

“Must post first” discussions

When assessments include a discussion post, students often wait for other students to post so they can see the answer, or get ideas for their own answer, before posting. Selecting “must post first” requires that students start a thread before they can read and reply to other students’ threads. This makes the post more indicative of the student’s knowledge and skill related to the discussion topic.

Quizzes

NOTE
The following information is relevant to any assessment including final exams, mid-terms, tests, and quizzes.

Open-ended Quiz Questions

Open-ended questions, especially those that require critical and creative thought, make cheating transparent because individual responses are rarely identical. Long answer and essay questions are examples of this.

Close-ended Quiz Questions

When students are given defined choices for the answer to a question, it is easier to cheat. A student can look up the answer quickly or ask a friend, “what is the answer to #5”, with a quick response of “B”. There is no way to tell that this student cheated as the answer is not unique, but there are ways to increase the integrity of close-ended questions.

Increasing the Integrity of a Quiz in an LMS

NOTE
For online exams, tests, and quizzes, instructors should follow the same principles of assessment and question design as for face-to-face exams.

When creating questions for your quiz in Brightspace, do one or more of the following to increase the integrity of the quiz:

  1. Create unique quizzes for each student by generating a random subset of questions from the Question Library. In your Quiz (Quiz Questions page) create a Question Pool and enter the number of questions that you want for the quiz and the questions or sections that you want to draw from.
  2. Make a unique presentation of the same quiz by using Sections to randomize (shuffle) the questions’ order as they appear to each student.
  3. Randomize (shuffle) the response options for a question each time it is selected for a quiz.
  4. Avoid using “all of the above” or “none of the above”. Students need only identify more than one correct option or eliminate a single option to find the correct answer. In addition, randomizing the response options will not work when “all of the above” or “none of the above” are present.
  5. Include response options that require a high level of knowledge and thought to determine the correct answer versus response options where there is one obvious answer among implausible options.
  6. Create sections in Brightspace that contain questions based on topic, question type, difficulty level, etc. Then, create a quiz that randomly selects one or more questions from each section. This way, each student will receive a unique, but fair, quiz.

Change the Question Type

  1. Instead of asking questions that test lower order thinking such as recalling facts or recognizing items, write a question or present a problem to which a student must apply their knowledge in order to respond.
  2. Instead of using a multiple choice (MC) type question, use a written response (WR) type. Include the response options in the question and ask students to type in their response and a written explanation for choosing their response.
  3. Choose a WR question to allow students to solve a problem on paper and upload a picture of their solution. Asking students to sign the document or include a picture of their student ID is optional.
  4. Choose an arithmetic type of question when variables are required, resulting in a unique question for each student.

Configuring a Quiz to Reduce Cheating

Setting features of the Brightspace quizzes tool to decrease the ability to cheat:

  • Paging prevents moving backwards through pages – students cannot go back to find an answer for a friend
    • NOTE: Enabling paging is frustrating for many students as skipping some questions and returning to them later in the exam is a exam strategy that they use frequently. Use cautiously and only for special situations.
  • Use question pools to create randomized sets of questions
  • Shuffle questions at the quiz level
  • Shuffle questions within a section
  • Disable right-click to prevent students from printing quiz questions (this feature is browser-dependent)
  • Disable Instant Messenger and alerts to prevent students from using the Messenger tool or alerts while taking a quiz
  • Use submission views strategically (see below)

Submission Views

Submission Views display information for the user after they complete and submit a quiz. These views can provide valuable feedback to students but using them wisely is important as they may inadvertently provide information for cheating.

The Default View is useful for graded quizzes and includes the following settings:

  • Displays immediately after submission
  • It does not show the questions (or answers)
  • Displays the user’s attempt score and overall attempt score (if more than one attempt was allowed)
    • NOTE: you can uncheck this if you do not want students to see their grade automatically
  • User statistics are not displayed

Create and use an Additional View if you want to customize a view. For example, you may want to hide a students’ quiz grade until after you review the quiz questions and make adjustments or you have a practice or homework quiz and you want students to see question feedback immediately.

Example Submission Views

Submission View One

Name: Quiz Review Open
Message (students will see this when they attempt to review their quiz — you can set this expectation prior to the quiz): “Quiz questions are available for review from Tuesday, Oct. 19 at 8:00 AM NST until Wednesday, Oct. 20 at 11:59 PM NST.”
Date: Enter the date and time of when the quiz answers are available for review. Note that this has to be after the quiz has been graded.
Show Questions?: Yes (and choose your options)
Score: Select Show attempt score and overall attempt score

Submission View Two

Name: Quiz Review Closed
Message (students will see this when they attempt to review their quiz — you can set this expectation prior to the quiz): “Quiz questions are nor longer available for review.”
Date: Enter the date and time of when the quiz answers are no longer available for review — suggest 24-48 hours after the quiz has been graded.
Show Questions?: No

NOTE
These submission views will overwrite the Default view.

References

Resource created by Denise C.