giving exams online: strategies and tools

as courses have moved online this spring, many of us need to consider how to have our students take exams online. in many cases, this involves learning how to use tools that help ensure students take the exam with only the resources you want them to have.

as you think about giving exams online, it is very important that you communicate with your students about behavior that is acceptable during the exam. are they allowed to collaborate? to use their notes or text? to use other websites? some of the tools described below help make these expectations clear and help prevent cheating, but the key first step your communication with students. the vu honor code relies heavily on what instructors communicate to students about what is allowed.

vanderbilt has two tools that readily allow instructors to create exams online: brightspace and tophat. brightspace calls exams “quizzes,” and instructions for creating one are found on the brightspace online guide on quizzes. tophat calls exams “tests,” and instructions for creating one are found on the vanderbilt top hat support site. both include information about how to adjust exam parameters to accommodate student needs for selected students, and the student access services office can offer more assistance.

this page is focused on using exam options that reduce the probability of cheating.

testing options

option 1: change your exam to allow collaboration and use of notes or other resources.

your best option may be to rethink your exam such that you explicitly allow students to collaborate and to use resources such as notes or texts. complex questions that allow students to apply their knowledge can be appropriately challenging even when students can collaborate.

abby parish, of nursing, uses this approach in both pharmacology and statistics courses that she teaches. she provides the following examples of questions that students can collaborate when answering:

hy is a 19 y/o female who recently moved to town to attend college. she comes to clinic reporting significant allergy-type symptoms with sneezing, itchy eyes, and bothersome rhinitis with post-nasal drip and sore throat. she reports that diphenhydramine (benadryl) was not helpful; cetirizine (zyrtec) and loratadine (claritin) helped but made her too drowsy to stay awake during lectures, even when she took them at night. in addition to allergen avoidance counseling, the np recommends:

1. montelukast (singulair) 10 mg po daily
2. azelastine (astelin) 2 sprays each nostril bid
3. fluticasone (flonase) 2 sprays each nostril daily*
4. pseudoephedrine (sudafed) 120 mg po bid

the np prescribes a combined estrogen/progestin contraceptive pill to a 23 y/o patient. the patient returns after 3 months and reports ongoing breakthrough bleeding which is worse during the second half of her cycle. the np plans to:

1. increase estrogen in the first half of pill pack
2. increase estrogen in the second half of pill pack
3. increase progestin in the first half of pill pack
4. increase progestin in the second half of pill pack*

a researcher is interested in assessing whether there is a difference between average score on a distress score measure (continuous scale) between two groups of patients – one group is patients with leukemia and the other group is patients with lymphoma. both groups of scores are distributed normally, and the researcher has recruited a large representative sample. what test could the researcher use to assess for a difference in distress scores between the two groups?

1. chi-square test
2. kruskal-wallis
3. dependent t-test
4. independent t-test*

good advice:

jim hewlett from finger lakes community college recommends that instructors set up a low stakes practice opportunity for students before having them take a high stakes exam online for the first time. erika offerdahl from washington state university also suggests giving students multiple opportunities to take the exam. she says that this helps mitigate problems with unreliable internet access; if a student gets kicked out of the exam, they can log back in and just start taking it again. because she uses question pools and question randomization, students aren’t taking the exact exam again and so are unlikely to misuse the opportunity.

option 2: use isomorphic questions and randomization to give each student a different (but equivalent) exam.

if you give an exam in a crowded lecture hall, you may use several versions of the exam. you may change the order of the questions, the order of the answers to mc items, or the precise content of the items themselves (such as changing numerical values). these options are available for exams given through brightspace and tophat, and result in each student having a slightly different but equivalent exam, reducing the probability of unwanted student-student collaboration.

creating isomorphic questions: isomorphic questions are those that are identical except for a small change. for example, you could ask students to calculate the number of nadh produced from the beta-oxidation of a fatty acid, changing the number of carbons; to identify a segment of a graph, changing which segment is to be identified; to identify the impact of a molecule, changing whether it is an activator, an inhibitor, or irrelevant. the idea is that you create a question pool that consists of 2-4 isomorphic questions and then the exam creator (e.g., brightspace or tophat) pulls one question from each question pool for each student exam it generates.

instructions for creating question pools in brightspace are shown here; instructions for doing it in tophat are found here.

using randomization: randomizing the order in which students see questions and randomizing the order of the alternatives for mc questions further reduces the probability that students will work together when you don’t want them to. to do that in brightspace, choose the “shuffle questions at the quiz level” when editing the properties of the quiz as shown in the figure below. tophat instructions are found here, about halfway down the page.

option 3: use tools within brightspace or tophat to prevent use of other websites on the device being used to take the exam.

brightspace has a lockdown browser that prevents students from accessing other websites on the device they are using to take the exam. in addition, it can be set to allow students access to specific websites that you approve. instructions are found here.

tophat’s tool works somewhat differently. it is called “proctoring,” and in essence, it shuts the students out of the exam if they leave the exam or take a screenshot. instructions for how to use it are shown here (middle of the page).

option 4: use the respondus monitor tool within brightspace to monitor students’ behavior during the exam.

this tool videos students while they take the exam. the videos are automatically uploaded to brightspace. unusual behavior is flagged for the instructor to view. this tool is powerful, but has relatively high technical demands for you and for your students. it is probably not the best approach when student access to the internet and to hardware (i.e. webcams) may be variable. nonetheless, instructions for using it are found here.

summary

this teaching guide is licensed under a creative commons attribution-noncommercial 4.0 international license.

.

.