Comparing the Security of Three Proctoring Regimens for Bring-Your-Own-Device Exams
We compare the exam security of three proctoring regimens of Bring-Your-Own-Device, synchronous, computer-based exams in a computer science class: online un-proctored, online proctored via Zoom, and in-person proctored. We performed two randomized crossover experiments to compare these proctoring regimens. The first study measured the score advantage students receive while taking un-proctored online exams over Zoom-proctored online exams. The second study measured the score advantage of students taking Zoom-proctored online exams over in-person proctored exams. In both studies, students took six 50-minute exams using their own devices, which included two coding questions and 8-10 non-coding questions.
We find that students score 2.3% higher on non-coding questions when taking exams in the un-proctored format compared to Zoom proctoring; no statistically significant advantage was found for the coding questions. While most of the non-coding questions had randomization such that students got different versions, for the few questions where all students received the same exact version, the score advantage escalated to 5.4%, indicating that randomization can mitigate some of the cheating associated with running un-proctored online exams. From the second study, we find no statistically significant difference between students’ performance on Zoom proctored versus in-person proctored exams.
Fri 22 MarDisplayed time zone: Pacific Time (US & Canada) change
15:45 - 17:00 | Testing and Academic IntegrityPapers at Meeting Rooms B110-112 Chair(s): Kim Titus North Carolina State University | ||
15:45 25mTalk | Comparing the Security of Three Proctoring Regimens for Bring-Your-Own-Device Exams Papers Rishi Gulati University of Illinois at Urbana-Champaign, Matthew West University of Illinois at Urbana-Champaign , Craig Zilles University of Illinois at Urbana-Champaign, Mariana Silva University of Illinois at Urbana Champaign DOI | ||
16:10 25mTalk | "I didn't know": Examining Student Understanding of Academic Dishonesty in Computer ScienceGlobal Papers Michael Liut University of Toronto Mississauga, Anna Ly University of Toronto Mississauga, Jessica Jia-Ni Xu University of Toronto, Justice Banson Western Washington University, Paul Vrbik The University of Queensland, Caroline Hardin Western Washington University DOI | ||
16:35 25mTalk | One Solution to Addressing Assessment Logistical Problems: An experience setting up and operating an in-person testing center Papers Kelly Downey UC Riverside, Kris Miller University of California, Riverside, Mariana Silva University of Illinois at Urbana Champaign, Craig Zilles University of Illinois at Urbana-Champaign DOI |