Exploring Novice Programmers' Testing Behavior: A first step to define coding struggle
To promote good coding practices we need to understand what students do when they are on their own. In this research study, we explore students’ testing behavior and response to persistent errors to better understand their coding patterns. We investigate how those patterns change when facing coding struggle, and how help-seeking might influence their coding behavior during coding struggle. We define struggle during coding as failing the same unit test case consecutively for more than four submission events, considering only unit test cases created by the instructors. To analyze the students’ coding data, we use progress indicators, student test implementation indicators, and both student-generated and instructor-generated unit test results from each student submission event. In addition, we use office hours attendance records and amount of assignment-related posts created on the course forum. Results show that students tend not to follow test-driven development practices, even when explicitly directed to, and tend to create unit tests only to earn assignment credit rather than to guide their software development. Students also tend not to modify their own unit tests once they have earned the related credits, even when facing coding struggle; they tend to modify their unit tests only after they have been facing coding struggle for an extended number of submission events.
Fri 22 MarDisplayed time zone: Pacific Time (US & Canada) change
15:45 - 17:00 | LLMs - Error message and Coding strugglesPapers at Oregon Ballroom 204 Chair(s): Celine Latulipe University of Manitoba | ||
15:45 25mTalk | A Large Scale RCT on Effective Error Messages in CS1Global Papers Sierra Wang Stanford University, John C. Mitchell Stanford University, Chris Piech Stanford University DOI | ||
16:10 25mTalk | dcc --help: Transforming the Role of the Compiler by Generating Context-Aware Error Explanations with Large Language ModelsGlobal Papers Andrew Taylor University of New South Wales, Sydney, Alexandra Vassar University of New South Wales, Sydney, Jake Renzella University of New South Wales, Sydney, Hammond Pearce University of New South Wales, Sydney DOI | ||
16:35 25mTalk | Exploring Novice Programmers' Testing Behavior: A first step to define coding struggle Papers Gabriel Silva de Oliveira North Carolina State University, Zhikai Gao North Carolina State University, Sarah Heckman North Carolina State University, Collin Lynch North Carolina State University DOI |