Blogs (4) >>

To promote good coding practices we need to understand what students do when they are on their own. In this research study, we explore students’ testing behavior and response to persistent errors to better understand their coding patterns. We investigate how those patterns change when facing coding struggle, and how help-seeking might influence their coding behavior during coding struggle. We define struggle during coding as failing the same unit test case consecutively for more than four submission events, considering only unit test cases created by the instructors. To analyze the students’ coding data, we use progress indicators, student test implementation indicators, and both student-generated and instructor-generated unit test results from each student submission event. In addition, we use office hours attendance records and amount of assignment-related posts created on the course forum. Results show that students tend not to follow test-driven development practices, even when explicitly directed to, and tend to create unit tests only to earn assignment credit rather than to guide their software development. Students also tend not to modify their own unit tests once they have earned the related credits, even when facing coding struggle; they tend to modify their unit tests only after they have been facing coding struggle for an extended number of submission events.

Fri 22 Mar

Displayed time zone: Pacific Time (US & Canada) change

15:45 - 17:00
LLMs - Error message and Coding strugglesPapers at Oregon Ballroom 204
Chair(s): Celine Latulipe University of Manitoba
15:45
25m
Talk
A Large Scale RCT on Effective Error Messages in CS1CER Best PaperGlobal
Papers
Sierra Wang Stanford University, John C. Mitchell Stanford University, Chris Piech Stanford University
DOI
16:10
25m
Talk
dcc --help: Transforming the Role of the Compiler by Generating Context-Aware Error Explanations with Large Language ModelsGlobal
Papers
Andrew Taylor University of New South Wales, Sydney, Alexandra Vassar University of New South Wales, Sydney, Jake Renzella University of New South Wales, Sydney, Hammond Pearce University of New South Wales, Sydney
DOI
16:35
25m
Talk
Exploring Novice Programmers' Testing Behavior: A first step to define coding struggle
Papers
Gabriel Silva de Oliveira North Carolina State University, Zhikai Gao North Carolina State University, Sarah Heckman North Carolina State University, Collin Lynch North Carolina State University
DOI