Use of Large Language Models for Extracting Knowledge Components in CS1 Programming Exercises (SIGCSE TS 2024 - Posters)

Who

Rose Niousha, Muntasir Hoq, Bita Akram, Narges Norouzi

Track

SIGCSE TS 2024 Posters

Time Zone

The program is currently displayed in (GMT-07:00) Pacific Time (US & Canada).

Use conference time zone: (GMT-07:00) Pacific Time (US & Canada)Select other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

By setting a time band, the program will dim events that are outside this time window. This is useful for (virtual) conferences with a continuous program (with repeated sessions).
The time band will also limit the events that are included in the personal iCalendar subscription service.

Display full programSpecify a time band

Save

When

Fri 22 Mar 2024 15:00 - 17:00 at Exhibit Hall E - Posters - Posters 3 Chair(s): Meghan Allen, Ashish Aggarwal

Abstract

With the recent surge in enrollment in computer sciences, providing automated individualized feedback in CS1 courses can potentially eliminate the achievement gap in Computing. This study utilizes large language models to extract foundational programming concepts targeted by various programming assignments in a CS1 course. We seek to answer the following research questions: RQ1. How effectively can large language models identify knowledge components in a CS1 course from programming assignments? RQ2. Can large language models be used to extract program-level knowledge components, and how can the information be used to identify students’ misconceptions? Preliminary results demonstrated a high similarity between course-level knowledge components retrieved from a large language model and that of an expert-generated list.

Rose Niousha

University of California, Berkeley

United States

Muntasir Hoq

North Carolina State University

United States

Bita Akram

North Carolina State University

United States

Narges Norouzi

University of California, Berkeley

United States

Time Zone

The program is currently displayed in (GMT-07:00) Pacific Time (US & Canada).

Use conference time zone: (GMT-07:00) Pacific Time (US & Canada)Select other time zone

The GMT offsets shown reflect the offsets at the moment of the conference.

Time Band

Display full programSpecify a time band

Save

Session Program

Fri 22 Mar
Displayed time zone: Pacific Time (US & Canada) change

15:00 - 17:00	Posters 3Posters at Exhibit Hall E - Posters Chair(s): Meghan Allen University of British Columbia, Ashish Aggarwal University of Florida

15:00 2h Talk		Analogies in Upper Division Computer Science Courses Posters Maria R. Ebling United States Military Academy, West Point, Ryan Dougherty United States Military Academy, Nicholas J. Clark United States Military Academy, West Point
15:00 2h Talk		The Potential of Humanitarian Applications to Increase Interest and Motivation of Underrepresented Student GroupsMSI Posters Lori Postner Nassau Community College, Heidi J.C. Ellis Western New England University, Gregory W. Hislop Drexel University, Philadelphia, PA, USA, Wesley Shumar Drexel University
15:00 2h Talk		Supporting Mastery Learning Through an Adaptive Grade Portal Posters Connor Bernard University of California, Berkeley, Dev Ahluwalia University of California, Berkeley, Madelen Flores University of California, Berkeley, Wilson Chu University of California, Berkeley, Yuanhan Li University of California, Berkeley, Dan Garcia UC Berkeley
15:00 2h Talk		Achieving Diversity in AI-focused Graduate Research Traineeships Posters Cecilia O. Alm Rochester Institute of Technology, Esa Rantanen Dept. of Psychology, Kristen Shinohara School of Information, Ferat Sahin Dept. of Electrical and Microelectronic Engineering, Chelsea Baileyshea Compass Evaluation, Reynold Bailey Rochester Institute of Technology
15:00 2h Talk		Why Learn This? Visualizing Pathways between CS Course Topics and Careers Posters Stacey Levine Georgia State University, Anu Bourgeois Georgia State University
15:00 2h Talk		Special education teachers evaluating the accessibility of CS educational robotics Posters Andrew B. Bennett University of Florida, Maya Israel University of Florida, Joanne R. Barrett University of Florida, Debra Kelly Thomas Broward County School District, Jason McKenna VEX Robotics
15:00 2h Talk		Exploring Technology for Accessibility Through a First-Year Writing Seminar Posters Pamela Cutter Kalamazoo College
15:00 2h Talk		Understanding the Role of Temperature in Diverse Question Generation by GPT-4 Posters Arav Agarwal Carnegie Mellon University, Karthik Mittal Carnegie Mellon University, Aidan Doyle Carnegie Mellon University, Pragnya Sridhar Carnegie Mellon University, Zipiao Wan Carnegie Mellon University, Jacob Doughty Carnegie Mellon University, Jaromir Savelka Carnegie Mellon University, Majd Sakr Carnegie Mellon University
15:00 2h Talk		Learning Software Engineering Principles with Program Wars v.3.0Global Posters Md. Hasan Tareque University of Lethbridge, John Anvik University of Lethbridge
15:00 2h Talk		Embracing Mathematical Conjecture Through Coding and Computational Thinking Posters Sarah Castle University of Idaho
15:00 2h Talk		Using Concept Maps for Notional Machine Selection in CS1 Posters Ethan Richards Colorado School of Mines, Sonia Spindt Cherry Creek Schools, Gabriel Fierro Colorado School of Mines
15:00 2h Talk		Augmenting Computer Science Undergraduate TA Training Programs to Benefit Recruitment, Refinement, and Retention Posters Julie Gawenda University of Illinois Chicago, Adam Koehler University of Illinois Chicago, Agne Nakvosaite University of Illinois Chicago
15:00 2h Talk		Implementation and Evaluation of Equitable Practices in an Introductory CS Course Posters Nadia Najjar University of North Carolina at Charlotte, Debarati Basu Embry-Riddle Aeronautical University
15:00 2h Talk		Supporting Instructors Adoption of Peer Instruction Posters Xingjian Gu University of Michigan, Barbara Ericson University of Michigan, Zihan Wu University of Michigan
15:00 2h Talk		Barriers to Equitable CS Expansion: Perceptions of Secondary Teachers of Computer Science during COVID-19 Posters Robert Schwarzhaupt American Institutes for Research, Ryan Torbey American Institutes for Research, Bridina Lemmer American Institutes for Research, Joseph Wilson American Institutes for Research
15:00 2h Talk		Circuit Tiles: Mixing Culture, Crafts, and Circuits to Inspire Diversity in Computing Posters Maria Lopez-Delgado University of Maryland, Baltimore County
15:00 2h Talk		Introducing Theoretical Computer Science Education in Social Sciences and Economics DegreesGlobal Posters Rafael del Vado Vírseda Universidad Complutense de Madrid
15:00 2h Talk		Impacts of Academic Preparedness on CS1 Performance Posters Barbara Martinez Neda University of California, Irvine, Flor Morales University of California, Irvine, Kitana Carbajal Juarez University of California, Irvine, Jennifer Wong-Ma University of California, Irvine, Sergio Gago-Masague University of California, Irvine
15:00 2h Talk		A Systematic Literature Mapping of COVID-19 Papers in Computer Science EducationGlobal Posters Brian Harrington University of Toronto Scarborough, Sharon Alex University of Toronto Scarborough, Leon Lee University of Toronto Scarborough, Colin Lin University of Toronto Scarborough, Zixiao Ren University of Toronto Scarborough, Youxin Tan University of Toronto Scarborough, Conroy Trinh University of Toronto Scarborough, shengsong xu University of Toronto Scarborough, Austin Yang University of Toronto Scarborough
15:00 2h Talk		Web-based Course Assessment System of Student Learning Outcomes: A Pilot Study Posters Daniel Ojeda Kean University, Patricia Morreale Kean University, Daehan Kwak Kean University
15:00 2h Talk		An LLM-based Reflection Analysis Tool for Identifying and Addressing Challenging Topics Posters Nasrin Dehbozorgi Kennesaw State University, Mourya Teja Kunuku Kennesaw State University
15:00 2h Talk		Programming Language Knowledge Transfer that Teachers Observe in their Classrooms Posters Jennifer Houchins WestEd, Rosalind Owen WestEd, Bryan Matlen WestEd, Yvonne Kao WestEd
15:00 2h Talk		Should we teach computing ethics to master's students? Posters Grace Barkhuff Georgia Institute of Technology, Judith Uchidiuno Georgia Institute of Technology, Ellen Zegura Georgia Institute of Technology
15:00 2h Talk		Validation of a Bebras-Based Test to Assess Computational Thinking Abilities in First-Year College StudentsGlobal Posters Federico Meza Universidad Técnica Federico Santa María, Andrea Vásquez Universidad Técnica Federico Santa María, Daniel San Martín Universidad Técnica Federico Santa María
15:00 2h Talk		Incorporating Retakes in a Robotics Class with Labs Posters Janine Hoelscher University of North Carolina at Chapel Hill, Bryce Ikeda University of North Carolina at Chapel Hill, Daniel Szafir University of North Carolina at Chapel Hill, Ron Alterovitz University of North Carolina at Chapel Hill
15:00 2h Talk		A Comparative Analysis of Tools & Task Types for Measuring Computational Problem-SolvingGlobal Posters Engin Bumbacher HEP Vaud, Jérôme Brender EPFL, Richard Davis EPFL
15:00 2h Talk		More than a checklist: Redesigning a UI/UX curriculum to emphasize accessibility Posters Talie Massachi Brown University
15:00 2h Talk		Engaging Students from Rural Communities in AI Education with Game-Based Learning Posters Alex Goslen North Carolina State University, Anisha Gupta North Carolina State University, Smrithi Muthukrishnan North Carolina State University, Raven Midgett North Carolina State University, Wookhee Min North Carolina State University, Jessica Vandenberg North Carolina State University, Veronica Catete North Carolina State University, Bradford Mott North Carolina State University
15:00 2h Talk		Motivating and Increasing the Relevance of Elementary Computer Science in Rural Communities Posters Dajung Diana Oh American Institutes for Research, Kathryn M. Rich American Institutes for Research, Katie Bosch-Wilson Idaho STEM Action Center, Heather Cunningham Boot Up Professional Development
15:00 2h Talk		Programming Assignment Ungrading as a License to Learn: Implementing Specifications Grading in the Undergraduate Web Development ClassroomGlobal Posters Raghav V. Sampangi Dalhousie University, Eric Poitras Dalhousie University, Mayra Barrera Machuca Dalhousie University
15:00 2h Talk		Developing Interactive Exercise Materials for Machine Learning Using SpreadsheetsGlobal Posters Atsuhiko Maeda Kanagawa Institute of Technology
15:00 2h Talk		Enhancing Programming Education through Game-Based Learning: Design and Implementation of a Puyo Puyo–Inspired Teaching ToolGlobal Posters TIAN RUOCHEN Waseda University, Daisuke Saito Takachiho University, Hironori Washizaki Waseda University, Yoshiaki Fukazawa Waseda University, Hiroshi Kobayashi System Information Co.,Ltd, Ayumi Tsuji System Information Co.,Ltd
15:00 2h Talk		Towards Reuse of Resources and Replication of Results to Improve Instruction on Refactoring Conditionals for Novice Programmers Posters Cecily Heiner Oregon Institute of Technology, Dana Nelson Oregon Institute of Technology
15:00 2h Talk		Support Patterns in Classrooms Implementing a Computer Science and Physical Computing Curriculum Posters Nga Hoang University of Colorado Boulder, Jeffrey Bush University of Colorado Boulder, Indrani Dey University of Wisconsin-Madison
15:00 2h Talk		Use of Large Language Models for Extracting Knowledge Components in CS1 Programming Exercises Posters Rose Niousha University of California, Berkeley, Muntasir Hoq North Carolina State University, Bita Akram North Carolina State University, Narges Norouzi University of California, Berkeley
15:00 2h Talk		Supporting Mastery Learning with Flexible Extensions Posters Yuerou Tang University of California, Berkeley, Jacob Yim UC Berkeley, Jordan Schwartz UC Berkeley, Madison Bohannan UC Berkeley, Dana Benedicto UC Berkeley, Charisse Liu Stanford University, Armando Fox UC Berkeley, Lisa Yan University of California, Berkeley, Narges Norouzi University of California, Berkeley
15:00 2h Talk		Exploring Collaboration as a Bridge to K-8 CS Integration Posters Justin Cannady University of Minnesota - Twin Cities, Jennifer Rosato College of St. Scholastica, Paul Schonfeld University of Minnesota - Twin Cities
15:00 2h Talk		Community Building and Joyful Learning in Computer Science Education Through Online At-Scale Seminars Posters Ana Rusch Georgia Institute of Technology, Eric Ianni Georgia Institute of Technology
15:00 2h Talk		Cracking the Cultural Code: Understanding the Cultural Barriers for Asian International CS Students in the US Posters Sandeep Sthapit North Carolina State University, Madison Thomas North Carolina State University, Janet Brock North Carolina State University, Tiffany Barnes North Carolina State University
15:00 2h Talk		The Relationships Between Modality, Peer Instruction Discussion, and Class Sentiment in Hybrid Courses Posters Salma El Otmani Duke University, Janet Jiang Duke University, Shao-Heng Ko Duke University, Kristin Stephens-Martinez Duke University