SIGCSE TS 2024 (series) / Posters /
Enhancing Code Tracing Question Generation with Refined Prompts in Large Language Models
Sat 23 Mar 2024 10:00 - 12:00 at Exhibit Hall E - Posters - Posters 4 Chair(s): Meghan Allen, Ashish Aggarwal
This study refines Large Language Models (LLMs) prompts to enhance the generation of code tracing questions, where the new expert-guided prompts consider features identified from prior research. Expert evaluations compared new LLM-generated questions against previously preferred ones, revealing improved quality in aspects like complexity and concept coverage. While providing insights into effective question generation and affirming LLMs’ potential in educational content creation, the study also contributes an expert-evaluated question dataset to the computing education community. However, generating high-quality reverse tracing questions remains a nuanced challenge, indicating a need for further LLM prompting refinement.
Sat 23 MarDisplayed time zone: Pacific Time (US & Canada) change
Sat 23 Mar
Displayed time zone: Pacific Time (US & Canada) change