Exploring the Impact of Generative AI for StandUp Report Recommendations in Software Capstone Project DevelopmentOnlineIn-Person
StandUp Reports play an important role in capstone software engineering courses, facilitating progress tracking, obstacle identification, and team collaboration. However, despite their significance, students often grapple with the challenge of creating StandUp Reports that are clear, concise, and actionable. This paper investigates the impact of the use of generative AI in producing StandUp report recommendations, aiming to assist students in enhancing the quality and effectiveness of their reports. In a semester-long capstone course, 179 students participated in 16 real-world software development projects. They submitted weekly StandUp Reports with the assistance of an AI-powered Slack, which analyzed their initial reports and provided suggestions for enhancing them using both GPT-3.5 and the early access GPT-4 API. After each submitted report, students voluntarily answered a survey about usability and suggestion preference. Furthermore, we conducted a linguistic analysis of the recommendations made by the algorithms to gauge reading ease and comprehension complexity. Our findings indicate that the AI-based recommendation system helped students improve the overall quality of their StandUp Reports throughout the semester. Students expressed a high level of satisfaction with the tool and exhibited a strong willingness to continue using it in the future. The survey reveals that students perceived a slight improvement when using GPT-4 compared to GPT-3.5 Finally, a computational linguistic analysis performed on the recommendations demonstrates that both algorithms significantly improve the alignment between the generated texts and the students’ educational level, thereby improving the quality of the original texts.
Fri 22 MarDisplayed time zone: Pacific Time (US & Canada) change
10:45 - 12:00 | Generative AIPapers at Meeting Room E146 Chair(s): Andreas Stefik University of Nevada at Las Vegas, USA | ||
10:45 25mTalk | Use of AI-driven Code Generation Models in Teaching and Learning Programming: a Systematic Literature ReviewOnlineGlobalIn-Person Papers DOI | ||
11:10 25mTalk | Exploring the Impact of Generative AI for StandUp Report Recommendations in Software Capstone Project DevelopmentOnlineIn-Person Papers Andres Neyem Computer Science Department, Pontificia Universidad Catolica de Chile, Juan Pablo Sandoval Alcocer Computer Science Department, Pontificia Universidad Catolica de Chile, Marcelo Mendoza Computer Science Department, Pontificia Universidad Catolica de Chile, Leonardo Centellas Computer Science Department, Pontificia Universidad Catolica de Chile, Luis Armando Gonzalez Pontificia Universidad Católica de Chile, Carlos Paredes Computer Science Department, Pontificia Universidad Catolica de Chile DOI | ||
11:35 25mTalk | ChatGPT in the Classroom: An Analysis of Its Strengths and Weaknesses for Solving Undergraduate Computer Science QuestionsOnlineIn-Person Papers Ishika Joshi Indraprastha Institute of Information Technology, Delhi, Ritvik Budhiraja Indraprastha Institute of Information Technology, Delhi, Harshal Dev Indraprastha Institute of Information Technology, Delhi, Jahnvi Kadia Indraprastha Institute of Information Technology, Delhi, M. Osama Ataullah Indraprastha Institute of Information Technology, Delhi, Sayan Mitra Indraprastha Institute of Information Technology, Delhi, Harshal D. Akolekar Indian Institute of Technology, Jodhpur, Dhruv Kumar Indraprastha Institute of Information Technology, Delhi DOI |