Intersectional Biases Within an Introductory Computing AssessmentMSI
Assessments that can measure student understanding of concepts in a reliable and valid way are incredibly valuable in research. Unfortunately, assessments can be a source of bias, differentially impacting students along various demographic lines. Differential Item Functioning (DIF) is a method to explore assessment bias. However, DIF is primarily limited to a single binary demographic variable (e.g. white and non-white; male and female). In this paper, we describe a novel expansion of DIF methods to explore intersections of student identities. We demonstrate the use of classic DIF on a data set of 255 complete responses to a CS1 assessment using binary race and gender variables in our analyses. Then, we present the importance of intersectional DIF by running a similar analysis on intersectional data. Using these methods, we identify problematic items on the assessment that bias against certain groups of test-takers. Our work contributes an innovative method to help interpret assessment results and inform changes to assessments.
Sat 23 MarDisplayed time zone: Pacific Time (US & Canada) change
10:45 - 12:00 | |||
10:45 25mTalk | Fostering Race-Conscious Literacies in Computer Science Teacher EducationMSI Papers Sukanya Kannan Moudgalya University of Tennessee, Knoxville DOI | ||
11:10 25mTalk | Intersectional Biases Within an Introductory Computing AssessmentMSI Papers Miranda Parker San Diego State University, He Ren University of Washington, Min Li University of Washington, Chun Wang University of Washington DOI | ||
11:35 25mTalk | U.S. Latines in Computing: A Literature ReviewMSI Papers Ismael Villegas Molina University of California, San Diego, Audria Montalvo University of California, San Diego, Adalbert Gerald Soosai Raj University of California, San Diego DOI |