Cultivating an Inclusive Environment in Computer Science: Validity Evidence for a New Scale

Mary E Lockhart; Karen E Rambo-Hernandez

Download Paper | Permalink

Conference: 2023 ASEE Annual Conference & Exposition
Location: Baltimore , Maryland
Publication Date: June 25, 2023
Start Date: June 25, 2023
End Date: June 28, 2023
Conference Session: Computing and Information Technology Division (CIT) Technical Session 7
Tagged Division: Computing and Information Technology Division (CIT)
Tagged Topic: Diversity
Page Count: 23
DOI: 10.18260/1-2--42841
Permanent URL: https://peer.asee.org/42841
Download Count: 228

Paper Authors

biography

Mary E Lockhart Texas A&M University

visit author page

Mary E. "Betsy" Lockhart, Ph.D. is a Postdoctoral Research Associate at Texas A&M University. Her research focuses on what factors influence diverse students to choose and persist in STEM. Particularly, she is interested in the development and cultivation of students' STEM identities and the potential protective element these identities have in student retention. Dr. Lockhart graduated from Stephen F. Austin State University with a B.S. in Mathematics and Psychology. She then graduated from Texas A&M University with a M.S. in Mathematics and Ph.D. in Educational Psychology with a specialization in Research, Measurement and Statistics.

visit author page

biography

Karen E Rambo-Hernandez Texas A&M University orcid.org/0000-0001-8107-2898

visit author page

Karen E. Rambo-Hernandez is an associate professor at Texas A & M University in the College of Education and Human Development in the department of Teaching, Learning, and Culture. In her research, she is interested in the assessing STEM interventions on

visit author page

Download Paper | Permalink

Abstract

This research paper describes the development and initial validation of an instrument to measure students’ inclusive attitudes and behaviors within computer science and its sensitivity to intervention effects. The lack of diversity within computing degree programs and fields has been an ongoing concern for several years. National programs and initiatives have placed a high priority on broadening participation in computer science and making the computing culture more inclusive of women and ethnic groups typically underrepresented in computer science. Only small gains have been documented. In this study, a measure of university students’ valuing of diversity and willingness to act inclusively within engineering contexts— a field with similar diversity concerns — was adapted and modified specifically for computer science. The adaptation of this engineering-based scale, the Valuing Diversity and Enacting Inclusion in Engineering (VDEIE), for computer science (VDEI-CS) was considered applicable given the common practice of housing computer science departments within engineering colleges or schools and engineering having similar problems with underrepresentation. After adapting the scale, validation efforts utilizing confirmatory factor analysis and multiple indicators multiple causes structural equation modeling affirmed that the VDEI-CS produced valid and reliable scores to gauge measures of inclusion and diversity within computer science students. Next, a small pilot study was conducted to determine if the VDIE-CS was sensitive enough to detect the effect of a series of computer science interventions geared towards enhancing first-year students’ value of diversity and willingness to act inclusively in computing contexts. Though the study was preliminary, results of the multilevel analysis demonstrated promise that the VDEI-CS was sensitive enough to detect changes as students in the intervention group demonstrated statistically significantly greater gains in their willingness to challenge discriminatory behaviors than students in the control group. The primary purpose of this study is to relay to the computing research community a tool to assess student attitudes toward the value of diversity and inclusive behaviors in computing contexts that will enable researchers to gauge the temperature of a group of students and assess the effect of interventions developed to promote change within the culture.

Citation
Format

Lockhart, M. E., & Rambo-Hernandez, K. E. (2023, June), Cultivating an Inclusive Environment in Computer Science: Validity Evidence for a New Scale Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--42841

TY  - CPAPER
AB  - This research paper describes the development and initial validation of an instrument to measure students’ inclusive attitudes and behaviors within computer science and its sensitivity to intervention effects.  The lack of diversity within computing degree programs and fields has been an ongoing concern for several years.  National programs and initiatives have placed a high priority on broadening participation in computer science and making the computing culture more inclusive of women and ethnic groups typically underrepresented in computer science.  Only small gains have been documented.  In this study, a measure of university students’ valuing of diversity and willingness to act inclusively within engineering contexts— a field with similar diversity concerns — was adapted and modified specifically for computer science.  The adaptation of this engineering-based scale, the Valuing Diversity and Enacting Inclusion in Engineering (VDEIE), for computer science (VDEI-CS) was considered applicable given the common practice of housing computer science departments within engineering colleges or schools and engineering having similar problems with underrepresentation.  After adapting the scale, validation efforts utilizing confirmatory factor analysis and multiple indicators multiple causes structural equation modeling affirmed that the VDEI-CS produced valid and reliable scores to gauge measures of inclusion and diversity within computer science students.  Next, a small pilot study was conducted to determine if the VDIE-CS was sensitive enough to detect the effect of a series of computer science interventions geared towards enhancing first-year students’ value of diversity and willingness to act inclusively in computing contexts.  Though the study was preliminary, results of the multilevel analysis demonstrated promise that the VDEI-CS was sensitive enough to detect changes as students in the intervention group demonstrated statistically significantly greater gains in their willingness to challenge discriminatory behaviors than students in the control group.  The primary purpose of this study is to relay to the computing research community a tool to assess student attitudes toward the value of diversity and inclusive behaviors in computing contexts that will enable researchers to gauge the temperature of a group of students and assess the effect of interventions developed to promote change within the culture.
AU  - Mary E Lockhart
AU  - Karen E Rambo-Hernandez
CY  - Baltimore , Maryland
DA  - 2023/06/25
PB  - ASEE Conferences
TI  - Cultivating an Inclusive Environment in Computer Science: Validity Evidence for a New Scale 
UR  - https://peer.asee.org/42841
DO  - 10.18260/1-2--42841
ER  -