Think-Aloud Insights: Exploring QuantCrit Challenges and Diverse Survey Responses Among Undergraduate Engineering Students

Sheila Kathryn Castro; Bruce Frederick Carroll; Janice Mejía; Kent J. Crippen

Download Paper | Permalink

Conference: 2025 Collaborative Network for Engineering & Computing Diversity (CoNECD)
Location: San Antonio, Texas
Publication Date: February 9, 2025
Start Date: February 9, 2025
End Date: February 11, 2025
Conference Session: CANCELLED: Track 5: Technical Session 6: Think-Aloud Insights: Exploring QuantCrit Challenges and Diverse Survey Responses Among Undergraduate Engineering Students
Tagged Topics: Diversity and 2025 CoNECD Paper Submissions
Page Count: 14
Permanent URL: https://peer.asee.org/54121
Download Count: 3

Paper Authors

biography

Sheila Kathryn Castro University of Florida

visit author page

Sheila Castro is a doctoral student in Science Education at the University of Florida's School of Teaching and Learning. Her research focuses on Latina's STEM identity, family support, and influences on the experiences of undergraduate engineering students.

visit author page

biography

Bruce Frederick Carroll University of Florida orcid.org/0000-0003-1747-8951

visit author page

Dr. Carroll is an Associate Professor of Mechanical and Aerospace Engineering at the University of Florida. He holds an affiliate appointment in Engineering Education. His research interests include engineering identity, self-efficacy, and matriculation of Latine/x/a/o students to graduate school. He works with survey methods and overlaps with machine learning using quantitative methods and sequential mixed methods approaches.

visit author page

biography

Janice Mejía Northwestern University orcid.org/0000-0002-7913-3011

visit author page

Dr. Mejia is an Associate Professor of Instruction in the Department of Industrial Engineering and Management Sciences. She also teaches in the Design Thinking and Communication (DTC), Masters in Engineering Management (MEM), and College Prep programs. Her research interests focus on mixed methods research in engineering education, curriculum assessment and development, and engineering identity.

visit author page

biography

Kent J. Crippen University of Florida orcid.org/0000-0002-8981-2376

visit author page

Kent Crippen is a Professor of STEM education in the School of Teaching and Learning at the University of Florida and a Fellow of the American Association for the Advancement of Science.

visit author page

Download Paper | Permalink

Abstract

Latina engineering students are less likely to attend graduate school than women from other ethnic or racial groups. This trend was observed in the Mechanical and Aerospace Engineering department of a large land-grant university for which Latine comprise approximately 20% of the engineering undergraduate enrollment. However, such statistics lack meaning without historical, racial, social, and political context. This paper, part of a larger research project, challenges deficit perspectives using an exploratory mixed methods approach. We combined Tinto’s Collegiate Achievement Model and Yosso’s Community Cultural Wealth Model, following a quantitative critical (quantcrit) perspective, to design a survey on factors influencing undergraduate students’ decision about pursuing an engineering degree. Quancrit, a methodology that challenges deficit perspectives through critical theory, presents implementation challenges. This paper reports on think-aloud sessions with four undergraduate engineering students-- three White women and one Asian man-- sharing their processing of the survey questions to guide the survey instrument development. Low recruitment of Latina participants highlighted the difficulty of conducting equity-centered research with underrepresented communities. Understanding how students outside of our community of interest interpreted the survey questions, highlights the risk of generalizing results without context, potentially leading to incomplete conclusions. This paper discusses how the participants’ responses reveal the opportunities and constraints of creating and implementing a critical quantitative survey and how racial, ethnic, and gender identities influence students’ perceptions and responses. Preliminary findings showed that participants did not critically engage with questions related to culture and social identities, often responding with hypotheticals about how other students might answer. Students referenced solely their hometowns as their culture, prompting us to consider how Latine students might interpret these questions differently, given their potentially more nuanced understanding of the term “culture”. When asked if obtaining their degree would combat stereotypes related to their social identities, the students showed limited awareness of existing stereotypes, including those positively associated with dominant identities in engineering (e.g., White, Asian, male). They perceived combating stereotypes as a barrier to education, rather than a motivator or act of resilience. This limitation presumes students are aware of these stereotypes and how they operate within systems of power. The think-aloud responses also indicate a need to nuance quantcrit surveys to embed the complexities of intersectional identities. This is evident when the responses of White women students echoed post-feminist views that underrepresentation of women in engineering is an “old stereotype”, without acknowledging how intersectional identities (e.g., racial, ethnic, socioeconomic) are salient for their experiences and perceptions as engineering students. Using think-aloud feedback, we modified and distributed our survey, in which we identified three Latine students with whom we will conduct future think-aloud sessions. This paper contributes knowledge to the field by demonstrating that challenges of quantcrit are essential for developing robust critical research. Grounding our project with a quantcrit lens allows us to approach survey design and analysis with critical awareness and encourages continued use of qualitative methods to deepen our understanding of Latina engineering students’ college experiences.

Citation
Format

Castro, S. K., & Carroll, B. F., & Mejía, J., & Crippen, K. J. (2025, February), Think-Aloud Insights: Exploring QuantCrit Challenges and Diverse Survey Responses Among Undergraduate Engineering Students Paper presented at 2025 Collaborative Network for Engineering & Computing Diversity (CoNECD), San Antonio, Texas. https://peer.asee.org/54121

TY - CPAPER
AB - Latina engineering students are less likely to attend graduate school than women from other ethnic or racial groups. This trend was observed in the Mechanical and Aerospace Engineering department of a large land-grant university for which Latine comprise approximately 20% of the engineering undergraduate enrollment. However, such statistics lack meaning without historical, racial, social, and political context. This paper, part of a larger research project, challenges deficit perspectives using an exploratory mixed methods approach.
We combined Tinto’s Collegiate Achievement Model and Yosso’s Community Cultural Wealth Model, following a quantitative critical (quantcrit) perspective, to design a survey on factors influencing undergraduate students’ decision about pursuing an engineering degree. Quancrit, a methodology that challenges deficit perspectives through critical theory, presents implementation challenges. This paper reports on think-aloud sessions with four undergraduate engineering students-- three White women and one Asian man-- sharing their processing of the survey questions to guide the survey instrument development.
Low recruitment of Latina participants highlighted the difficulty of conducting equity-centered research with underrepresented communities. Understanding how students outside of our community of interest interpreted the survey questions, highlights the risk of generalizing results without context, potentially leading to incomplete conclusions. This paper discusses how the participants’ responses reveal the opportunities and constraints of creating and implementing a critical quantitative survey and how racial, ethnic, and gender identities influence students’ perceptions and responses.
Preliminary findings showed that participants did not critically engage with questions related to culture and social identities, often responding with hypotheticals about how other students might answer. Students referenced solely their hometowns as their culture, prompting us to consider how Latine students might interpret these questions differently, given their potentially more nuanced understanding of the term “culture”. When asked if obtaining their degree would combat stereotypes related to their social identities, the students showed limited awareness of existing stereotypes, including those positively associated with dominant identities in engineering (e.g., White, Asian, male). They perceived combating stereotypes as a barrier to education, rather than a motivator or act of resilience. This limitation presumes students are aware of these stereotypes and how they operate within systems of power.
The think-aloud responses also indicate a need to nuance quantcrit surveys to embed the complexities of intersectional identities. This is evident when the responses of White women students echoed post-feminist views that underrepresentation of women in engineering is an “old stereotype”, without acknowledging how intersectional identities (e.g., racial, ethnic, socioeconomic) are salient for their experiences and perceptions as engineering students.
Using think-aloud feedback, we modified and distributed our survey, in which we identified three Latine students with whom we will conduct future think-aloud sessions. This paper contributes knowledge to the field by demonstrating that challenges of quantcrit are essential for developing robust critical research. Grounding our project with a quantcrit lens allows us to approach survey design and analysis with critical awareness and encourages continued use of qualitative methods to deepen our understanding of Latina engineering students’ college experiences.

AU - Sheila Kathryn Castro
AU - Bruce Frederick Carroll
AU - Janice Mejía
AU - Kent J. Crippen
CY - San Antonio, Texas
DA - 2025/02/09
PB - ASEE Conferences
TI - Think-Aloud Insights: Exploring QuantCrit Challenges and Diverse Survey Responses Among Undergraduate Engineering Students
UR - https://peer.asee.org/54121
ER -