Asee peer logo

Using Natural Language Processing to Explore Undergraduate Students’ Perspectives of Social Class, Gender, and Race

Download Paper |

Conference

2022 ASEE Annual Conference & Exposition

Location

Minneapolis, MN

Publication Date

August 23, 2022

Start Date

June 26, 2022

End Date

June 29, 2022

Conference Session

Research Frameworks for Identity and Equity: Equity, Culture & Social Justice in Education Division Technical Session 9

Page Count

16

DOI

10.18260/1-2--41779

Permanent URL

https://peer.asee.org/41779

Download Count

293

Request a correction

Paper Authors

biography

Umair Shakir Virginia Polytechnic Institute and State University

visit author page

My academic background is a bachelor's and master's in civil engineering (University of Engineering Technology, Lahore, Pakistan), and Ph.D. (Engineering Education, VT, the USA, expected in Fall 2022). My ten years of professional experience range from NESPAK (5 years), to Dubai (1-years), and assistant professor (The University of Lahore-3 years). I am certified in Project Management Professional (PMP). During my Ph.D., I served as a graduate research assistant on NSF projects and a teaching assistant at the Department of Engineering Education, VT. I have analytical skills in python, and R studio. I am using the state of the art natural language processing techniques to analyze national scale qualitative data. My dissertation research is focused on Pell grants and accessibility to engineering colleges for underserved populations in the US. I aim to work on international donor education-related projects, particularly in Pakistan

visit author page

biography

Sarah Ovink Virginia Polytechnic Institute and State University

visit author page

Sarah M. Ovink is an Associate Professor of Sociology at Virginia Tech. Her research focuses primarily on inequalities in higher education pathways by race/ethnicity, gender, and income, using mixed methods of inquiry. Her publications have appeared in a variety of journals, including Gender & Society, Social Currents, and Research in Higher Education. She is a co-editor of the volume, Intersectionality and Higher Education: Identity and Inequality on College Campuses (2019, Rutgers University Press). She is the author of Race, Class and Choice in Latino/a Higher Education: Pathways in the College-for-All Era (2017, Palgrave Macmillan). She is the recipient of a 2015 NSF CAREER award, investigating intersectional inequalities in STEM and non-STEM undergraduate pathways. From 2016–2020, she was a co-PI of the Life Sciences Mentoring Program, which matched incoming life sciences majors with near-peer mentors to provide mentoring training. Dr. Ovink received her Bachelor of Arts in Sociology at Kalamazoo College, and her Master of Arts and Ph.D. in Sociology at the University of California, Davis. She lives in Blacksburg, VA with her husband Eric, two kids, and two dogs.

visit author page

author page

Andrew Katz Virginia Polytechnic Institute and State University

Download Paper |

Abstract

Groups within the engineering education community are enabling an environment for generating transformative scholarship and pedagogical practices to challenge existing systematic educational barriers for traditionally marginalized ethnic and socio-political identities. For example, the engineering education research community is creating research opportunities to compare perspectives of minority and majority students about institutional culture issues, e.g., equitable access to and success in engineering education spaces for minority students. Unfortunately, quantitative research methodologies may lose the subtle nuances of students’ experiences. On the other end of the methodological spectrum, qualitative research methodologies can capture the rich description of students’ experiences, yet those methods can be resource-intensive and have issues related to scalability and transferability. These logistics and intrinsic quality control issues in the qualitative research paradigm may be addressed by recent state of the art developments in the natural language processing (NLP). This study aims to use NLP tools to explore students’ perspectives of the role of social class, gender, and race in shaping their (and other students') college experiences

In this study, we sought to answer the following research question: How do undergraduate students describe the role of social class, gender, and race in shaping students’ college experiences in a higher education institution? This study publication was based on a research project that used a longitudinal qualitative research methodology. The research site was an R1, Mid-Atlantic university. For the first qualitative phase of the research project, in-depth semi-structured interviews were conducted with 113 undergraduate students at the university - 41 students were from engineering majors, and 72 were outside of engineering majors. Of the total 113, 5 % (6 out of 113), and 10% (12 out of 113) of the study sample reported their annual combined family income less than 25 thousand dollars, or more than 250 thousand dollars, respectively. This study publication analyzed a portion of those transcribed interviews that were pertinent to the role of social class, gender, and race in shaping students’ college experiences. With the help of an NLP, human-in-the-loop workflow, we took, embedded that text corpus, using a pre-trained transformer (a specific kind of neural network architecture trained to encode inputs and decode outputs), and perform a sequence of dimension reduction techniques capped with a final clustering step. The research team then utilized these groupings to perform a thematic analysis this interview is with a more nuanced understanding that only a human could do. Informed by an intersectionality lens, the results identified a wide variation (or complexity) in students’ perspectives of the role of social class, gender, and race in shaping their (and or other students') college experiences. In addition to findings about student beliefs and perspectives, this study also demonstrated the utility of NLP as a first pass on the raw text since it can help group similar responses together expeditiously. A researcher can then utilize these groupings to perform further analysis with more nuanced understanding that only a human could do.

Shakir, U., & Ovink, S., & Katz, A. (2022, August), Using Natural Language Processing to Explore Undergraduate Students’ Perspectives of Social Class, Gender, and Race Paper presented at 2022 ASEE Annual Conference & Exposition, Minneapolis, MN. 10.18260/1-2--41779

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2022 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015