Minneapolis, MN
August 23, 2022
June 26, 2022
June 29, 2022
17
10.18260/1-2--40872
https://peer.asee.org/40872
444
Adrian Nat Gentry is a Ph.D. student at Purdue University in Engineering Education. They completed their undergraduate degree in Materials Engineering from Purdue in May 2020. Adrian’s research interests include assessing student supports in cooperative education programs and the experiences and needs of nonbinary scientists. Adrian is involved with Purdue’s Engineering Education Graduate Association and is president of the oSTEM chapter at Purdue.
Dr. Kerrie Douglas, Assistant Professor of Engineering Education at Purdue, studies how to improve the quality of classroom assessments and evaluation of online learning in a variety of engineering education contexts. She holds a PhD in Educational Psychology and a M.A. in Educational Studies, with focus on school counseling. She is a co-PI on the SCALE project, leading the evaluation and assessment efforts. She recently received an NSF award to study engineering instructor decisions and student support during COVID-19 and impact the pandemic is having on engineering students. She also recently won the prestigious CAREER award from the U.S. National Science Foundation to study increasing the fairness of engineering assessments. In total, she has been on the leadership of more than $24 million dollars in research awards. Her research on evaluation of online learning (supported by two NSF awards #1544259,1935683, ) has resulted in more than 20 peer-reviewed conference and journal publications related to engineering learners in online courses. She was a FutureLearn Research Fellow from 2017-2019; a 2018 recipient of the FIE New Faculty Fellow Award and was the 2021 Program Chair for the Educational Research Methods Division of ASEE.
Microelectronics play an increasingly important role in a wide range of technologies, which include not just computers but many consumer, business, and defense capabilities. To ensure a reliable source of microelectronic chips in the future, it is crucial to train an increasing number of students in this area and to foster their connection with the industry and government employers. As training programs are being stood up now, it is important to determine whether they are effective in meeting these goals. Our team modified an existing assessment of students’ exposure and motivation to focus explicitly on topics in microelectronics. The purpose of this paper is to evaluate validity evidence in terms of item functioning and factor structure. Specifically, we ask: 1) To what extent do the Exposure and Motivation items function as intended (i.e., items written to be exposure factor together and items written at motivation factor together); 2) To what extent are the items measuring Exposure and Motivation in microelectronics in a sensitive way (i.e., the items are able to detect the expected variance among students)? The assessment was administered as a pre- and post-survey to undergraduate engineering students in an introductory engineering design course (n = 508). Confirmatory factor analysis (CFA) was performed to compare the model fit for several models. Results from the CFA in terms of factor structure and goodness of fit confirm the two scales, Exposure and Motivation, are consistent with the original instrument. An item response theory (IRT) model was found, which indicated the two scales can sensitively measure differing levels of motivation and exposure. This study provides an assessment with validity evidence that it can be adapted for different technical areas and still provide meaningful information regarding students’ exposure and motivation in a specific area.
Gentry, A., & Bermel, P., & Holloway, E., & Douglas, K. (2022, August), Validity Evidence for Exposure and Motivation Scales in a Microelectronics Workforce Development Program Paper presented at 2022 ASEE Annual Conference & Exposition, Minneapolis, MN. 10.18260/1-2--40872
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2022 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015