Montreal, Quebec, Canada
June 22, 2025
June 22, 2025
August 15, 2025
ENT-2: Bridging Faculty and Student Perspectives in Entrepreneurial Education
Entrepreneurship & Engineering Innovation Division (ENT)
16
https://peer.asee.org/56800
2
Tyler Stump is a second-year Ph.D. student in the Department of Engineering Education at The Ohio State University. Tyler received his B.S. in Biosystems Engineering at Michigan State University in 2022 and received his M.S. from Michigan State University in 2023. His engineering education interests include critical quantitative research methods, computing education, and assessment validation.
H. Schwab is pursuing a B.S. in Chemical Engineering with a minor in Humanitarian Engineering at The Ohio State University. Involvement includes working as an Undergraduate Research Associate and Lead Undergraduate Teaching Associate for the Fundamentals of Engineering Program within the Department of Engineering Education. Research interests focus on sense of belonging, concept mapping, instrument content validation, and metacognition.
Sydney Cooper is pursuing her B.S. in Biomedical Engineering at The Ohio State University. She is involved in the Department of Engineering Education as an Undergraduate Research Associate. Her research interests include inclusion in engineering.
Krista Kecskemety is an Associate Professor in the Department of Engineering Education at The Ohio State University and the co-Director of the Fundamentals of Engineering Programs. Krista received her B.S. in Aerospace Engineering at The Ohio State University in 2006 and received her M.S. from Ohio State in 2007. In 2012, Krista completed her Ph.D. in Aerospace Engineering at Ohio State. Her engineering education research interests include investigating first-year engineering student experiences, faculty experiences, and the research to practice cycle within first-year engineering.
This complete research paper explores the advancement of educational measurement tools for engineering courses incorporating entrepreneurial thinking. One common entrepreneurial pedagogical approach for entrepreneurial course design within engineering education is through Entrepreneurial Minded Learning (EML). The Entrepreneurial Minded Learning is a commonality shared between educators of the Kern Entrepreneurial Engineering Network (KEEN) that embraces entrepreneurial pedagogy through the 3Cs: curiosity, connections, and creating value. This project is a smaller component of a larger project exploring students’ conceptual understanding of the 3Cs both directly and indirectly. Therefore, this project focuses on the two indirect assessments for connections and creating value to equip engineering educators within entrepreneurial course contexts with novel assessment tools for educational interventions and their effect on students' conceptual understanding of connections and creating value within EML. The initial validation analysis was anchored in identifying face validity and content validity of the instrument. Expert reviews from reviewers with expertise in EML and/or item construction were collected for assessment items based on clarity, relevance, necessity, and accuracy for each item aligned to the two indirect assessments. Face validity, or the extent to which items appear associated with connections and creatin value at their face level, was constructed using quantitative statistical analyses for Item Face Validity Index, Universal Agreement Scale Validity Index, and Average Scale Face Validity Index. Content validity refers to the extent to which the instrument is associated with the construct of interest from an expert point of view. The content analysis validation is anchored in Item Content Validity Index, Universal Agreement Scale Content Validity Index, and Average Scale Content Validity Index as appropriate validity metrics. Benchmarks for inclusion factors in item reduction to improve the validation evidence of the instrument were informed by item construction best practices. Additionally, the strength of expert reviewers was identified using Fleiss κ statistical analyses to enhance the considerations within content validation. Benchmark values were informed by instrument construction best practices and psychometric instrumentation standards to support the reduction of items for both face validity analyses and content validation analyses to improve the instrument before investigating further validation investigations. This initial investigation into the validation of these instruments supports a larger endeavor to advance assessment tools for entrepreneurial engineering education. Equipping engineering educators with adequate and nuanced assessments tools could enhance the ways in which best EML practices in the classroom are evaluated with hopes of ultimately improving EML skillsets for engineering students entering professional practice
Stump, T. J., & Schwab, H., & Cooper, S., & Kecskemety, K. M. (2025, June), Initial Validation of Indirect Assessments tools for Connections and Creating Value for Entrepreneurial Minded Learning Paper presented at 2025 ASEE Annual Conference & Exposition , Montreal, Quebec, Canada . https://peer.asee.org/56800
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2025 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015