Asee peer logo

Initial Validation of Indirect Assessments tools for Connections and Creating Value for Entrepreneurial Minded Learning

Download Paper |

Conference

2025 ASEE Annual Conference & Exposition

Location

Montreal, Quebec, Canada

Publication Date

June 22, 2025

Start Date

June 22, 2025

End Date

August 15, 2025

Conference Session

ENT-2: Bridging Faculty and Student Perspectives in Entrepreneurial Education

Tagged Division

Entrepreneurship & Engineering Innovation Division (ENT)

Page Count

16

Permanent URL

https://peer.asee.org/56800

Download Count

2

Paper Authors

biography

Tyler James Stump The Ohio State University Orcid 16x16 orcid.org/0000-0002-1264-858X

visit author page

Tyler Stump is a second-year Ph.D. student in the Department of Engineering Education at The Ohio State University. Tyler received his B.S. in Biosystems Engineering at Michigan State University in 2022 and received his M.S. from Michigan State University in 2023. His engineering education interests include critical quantitative research methods, computing education, and assessment validation.

visit author page

biography

H. Schwab The Ohio State University

visit author page

H. Schwab is pursuing a B.S. in Chemical Engineering with a minor in Humanitarian Engineering at The Ohio State University. Involvement includes working as an Undergraduate Research Associate and Lead Undergraduate Teaching Associate for the Fundamentals of Engineering Program within the Department of Engineering Education. Research interests focus on sense of belonging, concept mapping, instrument content validation, and metacognition.

visit author page

biography

Sydney Cooper The Ohio State University

visit author page

Sydney Cooper is pursuing her B.S. in Biomedical Engineering at The Ohio State University. She is involved in the Department of Engineering Education as an Undergraduate Research Associate. Her research interests include inclusion in engineering.

visit author page

biography

Krista M Kecskemety The Ohio State University Orcid 16x16 orcid.org/0000-0003-1192-4172

visit author page

Krista Kecskemety is an Associate Professor in the Department of Engineering Education at The Ohio State University and the co-Director of the Fundamentals of Engineering Programs. Krista received her B.S. in Aerospace Engineering at The Ohio State University in 2006 and received her M.S. from Ohio State in 2007. In 2012, Krista completed her Ph.D. in Aerospace Engineering at Ohio State. Her engineering education research interests include investigating first-year engineering student experiences, faculty experiences, and the research to practice cycle within first-year engineering.

visit author page

Download Paper |

Abstract

This complete research paper explores the advancement of educational measurement tools for engineering courses incorporating entrepreneurial thinking. One common entrepreneurial pedagogical approach for entrepreneurial course design within engineering education is through Entrepreneurial Minded Learning (EML). The Entrepreneurial Minded Learning is a commonality shared between educators of the Kern Entrepreneurial Engineering Network (KEEN) that embraces entrepreneurial pedagogy through the 3Cs: curiosity, connections, and creating value. This project is a smaller component of a larger project exploring students’ conceptual understanding of the 3Cs both directly and indirectly. Therefore, this project focuses on the two indirect assessments for connections and creating value to equip engineering educators within entrepreneurial course contexts with novel assessment tools for educational interventions and their effect on students' conceptual understanding of connections and creating value within EML. The initial validation analysis was anchored in identifying face validity and content validity of the instrument. Expert reviews from reviewers with expertise in EML and/or item construction were collected for assessment items based on clarity, relevance, necessity, and accuracy for each item aligned to the two indirect assessments. Face validity, or the extent to which items appear associated with connections and creatin value at their face level, was constructed using quantitative statistical analyses for Item Face Validity Index, Universal Agreement Scale Validity Index, and Average Scale Face Validity Index. Content validity refers to the extent to which the instrument is associated with the construct of interest from an expert point of view. The content analysis validation is anchored in Item Content Validity Index, Universal Agreement Scale Content Validity Index, and Average Scale Content Validity Index as appropriate validity metrics. Benchmarks for inclusion factors in item reduction to improve the validation evidence of the instrument were informed by item construction best practices. Additionally, the strength of expert reviewers was identified using Fleiss κ statistical analyses to enhance the considerations within content validation. Benchmark values were informed by instrument construction best practices and psychometric instrumentation standards to support the reduction of items for both face validity analyses and content validation analyses to improve the instrument before investigating further validation investigations. This initial investigation into the validation of these instruments supports a larger endeavor to advance assessment tools for entrepreneurial engineering education. Equipping engineering educators with adequate and nuanced assessments tools could enhance the ways in which best EML practices in the classroom are evaluated with hopes of ultimately improving EML skillsets for engineering students entering professional practice

Stump, T. J., & Schwab, H., & Cooper, S., & Kecskemety, K. M. (2025, June), Initial Validation of Indirect Assessments tools for Connections and Creating Value for Entrepreneurial Minded Learning Paper presented at 2025 ASEE Annual Conference & Exposition , Montreal, Quebec, Canada . https://peer.asee.org/56800

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2025 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015