Asee peer logo

Work in Progress: Validity and Reliability Testing of the Engineering Concept Assessment Modified for Eighth Grade

Download Paper |

Conference

2017 ASEE Annual Conference & Exposition

Location

Columbus, Ohio

Publication Date

June 24, 2017

Start Date

June 24, 2017

End Date

June 28, 2017

Conference Session

Predicting Student Success

Tagged Division

Educational Research and Methods

Page Count

10

Permanent URL

https://peer.asee.org/29189

Download Count

163

Request a correction

Paper Authors

biography

Kristin L. K. Koskey University of Akron

visit author page

Dr. Kristin Koskey is an Associate Professor in the LeBron James Family Foundation College of Education at The University of Akron. She holds a Ph.D. in Educational Research and Measurement and M.E. in Educational Psychology. Dr. Koskey teaches courses in evaluation, assessment, research design, and statistics. She also works as a psychometric consultant and serves on the Editorial Board for the journal of Psychological Assessment. Her work is published in leading journals such as Studies in Educational Evaluation, Journal of Applied Measurement, Journal of Mixed Methods Research, Journal of Experimental Education, International Journal of Qualitative Methods, and Educational and Psychological Measurement. Further, she has authored book chapters on Norming and Scaling for Automated Essay Scoring and Data-driven STEM Assessment. Dr. Koskey has secured grant funding from the Ohio Department of Education and National Science Foundation (NSF), as well as contributed to the evaluations on grants funded by the ODE, U.S. Department of State, and NSF.

visit author page

biography

Nicholas G. Garafolo University of Akron

visit author page

Dr. Nicholas G. Garafolo is a researcher in the broad area of thermo-fluids and aerospace, with an emphasis in advanced aerospace seals, near-hermetic fluid flows, and turbomachinery modal analysis. Dr. Garafolo currently holds a position as Assistant Professor at The University of Akron. Supporting the dissemination of his research activities, Dr. Garafolo has six journal manuscripts, over 30 conference papers and presentations, and $868,647 of total project funding. Prior to his appointment, Dr. Garafolo worked as a federal contractor, under the umbrella of a multi-million dollar contract, in space flight hardware research and development to NASA Glenn Research Center in Cleveland, Ohio. Dr. Garafolo was instrumental in developing a synergistic approach in the research and component modeling of elastomeric space seals for manned spaceflight; an asset to NASA and the development of advanced aerospace seals for the next generation of manned spacecraft. The unique problem necessitated a grasp of both fluid dynamics and material science, as well as experimental and computational analysis. As a DAGSI/Air Force Research Laboratory Ohio Student-Faculty Fellow, Dr. Garafolo gained experimental knowledge in structural dynamics of turbomachinery. In particular, his research on engine order excitation yielded insight into generating high cycle fatigue of turbomachinery using acoustic excitation.

visit author page

biography

Nidaa Makki University of Akron

visit author page

Dr. Nidaa Makki is an Associate Professor in the LeBron James Family Foundation College of Education at The University of Akron, in the department in Curricular and Instructional Studies. Her work focuses on STEM curriculum integration and science inquiry practices in middle and high school. She is a co-PI on an NSF funded project to investigate the impact of integrating engineering on middle school students’ interest and engagement in STEM. She has also received funding to conduct teacher professional development in the areas of engineering education, problem based learning and inquiry instruction.

visit author page

biography

Wondimu Ahmed University of Akron

visit author page

Dr. Wondimu Ahmed is an Assistant Professor in the LeBron James Family Foundation College of Education at the University of Akron. He received his Ph.D. from University of Groningen, The Netherlands. His research focuses on motivation and emotions in education, particularly in STEM subjects.

visit author page

biography

Donald P. Visco Jr. University of Akron

visit author page

Donald P. Visco, Jr. is the interim Dean in the College of Engineering at The University of Akron and Professor of Chemical & Biomolecular Engineering.

visit author page

author page

Uday Samreddy

Download Paper |

Abstract

This work in progress paper reports on the process of the modification and reliability and validity testing of the Engineering Concept Assessment (ECA; Daugherty, Custer, Brockway, & Spake, 2012) for eighth grade (ECA-M8). The purpose is for the research team to obtain feedback on the modification process prior to implementing the measure to approximately 1800 students across 11 middle schools in during the third and final year of the larger study. The process of the development of the ECA-M8 is outlined and the preliminary item analysis results are reported for the multiple-choice portion of the assessment.

Koskey, K. L. K., & Garafolo, N. G., & Makki, N., & Ahmed, W., & Visco, D. P., & Samreddy, U. (2017, June), Work in Progress: Validity and Reliability Testing of the Engineering Concept Assessment Modified for Eighth Grade Paper presented at 2017 ASEE Annual Conference & Exposition, Columbus, Ohio. https://peer.asee.org/29189

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2017 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015