Asee peer logo

Creating a Concept Inventory - Lessons Learned

Download Paper |

Conference

2018 ASEE Annual Conference & Exposition

Location

Salt Lake City, Utah

Publication Date

June 23, 2018

Start Date

June 23, 2018

End Date

July 27, 2018

Conference Session

Assessment and Research Tools

Tagged Division

Educational Research and Methods

Page Count

12

Permanent URL

https://peer.asee.org/30231

Download Count

26

Request a correction

Paper Authors

biography

Nancy E. Study Pennsylvania State University, Erie (Behrend College)

visit author page

Dr. Nancy E. Study is on the faculty of the School of Engineering at Penn State Behrend where she teaches courses in engineering graphics and rapid prototyping, and is the coordinator of the rapid prototyping lab. Her research interests include visualization, standardization of CAD practices, and haptics. Nancy is a former chair of the ASEE Engineering Design Graphics Division and is currently the Circulation Manager and Treasurer of the Engineering Design Graphics Journal. She received her B.S. from Missouri State University, and M.S. and Ph.D. from Purdue University.

visit author page

biography

Steven Nozaki Pennsylvania State University, Erie (Behrend College) Orcid 16x16 orcid.org/0000-0003-4733-246X

visit author page

Ph.D. Engineering Education - Pennsylvania State University, Erie (Behrend College)

visit author page

biography

Sheryl A. Sorby University of Cincinnati

visit author page

Dr. Sheryl Sorby is currently a Professor of STEM Education at the University of Cincinnati and was recently a Fulbright Scholar at the Dublin Institute of Technology in Dublin, Ireland. She is a professor emerita of Mechanical Engineering-Engineering Mechanics at Michigan Technological University and the P.I. or co-P.I. on more than $14M in grant funding, most for educational projects. She is the former Associate Dean for Academic Programs in the College of Engineering at Michigan Tech and she served at the National Science Foundation as a Program Director in the Division of Undergraduate Education from January 2007 through August 2009. Prior to her appointment as Associate Dean, Dr. Sorby served as chair of the Engineering Fundamentals Department at Michigan Tech. She received a B.S. in Civil Engineering, an M.S. in Engineering Mechanics, and a Ph.D. in Mechanical Engineering-Engineering Mechanics, all from Michigan Tech. Dr. Sorby has a well-established research program in spatial visualization and is actively involved in the development of various educational programs.

visit author page

biography

Mary A. Sadowski Purdue University, West Lafayette (Polytechnic Institute)

visit author page

Mary A. Sadowski has been at Purdue since 2003 and until September 1, 2011 served as the Associate Dean for Undergraduate Programs and Learning in the Purdue College of Technology where she provided leadership for strategic initiatives in undergraduate education. She was Dean of Purdue Extended Campus from 2011 to 2015 and professor of Computer Graphics from 2015 -2017 when she officially retired from Purdue.

As a professor of Computer Graphics, her research interests include enhancing visualization skills, creative thinking, and learning styles. She developed a Delphi instrument to gather data to create a concept inventory for engineering graphics and has worked with a team to develop and test the fully developed Engineering Graphics concept inventory. As a professor at both Purdue University and Arizona State University, Mary's specialty is computer and technical graphics. Dr. Sadowski received her B.S. from Bowling Green State University, her M.S. from The Ohio State University, and her Ph.D. from Purdue University.

visit author page

biography

Heidi M. Steinhauer Embry-Riddle Aeronautical Univ., Daytona Beach

visit author page

Heidi M. Steinhauer is a Professor of Engineering, Department Chair of the Engineering Fundamentals Department, co-advisor for the only all-women’s Baja SAE Team, Founding Member of FIRST (Female Initiative Reaching Success Together), and former director for GEMS (Girls in Engineering, Math, and Science). Dr. Steinhauer’s awards include the ABET Presidential Award of Diversity and a three time winner of the Women’s Vision Award. She has presented papers at ASEE Annual Conference, the ASEE Global Colloquium, Research in Engineering Education Symposium, Engineering Design Graphics Division Mid-Year Conference, Additive Manufacturers Users Group, and Solid Free-Form Fabrication Symposium. Her research interests center around the development and assessment of students’ spatial visualization skills, the effective integration of 3D modeling into engineering design, and the impact of contextualized hands-on applications on student learning and success. She has taught Engineering Graphics, Introduction to Engineering Design, Automation and Rapid Prototyping, and has developed several advanced applications of 3D modeling courses. Dr. Steinhauer received her B.S. in Aircraft Engineering and her M.S. in Systems Engineering, and her Ph.D. in Engineering Education from Virginia Tech.

visit author page

biography

Ronald L. Miller Colorado School of Mines

visit author page

Ronald L. Miller is a professor of chemical engineering and Director of the Center for Engineering Education at the Colorado School of Mines, where he has taught chemical engineering and interdisciplinary courses and conducted engineering education research for the past 26 years. Miller has received three university-wide teaching awards and has held a Jenni teaching fellowship at CSM. He has received grant awards for education research from the National Science Foundation, the U.S. Department of Education FIPSE program, the National Endowment for the Humanities, and the Colorado Commission on Higher Education and has published widely in engineering education literature. His research interests include measuring and repairing engineering student misconceptions in thermal and transport science.

visit author page

biography

Kaloki Nabutola Embry-Riddle Aeronautical Univ., Daytona Beach

visit author page

I am currently pursuing a Ph. D. in Mechanical Engineering at Embry-Riddle Aeronautical University focusing on heat transfer. I am also a graduate research assistant for the Engineering Fundamentals department. I have earned a Master of Science in Mechanical Engineering (CFD and Heat Transfer) and a Bachelor of Science in Aerospace Engineering (Propulsion) from Embry-Riddle Aeronautical University, Florida.

visit author page

Download Paper |

Abstract

A concept inventory is an instrument that helps identify concepts that students do not understand and identify which misconceptions are the most common. Since the development of the first concept inventory (the Force Concept Inventory in Physics education), a number of other instruments have been created in a variety of engineering subjects. For example, there are currently Concept Inventories in thermodynamics, heat transfer, and statics. The use of Concept Inventories has spurred educational reform in a wide range of settings and Concept Inventories have also been used in course development to identify potential topics for inclusion and to aid in assessment of course outcomes.

At the start of this project, there was no nationally normed and validated instrument for engineering graphics so a group of graphics professionals set out to create one with support from the National Science Foundation. The engineering graphics CI is currently on its gamma (third) version of the “final” document, over five years from when we began work on it. Since Concept Inventories have existed in engineering education research for more than 20 years, there are many publications describing the methods used in creating the instruments. For this project, we followed a previously established procedure called the “Assessment Triangle.” This paper will discuss the many valuable lessons learned along the way in the creation of the graphics Concept Inventory and will also describe pitfalls to avoid for anyone wishing to develop a Concept Inventory in the future.

Study, N. E., & Nozaki, S., & Sorby, S. A., & Sadowski, M. A., & Steinhauer, H. M., & Miller, R. L., & Nabutola, K. (2018, June), Creating a Concept Inventory - Lessons Learned Paper presented at 2018 ASEE Annual Conference & Exposition , Salt Lake City, Utah. https://peer.asee.org/30231

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2018 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015