Minneapolis, MN
August 23, 2022
June 26, 2022
June 29, 2022
20
10.18260/1-2--40791
https://peer.asee.org/40791
545
Hillary Merzdorf is a Ph.D. candidate at Purdue University in the School of Engineering Education. Her research interests are in flexible assessment practices incorporating both traditional psychometrics and technology-based approaches, digital engineering education tools, and cognitive engineering methods for learning research.
Dr. Kerrie Douglas, Assistant Professor of Engineering Education at Purdue, studies how to improve the quality of classroom assessments and evaluation of online learning in a variety of engineering education contexts. She holds a PhD in Educational Psychology and a M.A. in Educational Studies, with focus on school counseling. She is a co-PI on the SCALE project, leading the evaluation and assessment efforts. She recently received an NSF award to study engineering instructor decisions and student support during COVID-19 and impact the pandemic is having on engineering students. She also recently won the prestigious CAREER award from the U.S. National Science Foundation to study increasing the fairness of engineering assessments. In total, she has been on the leadership of more than $24 million dollars in research awards. Her research on evaluation of online learning (supported by two NSF awards #1544259,1935683, ) has resulted in more than 20 peer-reviewed conference and journal publications related to engineering learners in online courses. She was a FutureLearn Research Fellow from 2017-2019; a 2018 recipient of the FIE New Faculty Fellow Award and was the 2021 Program Chair for the Educational Research Methods Division of ASEE.
Sketching is a valuable skill in engineering for representing information, developing design ideas, and communicating technical and abstract information. As a precursor to computer-based visualization skills, sketching is an important means of developing spatial abilities which are predictive of success in STEM fields. Mental imagery broadly describes the ability to internally conceptualize and crystallize an image. In particular, mental rotation is key in engineering graphics for visualizing objects from multiple perspectives, as in orthographic projection. The Revised Purdue Spatial Visualization Test: Rotations shows symmetrical and asymmetrical objects from multiple isometric perspectives, and students select the consistent view. The Mental Rotation Test rotates irregular shapes on an axis, and students select the correct rotation. While both tests are highly predictive of engineering visualization skills, spatial ability research and its link to engineering drawing often uses them as intervention outcome measures, without directly assessing sketching ability. Our new test examines sketching skills with object assembly tasks using mental imagery and mental rotation. The study was guided by the following research questions: What are engineering students’ sketching skills as assessed by our instrument?, What is the factor structure of the engineering sketching skills assessment?, and What is the inter-rater reliability for grading sketches?
This study focuses on the development and pilot testing of a new sketching skills test using object assembly exercises. By sketching responses to spatial visualization exercises requiring mental imagery and mental rotation, students demonstrate sketching skill in the constructed images they draw. Exercises require students to visualize what they will draw, perform the mental operations on the depicted shapes necessary to correctly represent their mental image, and draw their results. A corresponding rubric scores sketches on accuracy, line straightness, precision, line weight, scale, consistency, symmetry, converging lines, and proportion at three skill levels. We received feedback from five student and professor engineering experts on test and rubric clarity and alignment. After making suggested edits, we will pilot the sketching skills test in two undergraduate sections of a mechanical engineering graphics and design course with 45 students per section, and in a graduate mechanical engineering design course with 40 students. We calculate inter-rater reliability between two raters scoring students sketches with the developed rubric.
Preliminary results show that experts recommended quantifying some skills, such as converging lines, to consistently grade sketches. Experts recommended removing symmetry and line weight for little correlation to the current tasks, and adding a category for cylinders to improve alignment. Pilot study results will report sketching skills in mechanical engineering undergraduate and graduate students at emerging, developing, and proficient ability levels. We report inter-rater reliability in applying the rubric for all categories. We compare undergraduate and graduate student scores and discuss differences between sections. Further changes to rubric categories with low reliability will be made to better represent engineering drawing skills. Drawing tasks will be modified to clearly map onto spatial ability. The paper will discuss implications for engineering educators. Our results will inform future dissemination of this instrument to engineering and design classrooms.
Merzdorf, H., & Jaison, D., & Weaver, M., & Douglas, K., & Linsey, J., & Hammond, T. (2022, August), Assessing Engineering Sketching Skills on Object Assembly Tasks Paper presented at 2022 ASEE Annual Conference & Exposition, Minneapolis, MN. 10.18260/1-2--40791
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2022 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015