July 26, 2021
July 26, 2021
July 19, 2022
Pre-College Engineering Education
A Framework for K-12 Science Education (NRC, 2012) and the Next Generation Science Standards ([NGSS], 2013) highlight the importance of including engineering in the K-12 curriculum. The implementation of NGSS requires that teachers understand engineers’ use of design in their work as well as the ways that engineering is connected to science, technology, and society. Researchers have used drawing tasks, such as the Draw and Engineer (DAE) test to identify teachers’ perceptions of engineers. While DAE instruments can provide researchers with important information about teachers perceptions, current instruments fall short of eliciting information about how teachers view the role of science and mathematics within the scope of engineers’ work. We sought to develop a modified version of DAE that allows researchers to identify how teachers perceive the use of mathematics and science within engineering work. The aim of the current study was to examine the use of the Draw-An-Engineer and Applications of Mathematics and Science (DEAMS) instrument and associated scoring rubric (DEAMS-R) for eliciting elementary teachers’ perceptions about the work of engineers and the ways that engineers use mathematics and science. DEAMS instructs participants to draw an engineer or engineers at work and then explain what the engineer is doing, as well as how the engineer is using mathematics and science in the work depicted. This studies documents the validation of DEAMS-R with elementary pre-service teachers at two large lang grant universities, one in the western US and one in the mid-western US. All participants were enrolled in an elementary science methods course at the time they completed the instrument. All participants completed the DEAMS twice, consecutively, during a single class meeting, resulting is a total of 170 drawings for analysis. The instrument was given twice consecutively to determine if a second drawing provided additional insight into participants’ perceptions. The current study documents the steps taken to ensure content validity and reliability, including expert panel review and inter-rater reliability. The first version of the rubric has three constructs: work of an engineer, use of science, and use of mathematics. Each construct has possible values of 1, 2, 3, or 4. This version was used by two science education faculty to independently score a random sample of 24 drawings. Using the first version of the rubric, the two faculty agreed on 67% of work of an engineer, 82% of use of science, and 77% of use of mathematics, with K=0.534, which indicates moderate agreement. Areas of disagreement were discussed extensively, and these discussions were used to develop a second version of the rubric. The second version is currently being tested and results from this second version of the rubric will be shared in the final paper.
Hammack, R. J., & Ivey, T., & Utley, J. (2021, July), Development and Validation of the Draw-an-Engineer and Applications of Mathematics and Science Instrument (Work in Progress) Paper presented at 2021 ASEE Virtual Annual Conference Content Access, Virtual Conference. 10.18260/1-2--36954
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2021 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015