June 23, 2013
June 23, 2013
June 26, 2013
Educational Research and Methods
23.1366.1 - 23.1366.17
Expert / Novice Agreement on “Good” DiagramsEngineers have a particular, predictable way of working. Problems first encountered through textor verbal description are translated into a diagram which abstracts the salient features, highlightsunderlying system structure, instantiates laws and principles, and organizes the complexity of theproblem. The diagram becomes a “tool for thinking”, a bootstrapping mechanism which servesas the basis for creating a symbolic/mathematical model for further analysis. Learning to createand successfully employ the many engineering-community-sanctioned diagrams (e.g. free bodydiagrams, multi-unit flow diagrams, circuit diagrams) is a major goal for engineering studentsand educators alike.The research presented in this paper is part of an extensive study on the text to diagram tosymbol translations and representations utilized within a course on mass and energy balance. Fordiagnostic purposes at the start of the term, students were given a textual description of a multi-unit system and directed to develop diagrams to represent the system for the purpose ofoptimizing the system. After pairs discussed their diagrams, they were given a set of sevendifferent diagrams developed by the professor and asked to rank order them with respect to theirusefulness in further analysis of the system. This task assessed whether the students couldrecognize good qualities for a diagram to have. In this paper, we analyze the agreement betweenexperts and the students on the diagram rankings using Cohen’s weighted kappa and Fleiss’skappa. In addition, we discuss the task in context, the ensuing class discussion regarding criteriafor a good diagram, and the implications of our findings for helping students develop thecapacity for diagrammatic development and reasoning.
Waller, A. A., & LeDoux, J. M., & Newstetter, W. C. (2013, June), What makes an effective engineering diagram? A comparative study of novices and experts Paper presented at 2013 ASEE Annual Conference & Exposition, Atlanta, Georgia. https://peer.asee.org/22751
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2013 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015