Salt Lake City, Utah
June 20, 2004
June 20, 2004
June 23, 2004
9.1134.1 - 9.1134.10
Subjective Evaluation in Engineering Design Richard Bannerot Department of Mechanical Engineering University of Houston
Abstract Engineering students may not receive sufficient experience and help in making and understanding subjective decisions. Two studies are presented that imply engineering students have poor subjective evaluation skills. The artifacts resulting from two design studies were evaluated by two different classes of sophomore engineering students and their instructor. One study represented innovative design, and the artifact was designed and fabricated by teams composed of four students each. The other study represented routine design and was addressed by individual students working alone. Both the instructor and students, acting individually, evaluated both the team and individually produced design artifacts. Compared with the instructor’s evaluations of the artifacts, the students undervalued the best artifacts and greatly overvalued the worst artifacts. Most demonstrated very little discrimination in their evaluations. However, the better designers were also better “graders” in that their evaluations more closely followed those of the instructor. Self-evaluations followed the same trends with many of the poorest designers grossly overvaluing their own artifacts. The results indicated that designing ability correlates positively with critical evaluation skills, and it is proposed that the teaching of such skills should be included in design courses.
Evaluation is an important part of the design process. Most engineering design textbooks (see for example references 1-6) devote considerable attention to the evaluation process. Much of this attention is directed to concept evaluation (i.e., selection), but evaluation procedures are also provided for comparing performance and other measures. However, most evaluation is at some level subjective. In engineering design the subjectivity of decisions involving a large number of parameters is usually reduced by subdividing the “big decision” into many “smaller decisions”, e.g., Pugh concept selection process or criteria functions. In theory these subdividing processes are good, but they do not remove the subjectivity; they simply move it to another level. Engineering design textbooks normally do not provided much help for the student in making these subjective decisions except for case study examples where students may get a “feel” for the small decisions.
Proceedings of the 2004American Society for Engineering Education Annual Conference &Exposition Copyright 2004, American Society for Engineering Education
Bannerot, R. (2004, June), Subjective Evaluation In Engineering Design Paper presented at 2004 Annual Conference, Salt Lake City, Utah. https://peer.asee.org/13791
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2004 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015