Salt Lake City, Utah
June 20, 2004
June 20, 2004
June 23, 2004
9.1327.1 - 9.1327.13
Two Instruments for Assessing Design Outcomes of Capstone Projects
Durward K. Sobek II, Vikas K. Jain Montana State University
A “good” design process is perhaps best defined by its output—good design processes produce good design outcomes. As part of an NSF-funded research effort to better understand student design processes, we developed two assessment instruments to measure the “goodness” of a design outcome. This paper describes the development and validation of the two instruments, presents the instruments and their implementation, and reports validation statistics on the initial data collected.
A common goal of many engineering design capstone courses in the US and elsewhere is to teach the students a “good” design process. In fact, many course instructors evaluate student design teams in these courses primarily by how well they define and/or follow a prescribed process. The underlying assumption is that good design processes lead to good design outcomes—but is that true? And if so, how can we know whether a design process is good? We propose that the goodness of a design process should be measured by the quality of its outcomes. As part of a larger to study to better understand student engineering design processes, we needed a way to measure design outcomes.
Development and successful implementation of a versatile capstone course assessment and evaluation system is potentially useful. Lack of effective assessment and evaluation tools can lead to false or inaccurate conclusions about the goodness of design processes. Yet, considering the ubiquitous presence of capstone design courses in almost every engineering curriculum, outcomes assessment of these courses is perhaps among the most under-researched topics in engineering education.
Cost, time and quality are the three basic performance measures attached to any process. In the capstone design projects we studied, time can measured in terms of number of weeks of total design time, e.g., one 15-week semester. The cost can be measured by the number of person hours devoted to the project. This paper, however, focuses on quality measurement, specifically the development of two distinct instruments designed to measure the quality of a design outcome, the Client Satisfaction Questionnaire (CSQ) and the Design Quality Rubric (DQR).
After a review of the common assessment strategies currently in use for senior capstone courses, the ensuing sections review the development, validation and data collection of the two
Proceedings of the 2004 American Society for Engineering Education Annual Conference & Exposition Copyright 2004, American Society for Engineering Education
Jain, V., & Sobek, D. (2004, June), Two Instruments For Assessing Design Outcomes Of Capstone Projects Paper presented at 2004 Annual Conference, Salt Lake City, Utah. https://peer.asee.org/13747
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2004 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015