June 24, 2007
June 24, 2007
June 27, 2007
Educational Research and Methods
12.168.1 - 12.168.24
Active Assessment in Engineering Design Using a Systems Approach
A major challenge for faculty is how to develop a “culture of evidence” in the classroom that supports student-centered formative learning and aligns with program and accreditation goals. Another challenge is the development of assessment tools that lighten, rather than add to, faculty workload. In this paper, we analyze a systems approach for gathering evidence centered on the development of group artifacts. Specifically, online project management (PM) and knowledge management (KM) resources are purposefully developed by students at the intersection of working, learning, and assessment. The KM and PM archives are assessed using a multi-method approach, with three goals in mind: 1) ease of implementation, 2) real-time documentation of improvements, and 3) alignment of course assessments with program and institutional goals.
Faculty are being asked by legislators, accrediting agencies, institutions, employers and the public to provide more and better evidence of students’ academic achievement. At the same time, they are asked to provide evidence of higher-order thinking and professional skills, which are complex and difficult to measure. This poses a paradox for faculty who want to implement innovative team- and project-based pedagogies. The lack of assessment tools, incentives, and support structures in higher education can discourage faculty from adopting active, student- centered learning approaches, such as collaborative, problem-based, team-based, project-based, inquiry-based, inductive and experiential learning [1,2,3,4]. Faced with more difficult-to- measure learning outcomes, a major challenge for faculty is how to reconcile what stakeholders want with what faculty can reasonably do. At the same time, faculty are evaluated on the rigorousness of their methods and their contributions to theory and practice beyond the local context.
To solve this problem by measuring every variable using every available technique isn’t practical or useful. In order to avoid what Gloria Rogers, Associate Executive Director of Professional Services for ABET, Inc.— the nationally-recognized accreditor for college and university programs in applied science, computing, engineering, and technology (ABET)— calls “death by assessment,” alternative assessments are needed that: 1) target specific educational questions, 2) improve organization, learning and assessment, together as an interconnected whole, and 3) reduce faculty workload . Complex learning environments do not lend themselves to traditional positivist methodologies, where a single variable is isolated and controlled for, and the results repeated and generalized. For example, it is impossible (and counterproductive) to isolate and control for interpersonal communication (ABET outcome g) from the ability to function on multi-disciplinary teams (ABET outcome d) without affecting the variable you want to measure in the first place.
In response, the engineering education community is calling for more rigorous methods in education that use a systems approach. ABET, for example, suggests that it is important to use a “multi-method/multi source approach to maximize the validity and reduce the bias of any one
Racicot, K., & Pezeshki, C. (2007, June), Active Assessment In Capstone Design Using A System Approach Paper presented at 2007 Annual Conference & Exposition, Honolulu, Hawaii. 10.18260/1-2--1731
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2007 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015