June 24, 2007
June 24, 2007
June 27, 2007
12.39.1 - 12.39.10
A Direct Assessment Technique that Works
The development and use of direct assessment techniques using embedded indicators has become more prevalent at this institution over the last two years in response to requirements to provide more meaningful assessment data without incurring additional faculty resources. A specific technique linking student grades to the assessment of program outcomes has been used successfully in two civil engineering courses with good success. This paper presents a revised procedure that serves to address previously expressed concerns related to mathematical processes within the assessment technique.
The assessment technique is constructed within a spreadsheet and is easy to modify for use in any course. Inherent to this assessment technique is a mapping of specific student activities, whether as part of a project or other graded assignment, to specific program outcomes. The mapping involves the assignment of a number between one (weak mapping) and five (strong mapping) by experienced faculty members who have taught the course at least once and are knowledgeable about both the course and its relation to the program outcomes. Included within the spreadsheet is a standard grading breakdown which lists the specific student activities and their relative point values. After assignment of points for each activity, the spreadsheet combines the grade values and the mapping values to determine an assessment of each program outcome.
Another meaningful aspect of the technique is the determination of the validity of each program outcome assessment value. The validity number allows the instructor to determine which program outcomes need either increased emphasis or the inclusion of additional student activities in the assessment. The number also assists instructors in reallocating resources or student effort from strongly assessed outcomes to outcomes where the validity of the assessment may be questionable.
This paper includes the discussion of data collected over two semesters for the CE Capstone Design Course and addresses the use of a similar system in a senior- level construction management course.
For years, educators have been trying to find innovative ways to capture what their students have learned to assess the effectiveness of their programs. Some strictly rely on student end-of-course critiques. Others rely solely on grades and some on a combination of the two. A method used in CE492, Design of Structural Systems, at the United States Military Academy (USMA) includes the use of embedded indicators to directly assess students’ abilities to achieve each of the 17 Civil Engineering (CE) Program Outcomes. Embedded indicators have been shown previously to provide a better assessment of student work.1-4
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2007 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015