June 16, 2002
June 16, 2002
June 19, 2002
7.65.1 - 7.65.11
A Model for the Evaluation of Innovative Engineering Courseware: Engineering an Assessment Program
Richard H. Hall, Timothy A. Philpot, David B. Oglesby, Ralph E. Flori, Nancy Hubing, Steve E. Watkins, and Vikas Yellamraju
University of Missouri – Rolla
This paper describes a general model for assessment of instructional innovations used by the University of Missouri – Rolla’s Media Design and Assessment Laboratory and an example of the model’s application. This model is based on three themes: a) iterative assessment with on- going feedback; b) triangulation of multiple outcome and process measures; and c) progressive application of multiple experimental methodologies. The model was applied in the form of two experiments that took place during the early stages of an on-going project that includes the development of multimedia modules for Basic Engineering Mechanics of Materials classes. The model’s themes and components are presented, followed by a discussion of the example experimental methodology, results, and consequent recommendations.
A great deal of time, money, and effort have gone into the development of learning technologies of all sorts in Engineering Education courseware over the years, and the pace has increased exponentially in the last decade due to the World Wide Web. Unfortunately, a substantial number of these technology-based learning innovations are integrated without any thought given to design issues, and, most importantly, without any thought to systematic evaluation of the impact of these technologies . In fact, systematic evaluation of learning innovations, in general, have been greatly lacking over the years. This is particularly unfortunate because, without this type of feedback on new techniques and innovations, the most effective practices are not emphasized, and those that are ineffective remain. In response to this basic problem, some large organizations and agencies have identified evaluation and assessment as a fundamental hallmark of effective education. This is dramatically illustrated by the 2000 ABET criteria for engineering education , which emphasizes the importance of a recursive method of course and curriculum evaluation, a process that will surely lead to more effective practices.
It is not surprising, however, that there is still such a lack of emphasis on assessment and evaluation given some of the constraints: a) Criterion measures for learning are difficult to identify and measure; b) Laboratory studies can be artificial and field studies can be lacking in
Proceedings of the 2002 American Society for Engineering Education Annual Conference & Exposition Copyright Ó 2002, American Society for Engineering Education
Watkins, S., & Hall, R., & Hubing, N., & Oglesby, D., & Yellamraju, V., & Flori, R., & Philpot, T. (2002, June), A Model For The Evaluation Of Innovative Engineering Courseware: Engineering An Assessment Program Paper presented at 2002 Annual Conference, Montreal, Canada. 10.18260/1-2--10465
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2002 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015