Asee peer logo

A Model For Teaching Materials Evaluation: Development And Testing Of Interactive Computer Simulations Modules For Undergraduate Education

Download Paper |


2004 Annual Conference


Salt Lake City, Utah

Publication Date

June 20, 2004

Start Date

June 20, 2004

End Date

June 23, 2004



Conference Session

Learning & Teaching Issues

Page Count


Page Numbers

9.67.1 - 9.67.11



Permanent URL

Download Count


Request a correction

Paper Authors

author page

Emilia Hodge

author page

Chang-Yu Wu

author page

Anne Donnelly

Download Paper |

NOTE: The first page of text has been automatically extracted and included below in lieu of an abstract

Session # 1331

A Model for Teaching Materials Evaluation: Development and Testing of Interactive Computer Simulations Modules for Undergraduate Education

Anne E. Donnelly1, Emilia Hodge1, Melis Budak1, Heath Wintz2, Randy Switt2, Chang-Yu Wu2, Prakash Kumar3, Pratim Biswas3 Priscilla Chapman4, Anne L. Allen4 1 University of Florida, Engineering Research Center for Particle Science & Technology, Gainesville, FL 32611/2University of Florida, Department of Environmental Engineering Sciences, Gainesville, FL 32611/3Washington University in St. Louis, Environmental Engineering Science Program, St. Louis, MO 63130/4University of Florida, Office of Academic Technology, Gainesville, FL 32611


A comprehensive evaluation program was developed as part of an NSF Course Curriculum, and Laboratory Improvement grant to develop three undergraduate computer simulation modules. Aerosol science and technology is generally taught at the graduate level and the goal of this program was to develop materials that would bring this subject to the undergraduate level. To achieve this goal, an evaluation plan was developed that included formative and summative, and cognitive and affective measures. This was a collaboration between content and evaluation experts who were involved from the proposal stage. The program included formative evaluation of pilot versions of the materials. Both undergraduate students and faculty were involved and provided significant feedback on how the materials could be modified to be more effective. The modified versions were formally tested in classroom settings to determine if students could master the material and if they enjoyed using the modules. Students made statistically significant gains in knowledge as a result of the modules and appreciated the ability to go through the simulations at their own pace. The evaluation program used here was instrumental in ensuring high quality products and can serve as a model easily exportable to other educational product development projects. The full model and the lessons learned will be described.


Evaluation of engineering education programs and products is critical to ensure quality and enhance the dissemination of these materials. The National Science Foundation has taken a leadership role in ensuring adequate program evaluation by making it an integral element of

“Proceedings of the 2004 American Society for Engineering Education Annual Conference & Exposition Copyright  2004, American Society for Engineering Education”

Hodge, E., & Wu, C., & Donnelly, A. (2004, June), A Model For Teaching Materials Evaluation: Development And Testing Of Interactive Computer Simulations Modules For Undergraduate Education Paper presented at 2004 Annual Conference, Salt Lake City, Utah. 10.18260/1-2--13400

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2004 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015