New Orleans, Louisiana
June 26, 2016
June 26, 2016
August 28, 2016
Engineering Design Graphics
Building on substantial work done on a new automated course and program assessment tool, we undertook an experiment to determine the accuracy of the outcomes assessments. We compared assessments of course-level outcomes using manual instructor assessments in Moodle and our Automated Course Assessment Tool (ACAT). Four courses taught in the Spring of 2015 were considered. Two are Laboratory courses, and two are traditional book-based courses with exams or projects. We found that in all but one specific case the manual assessment matched the ACAT assessment. In the sole case that did not match, a single indicator attempted to measure all course outcomes simultaneously. The study considered 34 students, 27 outcomes, and used 107 indicators to measure the outcomes. A single indicator affecting two students caused three outcomes to be adjudged incorrectly.
Glossner, J., & Bertozzi, N., & Kostar, T. D., & Guo, X. D., & McInnis, J., & Marquis, L. (2016, June), ACAT Assessment of Grade-based and Outcome-based Criteria Paper presented at 2016 ASEE Annual Conference & Exposition, New Orleans, Louisiana. 10.18260/p.26491
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2016 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015