June 23, 2013
June 23, 2013
June 26, 2013
Educational Research and Methods
23.891.1 - 23.891.15
Measuring the effectiveness of pedagogical innovations using multiple baseline testingABSTRACTA great deal of literature focuses on innovations that are designed to improve educationalperformance. Although some innovations are designed and implemented to address learning in avery specific domain, others influence student learning more generally as they are applicableregardless of specific content (e.g., mechanisms for delivering new content, new strategies forstudent-student interactions, and application of new technologies). Many instructors form thehypothesis that a particular innovation will enhance student learning and, consequently, theability to achieve desired learning objectives. Validly testing such a hypothesis can betroublesome when confounding factors exist in the student body’s learning environment such asscheduled breaks, social stressors, and activities occurring in other courses. Multiple baselinetesting is a promising strategy for statistically controlling the influence of confounding factorswhen innovations are implemented consistently across multiple courses. This strategy involvesmeasuring student performance, implementing the innovation at a randomly selected time, andcontinuing to measure student performance as the innovation is integrated within the course. Theimpact of the innovation treatment can be measured using time series regression models and F-tests. This paper presents the proper mechanics of multiple baseline testing, discusses therelatively small body of research on this method that exists outside the medical and biologicalfields, and provides clear recommendations for managing threats to validity in engineeringeducation research.
Albert, A. (2013, June), Measuring the effectiveness of pedagogical innovations using multiple baseline testing Paper presented at 2013 ASEE Annual Conference & Exposition, Atlanta, Georgia. https://peer.asee.org/22276
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2013 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015