June 24, 2007
June 24, 2007
June 27, 2007
12.13.1 - 12.13.9
A Closer Look at the VaNTH/ERC Biomedical Engineering Modules: A Method to Examine of the Effects of Selected Core Components of the “Legacy Cycle” and HPL Model
Abstract Educational innovations developed within the Vanderbilt-Northwestern-Texas- Harvard/MIT Engineering Research Center (VaNTH/ERC) for Bioengineering Educational Technologies have been tested using a sequence of experimental, quasi- experimental, and non-experimental methods. More specifically, many of the innovations were first tested using randomized experiments or high quality quasi-experiments. When modules were shown to be effective under experimental conditions, subsequent assessments relied on non-experimental methods (e.g., pre-to-post gain) or simply the achieved level of average performance. Our overall all (i.e., meta-analytic) assessment of experimental and quasi- experimental studies have shown that they are effective in enhancing the learning outcomes for college and high school students. This paper demonstrates a set of methods that are used to probe the effects of multiple, sequential assessments of the same innovation, offering a broad scale model for monitoring the educational accomplishments of programs. This approach attempts to capitalize on available experimental and non- experimental as a means of testing effectiveness and monitoring subsequent performance. We also present analyses that show the unique contribution (to learning and other outcomes) of variations in specific core components of the Legacy Cycle and its learning principles.
The Vanderbilt-Northwestern-Texas-Harvard/MIT Engineering Research Center (VaNTH/ERC) for Bioengineering Educational Technologies has developed over 60 innovative instructional modules in a variety of bioengineering areas (See Harris et al.1). These innovations are based on the model of learning and instruction, (referred to as HPL for “How People Learn”) described by Bransford et al.2 in a volume issued by the National Academy of Sciences entitled How People Learn: Brain, Mind, Experience, and School. Prior analyses have shown that a subset of all VaNTH-sponsored modules and course enhancements are effective. Using meta-analytic methods to quantitatively combine the results from multiple studies, we have shown that HPL-inspired innovations are effective for student learning (see Cordray, Pion, A.Harris, & Norris3). An updated meta-analysis, including 19 studies that yielded 28 effect size estimates, revealed an average effect size of 0.644 standard deviation unit. The most common ES is expressed as ES = (MT - MC)/ SDpooled. or the mean (M) difference between treatment (MT) and control (MC) conditions, divided by the pooled standard deviation (SD) across conditions. However, additional analyses suggest that the results for well executed experimental studies are somewhat smaller (0.441 standard deviation units) but they are still regarded as moderate effects (See Cordray, Harris & Gilbert4). Almost all of the studies that were synthesized used the “Legacy Cycle” as a means of operationalizing the HPL model (Schwartz et al. 5).
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2007 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015