Asee peer logo

Transforming Curricula To Reflect New It Literacies For 21 St Century Stem Careers

Download Paper |


2007 Annual Conference & Exposition


Honolulu, Hawaii

Publication Date

June 24, 2007

Start Date

June 24, 2007

End Date

June 27, 2007



Conference Session

Engineering Professional Development for K-12 Teachers – II

Tagged Division

K-12 & Pre-College Engineering

Page Count


Page Numbers

12.1502.1 - 12.1502.26



Permanent URL

Download Count


Request a correction

Paper Authors


Patricia Carlson Rose-Hulman Institute of Technology

visit author page

Dr. Patricia A. Carlson received the BS from the College of William and Mary in 1968 and the MS and Ph.D. degrees from Duke University in 1969 and 1973 respectfully. Currently Dr. Carlson is Professor of American Literature and Director of PRISM, Department of Humanities and Social Science, Rose-Hulman Institute of Technology.

visit author page


Dale Bremmer Rose-Hulman Institute of Technology

visit author page

Dale Bremmer is a professor of economics in the Department of Humanities and Social Sciences at Rose-Hulman Institute of Technology, Terre Haute, Indiana. He has taught at Rose-Hulman for the last eighteen years, specializing in applied econometrics. Bremmer has also taught at Arkansas State University and Indiana State University. He received his bachelor’s and master’s degrees in economics from Arizona State University while he earned his doctorate in economics from Texas A&M University.

visit author page

Download Paper |

NOTE: The first page of text has been automatically extracted and included below in lieu of an abstract

being captured by the state department of education at the district and schoolhouse level. Using data publicly reported for middle school education in Indiana (available at ), statistical calculations were used to determine how significant the effect of PRISM usage was for changing ISTEP scores (specifically math) during a given time frame and for a given grade level. More detailed results for these two studies are included in Addendum B.

Dr. Dale Bremmer (Professor of Economics at Rose-Hulman) worked with the project, collecting and analyzing data on several different variables that potentially influence performance on ISTEP (Indiana Statewide Testing for Educational Progress), an achievement test that measures student learning as defined by the state’s academic standards. In addition to PRISM usage, independent variables included such things as past achievement of students, school and teacher corps characteristics, and other socio-economic features, for a total of about a dozen independent variables. Using statistical regression analysis, we determined the factors – including PRISM usage by classroom teachers – that affected the performance of Indiana eighth graders on the standardized math exam.

In the first study, we used data from the 2004 ISTEP. (At the time of this preliminary study, these were the most recent test data available from the state.) Our unit of measure was the school district level, and we have reported our findings in the literature [7]. Succinctly, we found statistical evidence that PRISM use had a weak, but positive, effect on ISTEP scores. While the results were encouraging, PRISM was relatively new and cumulative number of unique visitors to the site had reached only about 2,000 at the time of the September 2004 ISTEP testing period. (See Figure 1 above; the solid vertical line to the left of the chart indicates the traffic history used in this first study.)

Improved collection methods in 2005 allowed us to track PRISM usage patterns at the school house level from the system’s inception in September 2003. We anticipated that this refinement in the empirical model would more closely capture effects of PRISM that were being “washed out” by the large variance in usage intensity at the district level. Our second study was based on individual school house data and analyzed how PRISM affected the change in scores on the eighth-grade ISTEP math exams between the years 2003 and 2006 (inclusive).

We found good results from this second empirical study. Using well-known regression techniques, statistical evidence indicates there is a direct (and statistically significant) relationship between the use of PRISM at a given school and the students’ performance on the eighth-grade ISTEP math exam. In other words, increased use of PRISM by a school’s teachers, holding everything else constant, leads to larger increases or smaller decreases in their eight- grade students’ ISTEP math scores.

The results from both studies, however, should be taken with several caveats. Our regression analyses do not determine causality. The key question is whether continued use of PRISM leads to better teaching, improved learning, and higher standardized scores? Or do better, more motivated teachers use all teaching tools at their disposal, including PRISM? And would these stronger teachers generate an improved learning experience and result in higher ISTEP scores without using PRISM? Furthermore, the positive relationship between PRISM use and ISTEP

Carlson, P., & Bremmer, D. (2007, June), Transforming Curricula To Reflect New It Literacies For 21 St Century Stem Careers Paper presented at 2007 Annual Conference & Exposition, Honolulu, Hawaii. 10.18260/1-2--2917

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2007 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015