Asee peer logo

Effectiveness of Online Textbooks vs. Interactive Web-Native Content

Download Paper |

Conference

2014 ASEE Annual Conference & Exposition

Location

Indianapolis, Indiana

Publication Date

June 15, 2014

Start Date

June 15, 2014

End Date

June 18, 2014

ISSN

2153-5965

Conference Session

Best of Computers in Education Division

Tagged Division

Computers in Education

Page Count

10

Page Numbers

24.460.1 - 24.460.10

DOI

10.18260/1-2--20351

Permanent URL

https://peer.asee.org/20351

Download Count

287

Request a correction

Paper Authors

biography

Alex Daniel Edgcomb University of California, Riverside

visit author page

Alex Edgcomb is a Ph.D. candidate in computer science at the University of California, Riverside with an expected graduation of spring 2014.

visit author page

author page

Frank Vahid University of California, Riverside

Download Paper |

Abstract

Efficacy of Static Web Content Plus Tool vs. Interactive Web-Native ContentStatic web content plus tool utilizes text and pictures for the core explanations (like atraditional textbook), then adds a tool, such as a programming environment alongside thecontent. Interactive web-native content utilizes less text and pictures, and instead utilizesanimations, responsive question sets, and interactive exercises for the core explanations.The objective of this study was to determine the efficacy of static web content plus a toolcompared to interactive web-native content.We compared the two content styles with a lesson on basic output in C++. We chose onelesson from Zyante's Programming in C++ (zyante.com) offering as the interactive web-native textbook, and one lesson from Horstmann's Big C++, the leading textbook forC++, as the static web content. The Zyante lesson had 769 words of explanatory text,including code examples, and 7 interactive elements, including 1 animation, 3 embeddedprogramming exercises, and 3 questions sets, as well as 1 three minute video. The BigC++ lesson had 1,236 words for explanatory text, including code examples, and an easy-to-use programming environment alongside the lesson. We compared the concepts taughtin each lesson and removed non-overlapping concepts whenever possible. Also, all quizquestions focused on a single concept that was taught in both lessons.We conducted a study during the first week of the Fall quarter, prior to any lecture, lab,or assignment on C++, with participants who were enrolled in CS1 in C++. Theparticipants performed 5 tasks in order: background survey, pre-lesson quiz (4 questions),lesson in C++, post-lesson quiz (11 questions with 4 from the pre-lesson quiz), thenfollow-up survey. The lesson style was randomly assigned. The participants were notgiven a time limit during the study.An improvement score is a participant's post-lesson minus pre-lesson quiz scores.Overall, the average improvement score was 16% higher (p-value = 0.016) forparticipants given the interactive web-native lesson (6.4 out of 11 improvement score)than the static web lesson (5.5 out of 11 score). Moreover, for the participants who scoredin the lower-quartile of the pre-lesson quiz (least-prepared participants), the averageimprovement score was 64% higher (p-value < 0.001) for the interactive web-nativelesson (7.4 out of 11 score) than the static web lesson plus tool (4.5 out of 11 score).The significant improvement of the least-prepared participants may be cause by thehigher (p-value = 0.055) self-reported engagement with the interactive web-native lesson(5.3 out of 6 engagement score) than the static web lesson plus tool (4.8 out of 6 score).Also, participants chose to spend more time (p-value < 0.001) with the interactive web-native lesson (17.5 minutes) than the static web lesson plus tool (9.4 minutes). Oneparticipant with the interactive web-native lesson wrote: “I can learn by practicing andauto-check the answer right away ... the activities are fun and helpful.”The interactive web-native lesson was significantly more effective than the static weblesson plus tool for improving quiz scores, especially for the least-prepared students.

Edgcomb, A. D., & Vahid, F. (2014, June), Effectiveness of Online Textbooks vs. Interactive Web-Native Content Paper presented at 2014 ASEE Annual Conference & Exposition, Indianapolis, Indiana. 10.18260/1-2--20351

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2014 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015