June 24, 2007
June 24, 2007
June 27, 2007
Computers in Education
12.1241.1 - 12.1241.11
Results from a Multi-center Investigation of the Effect of Network Latency on Pedagogic Efficacy Interactive web-based learning tools, such as engineering simulations, are becoming increasingly common. Universities find them cost-effective, and students find them convenient. Professors find web-based simulations effective to intuitively convey the complex cause-and-effect relationships that are central in engineering education. For example, moving a slider can be used to interactively see how changing a resistor’s value changes current flow through a current divider. There are many studies investigating the effectiveness of interactive web-based learning materials, yet, little systematic investigation of the pedagogic impact of network delay. This paper, therefore, seeks to quantify the relationship that network latency, or delay, has upon student enjoyment and student comprehension.
An interactive software application was designed purportedly to teach Fourier Analysis concepts, but embeds a secret delay between the time a student moves one of the interactive controls and the time that the screen updates. Different versions of the application were designed, each identical except for the delay. Students were randomly assigned application versions, ensuring double-blind test conditions. Students used the application while completing a short guided lesson that used the Socratic Method to intuitively teach Fourier Analysis. After completing the tutorial questions, which provide an objective assessment of student comprehension, students self-rated their comprehension and enjoyment, and recorded their program version number which encoded the delay. The data was least-squares fit to several different functions with varying degrees of freedom and residuals were computed.
Data involving 281 students from four universities and one high school using eight equally- spaced delays from 0 to 420 ms was analyzed. A two-part piecewise linear function was found to have both a low number of degrees of freedom and low sum of residuals that suggest a “knee” in pedagogic efficiency exists. One knee at a 300ms delay describes self-rated comprehension and self-rated enjoyment tolerance to delays. A second knee exists at 60ms 30ms and describes objective comprehension.
The difference in knee location suggests that our learning is maximally effective for cause-and- effect relationships when delay is minimized, but that our psychological tolerance for delay is much higher. This conflict between competence perception and objective reality impacts university information technology infrastructure and pedagogical software design. This is especially the case for the emerging field of long-distance web education. These studies expose flaws in perception-based assessment of these areas. Continued studies are planned to assess category-specific differences such as age, gender, and major.
The use of web-based learning tools is continuing to increase today as well as the promotion of long-distance learning and assessment1. Many standardized tests, such as the Scholastic Aptitude Test (SAT) and Graduate Record Examination (GRE) can be taken online. Universities are similarly increasing online course offerings, and some have offered distance-learning degrees
Squire, J., & Walsh, V., & Bush, H. F., & Sullivan, G., & English, A. (2007, June), Results From A Multi Center Investigation Of The Effect Of Network Latency On Pedagogic Efficacy Paper presented at 2007 Annual Conference & Exposition, Honolulu, Hawaii. 10.18260/1-2--1824
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2007 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015