Asee peer logo

Comparing Student Outcomes in Online vs. In-person Sections of an On-campus Computer Science Course

Download Paper |

Conference

2023 ASEE Annual Conference & Exposition

Location

Baltimore , Maryland

Publication Date

June 25, 2023

Start Date

June 25, 2023

End Date

June 28, 2023

Conference Session

COED: Online and Remote Learning

Tagged Division

Computers in Education Division (COED)

Tagged Topic

Diversity

Page Count

14

DOI

10.18260/1-2--43276

Permanent URL

https://peer.asee.org/43276

Download Count

174

Request a correction

Paper Authors

author page

Rishi Sunny Gulati

biography

Matthew West University of Illinois, Urbana-Champaign Orcid 16x16 orcid.org/0000-0002-7605-0050

visit author page

Matthew West is a Professor in the Department of Mechanical Science and Engineering at the University of Illinois at Urbana-Champaign.

visit author page

biography

Craig Zilles University of Illinois, Urbana-Champaign Orcid 16x16 orcid.org/0000-0003-4601-4398

visit author page

Craig Zilles is an Associate Professor in the Computer Science department at the University of Illinois at Urbana-Champaign. His research focuses on computer science education and computer architecture. His research has been recognized by two best paper

visit author page

biography

Mariana Silva University of Illinois, Urbana-Champaign

visit author page

Mariana Silva is a Teaching Associate Professor in the Department of Computer Science at the University of Illinois at Urbana-Champaign. Silva is known for her teaching innovations and educational studies in large-scale assessments and collaborative learning. She has participated in two major overhauls of large courses in the College of Engineering: she played a key role in the re-structure of the three Mechanics courses in the Mechanical Science and Engineering Department, and the creation of the new computational-based linear algebra course, which was fully launched in Summer 2021. Silva research focuses on the use of web-tools for class collaborative activities, and on the development of online learning and assessment tools. Silva is passionate about teaching and improving the classroom experience for both students and instructors.

visit author page

Download Paper |

Abstract

We present results from a quasi-experimental study to compare an online section to an in-person section of the same computer science class, where all students were residential and physically present on campus. The use of online sections for computer science classes has been primarily driven by two key factors: (1) the difficulties of finding enough large classrooms to accommodate the growing number of computer science majors, and (2) the desire of some students to take classes online, with the flexibility that this entails.

This study adds to the existing body of knowledge on online versus in-person instruction by specifically addressing the question of how effective online instruction is for students who are physically on campus, where they retain their peer support networks and physical learning environments. In this study we considered online and in-person sections of an upper-level required undergraduate computer science course at a large public university in Spring 2022. Students were free to choose to enroll in either the online or in-person sections, both offered in the same semester, by the same instructor, using the same material. The online section had 222 students and the in-person section had 117 students.

The course followed a flipped format with pre-lecture videos. During class time, students were expected to complete computer-based group activities. The in-person section completed these activities in the classroom while the students in the online section had to arrange to complete the activities with their groups at a time of their choosing, either in person or online. All course assessments were completed using an online platform. Students took quizzes and the final exam online using their own computers, which were proctored by course staff online via Zoom.

We compared assessment performance and sense of belonging for students in the online and in-person sections. The two sections had similar average student GPA at the start of the course (3.78 and 3.73 for online and in-person sections respectively; not significant, Cohen’s d = 0.15 and p = 0.22). Controlling for GPA, the two sections had similar quiz averages and final exam average (the online section was 1.3% higher, which was not significant; Cohen’s d = 0.1 and p = 0.4). Disaggregating by gender and URM status showed similar results.

We also conducted pre and post surveys that included measures of student’s sense of belonging in relation to their instructors and classmates (whole class) and in relation to their collaborative groups (within group). Students in the online and in-person sections report similar levels of sense of belonging on average in both surveys (for example, for the post survey the in-person section was 0.05 points higher on a 5-point scale, which was not significant; p = 0.6). Moreover, the whole class sense of belonging statistically increases from the beginning to the end of the semester in both sections.

Based on these results we conclude that online sections of courses for on-campus students can be an effective way to accommodate large class sizes and increased enrollment pressure, while not disadvantaging students in either learning outcomes or sense of belonging. In our study about 2/3 of students preferred to enroll in the online section, substantially reducing the demands for classroom space.

Gulati, R. S., & West, M., & Zilles, C., & Silva, M. (2023, June), Comparing Student Outcomes in Online vs. In-person Sections of an On-campus Computer Science Course Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--43276

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2023 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015