Comparing Student Outcomes in Online vs. In-person Sections of an On-campus Computer Science Course

Rishi Sunny Gulati; Matthew West; Craig Zilles; Mariana Silva

Download Paper | Permalink

Conference: 2023 ASEE Annual Conference & Exposition
Location: Baltimore , Maryland
Publication Date: June 25, 2023
Start Date: June 25, 2023
End Date: June 28, 2023
Conference Session: COED: Online and Remote Learning
Tagged Division: Computers in Education Division (COED)
Tagged Topic: Diversity
Page Count: 14
DOI: 10.18260/1-2--43276
Permanent URL: https://peer.asee.org/43276
Download Count: 246

Paper Authors

author page

Rishi Sunny Gulati

biography

Matthew West University of Illinois, Urbana-Champaign orcid.org/0000-0002-7605-0050

visit author page

Matthew West is a Professor in the Department of Mechanical Science and Engineering at the University of Illinois at Urbana-Champaign.

visit author page

biography

Craig Zilles University of Illinois, Urbana-Champaign orcid.org/0000-0003-4601-4398

visit author page

Craig Zilles is an Associate Professor in the Computer Science department at the University of Illinois at Urbana-Champaign. His research focuses on computer science education and computer architecture. His research has been recognized by two best paper

visit author page

biography

Mariana Silva University of Illinois, Urbana-Champaign

visit author page

Mariana Silva is a Teaching Associate Professor in the Department of Computer Science at the University of Illinois at Urbana-Champaign. Silva is known for her teaching innovations and educational studies in large-scale assessments and collaborative learning. She has participated in two major overhauls of large courses in the College of Engineering: she played a key role in the re-structure of the three Mechanics courses in the Mechanical Science and Engineering Department, and the creation of the new computational-based linear algebra course, which was fully launched in Summer 2021. Silva research focuses on the use of web-tools for class collaborative activities, and on the development of online learning and assessment tools. Silva is passionate about teaching and improving the classroom experience for both students and instructors.

visit author page

Download Paper | Permalink

Abstract

We present results from a quasi-experimental study to compare an online section to an in-person section of the same computer science class, where all students were residential and physically present on campus. The use of online sections for computer science classes has been primarily driven by two key factors: (1) the difficulties of finding enough large classrooms to accommodate the growing number of computer science majors, and (2) the desire of some students to take classes online, with the flexibility that this entails.

This study adds to the existing body of knowledge on online versus in-person instruction by specifically addressing the question of how effective online instruction is for students who are physically on campus, where they retain their peer support networks and physical learning environments. In this study we considered online and in-person sections of an upper-level required undergraduate computer science course at a large public university in Spring 2022. Students were free to choose to enroll in either the online or in-person sections, both offered in the same semester, by the same instructor, using the same material. The online section had 222 students and the in-person section had 117 students.

The course followed a flipped format with pre-lecture videos. During class time, students were expected to complete computer-based group activities. The in-person section completed these activities in the classroom while the students in the online section had to arrange to complete the activities with their groups at a time of their choosing, either in person or online. All course assessments were completed using an online platform. Students took quizzes and the final exam online using their own computers, which were proctored by course staff online via Zoom.

We compared assessment performance and sense of belonging for students in the online and in-person sections. The two sections had similar average student GPA at the start of the course (3.78 and 3.73 for online and in-person sections respectively; not significant, Cohen’s d = 0.15 and p = 0.22). Controlling for GPA, the two sections had similar quiz averages and final exam average (the online section was 1.3% higher, which was not significant; Cohen’s d = 0.1 and p = 0.4). Disaggregating by gender and URM status showed similar results.

We also conducted pre and post surveys that included measures of student’s sense of belonging in relation to their instructors and classmates (whole class) and in relation to their collaborative groups (within group). Students in the online and in-person sections report similar levels of sense of belonging on average in both surveys (for example, for the post survey the in-person section was 0.05 points higher on a 5-point scale, which was not significant; p = 0.6). Moreover, the whole class sense of belonging statistically increases from the beginning to the end of the semester in both sections.

Based on these results we conclude that online sections of courses for on-campus students can be an effective way to accommodate large class sizes and increased enrollment pressure, while not disadvantaging students in either learning outcomes or sense of belonging. In our study about 2/3 of students preferred to enroll in the online section, substantially reducing the demands for classroom space.

Citation
Format

Gulati, R. S., & West, M., & Zilles, C., & Silva, M. (2023, June), Comparing Student Outcomes in Online vs. In-person Sections of an On-campus Computer Science Course Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--43276

TY  - CPAPER
AB  - We present results from a quasi-experimental study to compare an online section to an in-person section of the same computer science class, where all students were residential and physically present on campus. The use of online sections for computer science classes has been primarily driven by two key factors: (1) the difficulties of finding enough large classrooms to accommodate the growing number of computer science majors, and (2) the desire of some students to take classes online, with the flexibility that this entails.

This study adds to the existing body of knowledge on online versus in-person instruction by specifically addressing the question of how effective online instruction is for students who are physically on campus, where they retain their peer support networks and physical learning environments. In this study we considered online and in-person sections of an upper-level required undergraduate computer science course at a large public university in Spring 2022. Students were free to choose to enroll in either the online or in-person sections, both offered in the same semester, by the same instructor, using the same material. The online section had 222 students and the in-person section had 117 students.

The course followed a flipped format with pre-lecture videos. During class time, students were expected to complete computer-based group activities. The in-person section completed these activities in the classroom while the students in the online section had to arrange to complete the activities with their groups at a time of their choosing, either in person or online. All course assessments were completed using an online platform. Students took quizzes and the final exam online using their own computers, which were proctored by course staff online via Zoom.

We compared assessment performance and sense of belonging for students in the online and in-person sections. The two sections had similar average student GPA at the start of the course (3.78 and 3.73 for online and in-person sections respectively; not significant, Cohen’s d = 0.15 and p = 0.22). Controlling for GPA, the two sections had similar quiz averages and final exam average (the online section was 1.3% higher, which was not significant; Cohen’s d = 0.1 and p = 0.4). Disaggregating by gender and URM status showed similar results.

We also conducted pre and post surveys that included measures of student’s sense of belonging in relation to their instructors and classmates (whole class) and in relation to their collaborative groups (within group). Students in the online and in-person sections report similar levels of sense of belonging on average in both surveys (for example, for the post survey the in-person section was 0.05 points higher on a 5-point scale, which was not significant; p = 0.6). Moreover, the whole class sense of belonging statistically increases from the beginning to the end of the semester in both sections.

Based on these results we conclude that online sections of courses for on-campus students can be an effective way to accommodate large class sizes and increased enrollment pressure, while not disadvantaging students in either learning outcomes or sense of belonging. In our study about 2/3 of students preferred to enroll in the online section, substantially reducing the demands for classroom space.

AU  - Rishi Sunny Gulati
AU  - Matthew West
AU  - Craig Zilles
AU  - Mariana Silva
CY  - Baltimore , Maryland
DA  - 2023/06/25
PB  - ASEE Conferences
TI  - Comparing Student Outcomes in Online vs. In-person Sections of an On-campus Computer Science Course
UR  - https://peer.asee.org/43276
DO  - 10.18260/1-2--43276
ER  -