Asee peer logo

On the Portability and Robustness of Early Student Performance Predictions

Download Paper |

Conference

2024 ASEE Annual Conference & Exposition

Location

Portland, Oregon

Publication Date

June 23, 2024

Start Date

June 23, 2024

End Date

July 12, 2024

Conference Session

Computing and Information Technology Division (CIT) Technical Session 4

Tagged Division

Computing and Information Technology Division (CIT)

Permanent URL

https://peer.asee.org/47811

Request a correction

Paper Authors

biography

Abdulmalek Al-Gahmi Weber State University

visit author page

Dr. Abdulmalek Al-Gahmi is an associate professor at the School of Computing Department of Weber State University. His teaching experience involves courses on object-oriented programming, full-stack web development, computer graphics, algorithms and data structures, and machine learning. He holds a Ph.D. in Computer Science from New Mexico State University.

visit author page

Download Paper |

Abstract

The early prediction of student performance has long been a significant area of interest within the educational research community. Numerous studies have sought to identify students who struggle early in their courses, with the goal of providing timely interventions. This early detection of at-risk students is vital for fostering and promoting student success, which is critical to the missions of higher-education institutions and their long-term goals of improving student graduation and retention rates.

This paper builds on the predictive models from a previous paper, focused on making early course-based predictions of student performance based on data collected from a Learning Management System (LMS). It describes these models, augments them with new features, and investigates the portability and robustness of their predictions— aspects not addressed in the previous paper. It frames the early prediction of student performance as a binary classification problem, distinguishing between two student groups: at-risk students who are failing their courses and require early identification for timely assistance, and those who are performing satisfactorily. Additionally, this paper employs Explainable AI (XAI) methods to gain insight into how the new models generate their predictions and to identify the key data features that contribute to these predictions.

This paper relies on data gathered from the Canvas Learning Management System through RESTful and GraphQL APIs. The data pertain to 274 lower-division Computer Science courses, encompassing 2,656 students and 37 instructors. These courses are delivered in various formats (face-to-face, online, and virtual), spanning a three-year period at a public four-year university.

Al-Gahmi, A. (2024, June), On the Portability and Robustness of Early Student Performance Predictions Paper presented at 2024 ASEE Annual Conference & Exposition, Portland, Oregon. https://peer.asee.org/47811

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2024 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015