Asee peer logo

The Impact of AI Assistance on Student Learning: A Cross-Disciplinary Study in STEM Education

Download Paper |

Conference

2024 Fall ASEE Mid-Atlantic Section Conference

Location

Farmingdale State College, NY, New York

Publication Date

October 25, 2024

Start Date

October 25, 2024

End Date

November 5, 2024

Conference Session

Technical Sessions 5

Tagged Topics

Diversity and Professional Papers

Page Count

11

DOI

10.18260/1-2--49457

Permanent URL

https://peer.asee.org/49457

Download Count

48

Paper Authors

biography

Matthew Fried SUNY Farmingdale

visit author page

Matthew Fried is an Assistant Professor with a research focus in machine learning. His work includes the application of advanced mathematical techniques, such as the Choquet integral, to deep neural networks (DNNs). He has presented multiple papers on this topic at international conferences, contributing to the ongoing development of noise reduction and performance optimization in DNNs.

visit author page

author page

Mohammad Alshibli

Download Paper |

Abstract

We examine the widespread use of AI in the form of Large Language Models (LLMs) as a tool for academic assistance. The study investigates whether students studying with AI assistance retain more information compared to those employing standard alternative approaches such as using a basic search engine, reviewing with a friend, or contemplating the material independently. The research reveals that while basic tasks and retention may benefit from AI assistance, outsized gains are lacking. Counterintuitively, specific tasks related to deep thinking and conceptual exploration are found to be better served with alternative approaches. We compare different features via hypothesis testing (p-values), ANOVA, logistic regression, and chi-square, highlighting relationships and the lack thereof. The data was collected across multiple colleges in various STEM disciplines, providing a robust cross-disciplinary perspective. Additionally, the paper discusses the influence of ethnic and cultural background, learning styles, technical talent, and other contributing factors to student success when utilizing LLMs.

Fried, M., & Alshibli, M. (2024, October), The Impact of AI Assistance on Student Learning: A Cross-Disciplinary Study in STEM Education Paper presented at 2024 Fall ASEE Mid-Atlantic Section Conference, Farmingdale State College, NY, New York. 10.18260/1-2--49457

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2024 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015