Asee peer logo

WIP: Generative AI as an Enhanced Study Aid in Engineering Courses

Download Paper |

Conference

ASEE Mid-Atlantic Section Spring Conference

Location

George Washington University, District of Columbia

Publication Date

April 19, 2024

Start Date

April 19, 2024

End Date

April 20, 2024

Page Count

11

DOI

10.18260/1-2--45744

Permanent URL

https://peer.asee.org/45744

Download Count

244

Paper Authors

author page

Stephen McGill Jr Villanova University

biography

Rebecca McGill Villanova University

visit author page

Dr. McGill is a faculty member in the Department of Mechanical Engineering at Villanova University, specializing in dynamics and controls. Her background lies in robotics and flapping-wing micro-aerial systems, and her current research interests are in flapping-wing aerial systems and robot-assisted agriculture.

visit author page

Download Paper |

Abstract

Engineering classrooms are marked by their balance between building foundational theory and giving examples to solidify understanding. Student performance improves with increased quantity and diversity of example problems; however, faculty members, especially those early in their careers, can find it burdensome to provide enough quality example problems to accommodate student interests and learning styles. Using Generative Artificial Intelligence (AI) can provide a novel approach to fill the gap between faculty resources and student demand. In our work, we assess the exam performance of undergraduate mechanical engineers when taking a course covering vibration analysis, both with and without the availability of Generative AI tools. For this single course, we analyzed the performance of the students over two semesters – the first shortly prior to the public release of the ChatGPT AI chatbot; the second shortly after the release of the tool – while introducing ChatGPT as a direct learning tool in the second semester of the course. The professor showed relevant example conversations with the AI chatbot, to pursue equitable and effective usage of new AI tooling by the student population. Following the professor’s example conversations, students can ask the chatbot to generate more examples, and the chatbot will also attempt to give and explain solutions. Students can also ask the chatbot follow-up questions to deepen their understanding and can interact with the AI tool when they study outside of the classroom. During class time, students receive exams that include straightforward computing of characteristic values relevant to vibration systems. Additionally, the exams contain word problems that require determining component values from design specifications. With exams designed for similar difficulty from semester to semester, we inspect performance differences in consecutive junior-level cohorts, specifically looking at performance on direct computation and on word problems with design decisions. This ongoing work seeks to capture the effects of embedding generative AI within the classroom. As the student body begins to adopt generative AI tooling, we see a unique opportunity to characterize the effects of AI integration.

McGill, S., & McGill, R. (2024, April), WIP: Generative AI as an Enhanced Study Aid in Engineering Courses Paper presented at ASEE Mid-Atlantic Section Spring Conference, George Washington University, District of Columbia. 10.18260/1-2--45744

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2024 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015