Asee peer logo

A Pilot Study of the Use and Attitudes Toward Large Language Models Across Academic Disciplines

Download Paper |

Conference

2024 ASEE Annual Conference & Exposition

Location

Portland, Oregon

Publication Date

June 23, 2024

Start Date

June 23, 2024

End Date

July 12, 2024

Conference Session

Multidisciplinary Engineering Division (MULTI) Technical Session 10

Tagged Division

Multidisciplinary Engineering Division (MULTI)

Permanent URL

https://peer.asee.org/46474

Request a correction

Paper Authors

biography

Lawrence E. Whitman University of Arkansas at Little Rock

visit author page

Dr. Lawrence Whitman is Dean of the Donaghey College of Science, Technology, Engineering, and Mathematics.

Dr. Whitman earned his Bachelor's degree in Mechanical Engineering Design Technology from Oklahoma State University where he also earned his Master

visit author page

biography

Kristin Dutcher Mann University of Arkansas at Little Rock

visit author page

Kristin Dutcher Mann is professor of history and social studies education coordinator at the University of Arkansas at Little Rock. A specialist in the colonial history of the U.S.-Mexico Borderlands, she has authored a book and articles about music, dance, and material culture. She often works with K-12 and college faculty to incorporate reading, writing, and primary source document analysis into instruction. Her latest research is part of an interdisciplinary project to examine student perceptions of the use of large language models such as ChatGPT and Microsoft CoPilot in academic work.

visit author page

biography

Amar Shireesh Kanekar University of Arkansas at Little Rock

visit author page

Dr. Kanekar is a Professor and Graduate Program Coordinator for Health Education and Health Promotion at the University of Arkansas at Little Rock. His 17 years of teaching experience involves more than 30 different courses (undergraduate and graduate) in the areas of public health, health education and health promotion. Recipient of numerous teaching awards at the international, national and local levels, his pedagogical techniques involve online –distance learning, hybrid, and face-to-face courses.
He has published more than 80 publications (refereed and non-refereed) and his research areas of interest focus on adolescent health, measurement in health education, global health, online and hybrid pedagogy, and health behavior interventions. He currently serves as a Certified in Public Health ambassador for the National Board of Public Health Examiners and on the Arkansas Public Health Education Board

visit author page

author page

Albert L Baker University of Arkansas at Little Rock

biography

Srikanth B Pidugu P.E. University of Arkansas at Little Rock

visit author page

Dr. Pidugu is a Professor and Director (Interim) of School of Engineering and Engineering Technology at University of Arkansas at Little Rock. He obtained Ph.D. in Mechanical Engineering at Old Dominion University in 2001.

visit author page

Download Paper |

Abstract

This study investigates college students' use of and attitude toward large language models (LLMs). The primary research questions are, “What are students’ perceptions of the ethical use of large language models in college coursework and other settings?” and “How does teaching about large-language models impact student understanding of the applications of machine-learning, plagiarism, and ethics in specific content areas?”

Our mixed-methods study involves pre- and post-module surveys with questions assessing students' attitudes and perceptions about the ethics of large language model use in college and professional settings. The learning module includes an introductory video, interactive slide presentation, and discussion questions. We collected additional data through a related assignment. Participants were students from introductory engineering courses, along with those in computer science, science, and humanities courses, in the fall 2023 semester.

Our study considers the impact of LLMs in engineering education, addressing opportunities for enhancing students' understanding of machine learning and ethical considerations in college and the workplace. The results will offer insights to educators, allowing for more effective integration of LLMs in engineering curricula.

Whitman, L. E., & Mann, K. D., & Kanekar, A. S., & Baker, A. L., & Pidugu, S. B. (2024, June), A Pilot Study of the Use and Attitudes Toward Large Language Models Across Academic Disciplines Paper presented at 2024 ASEE Annual Conference & Exposition, Portland, Oregon. https://peer.asee.org/46474

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2024 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015