Portland, Oregon
June 23, 2024
June 23, 2024
June 26, 2024
Computers in Education Division (COED)
13
10.18260/1-2--48457
https://peer.asee.org/48457
947
Han Kyul Kim is a Ph.D. student in the Department of Industrial and Systems Engineering at the University of Southern California. He earned his M.S. in Industrial Engineering from Seoul National University and holds B.S. degrees in Industrial & Systems Engineering and Business and Technology Management from KAIST. Previously, he worked as a data scientist and software engineer at Deloitte Consulting, Samsung Electronics, and Seoul National University Hospital. His research interests include machine learning, natural language processing, and learning analytics.
Aleyeh Roknaldin is earning her Ph.D. in industrial and systems engineering from the Daniel J. Epstein Department of Industrial and Systems Engineering at the University of Southern California (USC). Aleyeh earned an M.S. in Engineering Management in 2022 from USC and her B.S. in Chemical Engineering from the University of California, Davis in 2020. Her research interests include learning analytics to investigate how students learn from one another in computer-supported collaborative learning environments and how students interact with generative artificial intelligence in learning contexts.
Xiaoci Zhang received his Bachelor’s in Industrial
Engineering and a minor in Mathematics from the
Pennsylvania State University in 2021. Currently, he
is pursuing his Master’s in Industrial and System
Engineering at the University of Southern California.
His research interests include machine learning, data
analysis, and mathematical optimizations.
Stephen Lu is the David Packard Chair in Manufacturing Engineering at University of Southern California. His current professional interests include design thinking, collaborative engineering, technological innovation, and education reform. He has over 330
The growing popularity of generative AI (genAI), particularly ChatGPT, has sparked enthusiasm and caution among education practitioners and researchers. To harness the full potential of generative AI in educational contexts, it is crucial to thoroughly analyze its impact and suitability for different educational purposes. This work serves as an initial step towards our long-term research goal of integrating generative AI as a "brainstorming partner" in the context of computer-supported collaborative learning (CSCL). Rather than immediately outlining requirements and developing components for ChatGPT to function as an independent brainstorming partner, the primary objective of this paper is to examine ChatGPT's impact in a collaborative creative ideation process.
As an example of CSCL, this paper delves into students' creative group brainstorming activities. In this educational context, the learning objective lies in encouraging students to creatively apply their factual knowledge without rigid concerns about correctness. Diverging from recent concerns about hallucination and academic integrity involving genAI in education, our paper introduces a unique application of genAI where these concerns hold relatively less significance. Furthermore, we quantitatively analyze the influence of ChatGPT on the creativity of ideas emerging from group brainstorming sessions. Specifically, we describe how students incorporate ChatGPT into their ideation process and observe its impact on the perceived creativity levels of the generated ideas. Additionally, we explore whether leveraging ChatGPT leads to more homogeneous ideas among students, potentially challenging the collaborative and diversity-centric learning objective of group brainstorming.
Our investigation involves a statistical analysis and natural language processing techniques to digital logs, discussion messages and product design ideas generated by 33 students over a two-week period in a graduate-level product engineering class. The students were randomly organized into teams comprising of 4 to 5 individuals to engage in group discussions in an online platform. Their task was to brainstorm and discuss new product ideas that aligned with specific user requirements. In select groups, ChatGPT was introduced as an additional member, providing students with the capability to direct questions during their ideation process.
Our findings illustrate that students predominantly utilize ChatGPT during their initial ideation stage, injecting their own modifications and enhancements to its responses. Surprisingly, ideas generated with ChatGPT are perceived as more creative by the students, potentially attributed to their relatively detailed descriptions. Furthermore, our observations indicate that the use of ChatGPT does not necessarily lead to homogenous ideas, as students' prompts to ChatGPT and its responses exhibit linguistic diversity.
This paper not only offers a unique application of genAI in the educational landscape but also provides valuable insights into the nuanced dynamics of integrating ChatGPT as a collaborative partner during creative ideation. Our results pave the way for further exploration, showcasing the potential of genAI to enhance collaborative learning experiences while fostering creativity among students.
Kim, H. K., & Roknaldin, A., & Nayak, S. P., & Zhang, X., & Yang, M., & Twyman, M., & Hwang, A. H., & Lu, S. (2024, June), ChatGPT and Me: Collaborative Creativity in a Group Brainstorming with Generative AI Paper presented at 2024 ASEE Annual Conference & Exposition, Portland, Oregon. 10.18260/1-2--48457
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2024 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015