management and infrastructure resilience. This paper exploreshow generative AI can be leveraged by engineering educators to teach students advancedtechniques for wildfire prediction and geospatial analysis. Focusing on the use of generative AIin the classroom, the methodology demonstrates how students can engage with platforms likeGoogle Earth Engine to access and analyze satellite imagery and environmental datasets, such asMODIS Active Fire Detections and LANDSAT/Sentinel Burn Severity. By integrating generativeAI tools (e.g., ChatGPT, Gemini), educators can guide students through the process ofautomating code generation for wildfire location mapping, enhancing their problem-solvingskills and technical competence. The use of generative AI
Computer Science As a Test Case (Research to Practice)AbstractIntroduction: Because developing integrated computer science (CS) curriculum is aresource-intensive process, there is interest in leveraging the capabilities of AI tools, includinglarge language models (LLMs), to streamline this task. However, given the novelty of LLMs,little is known about their ability to generate appropriate curriculum content.Research Question: How do current LLMs perform on the task of creating appropriate learningactivities for integrated computer science education?Methods: We tested two LLMs (Claude 3.5 Sonnet and ChatGPT 4-o) by providing them with asubset of K-12 national learning standards for both CS and language arts and
. However, there are a few restrictions: • The minimum version of ChatGPT is specified. • Catching ChatGPT making oversimplifications is insufficient. • No purposely incorrect questions are allowed.After finding a misconception, students have to analyze the error and provide a detailedexplanation of what makes ChatGPT wrong. Additionally, they have to explain the concept thatwould correct its misunderstanding.For documentation, students must provide a link to the conversation, so that it is impossible tofake. However, there is still room for academic dishonesty, as there is no way to know if the ideawas suggested by someone else.3 Results and DiscussionWhile the assessment strategy has been well received and enjoyed by students
assignments. Thispaper presents the results of the surveys, analyzing students' initial perceptions, expectations, andexperiences with AI tools, as well as the strategies they employed to enhance their interactionswith ChatGPT during a structured assignment 2. MethodsThis study utilized a survey-based approach to examine the understanding, expectations, andperceived applications of artificial intelligence (AI) among first-year engineering and computingstudents. The survey was designed to capture the students’ initial perceptions prior to any formallecture on AI tools and their perspectives after engaging with the lecture content.The study included participants enrolled in an "Introduction to Engineering and Computing"course at xxxxxx University
findings reflect broadertrends observed in higher education; for instance, a recent global survey indicated that 24% ofstudents employ AI tools daily, and over half utilize them at least weekly [7]. Our cohort, beingpart of a technology-oriented graduate program, appears even more inclined toward frequent useof GenAI.Figure 1: Distribution of self-reported frequency of GenAI tool usage among Robotics MS students(N=19). About 47.3% use GenAI tools “Frequently” (weekly) or “Almost Daily,” while a minority(about 5.3%) use them rarely or never.As shown in Figure 2, ChatGPT is the leading GenAI platform among students, with nearly 90%utilizing it for academic tasks. Google’s Bard is accessed by approximately 50% of students,serving as an alternative to
propulsion systems and Engineering Education. ©American Society for Engineering Education, 2025 ACE up your Sleeve: An Analysis of Student Generative AI Usage in an Engineering Statics CourseAbstractRapid technological advancements, including the emergence of computer-aided design andsimulation, have had a significant impact on the engineering industry. This, in turn, extends toengineering education, demonstrating a similar influential effect. The latest development to havesuch reverberations is the launch of a generative artificial intelligence (AI) chatbot known asChatGPT. ChatGPT utilizes a large language model (LLM) that trains the platform to understandand generate human-like responses
on Python and creating the code for several assignedprograms, students are required to use ChatGPT or any other AI platform to create Python codefor a structural engineering application. As an embedded indicator for ABET Student Outcome7 (Lifelong Learning), students must learn and experiment with ChatGPT on their own. Assupport for Student Outcome 3 (Effective communication), students write an essay about theirresults, their AI experience, the learning strategies they applied, and the effectiveness andlimitations of using AI to write computer code. The students then use AI to rewrite their essayand comment on what they learned about the quality of their own writing.After running this exercise over three iterations of the ARCE 352 course
least somewhat be preparingthem for AI in the workplace. However, a 2024 survey of College and University ChiefAcademic Officers by Inside Higher Ed found that only 14 percent have reviewed the curriculumto ensure it will prepare students for AI in the workforce. Considering this information, what canwe do as educators to ensure our students in fields related to structural engineering are preparedfor AI in the workplace?This paper will discuss the evaluation of current generative AI chatbots in their unmodifiedconfigurations for their use in fields related to structural engineering. Various generative AIchatbots, including ChatGPT, Claude, Gemini, CoPilot, and SE GPT will be asked the samequestions related to the field of structural engineering
Worldwide in 2016 as an associate professor in the School of Engineering (formerly Department of Engineering and Technology).Dr. A. Mehran Shahhosseini, Indiana State University A. Mehran Shahhosseini is a Professor in the Department of Applied Engineering and Technology Management at Indiana State University. He has published over 65 articles in different journals and conferences ©American Society for Engineering Education, 2025 Leveraging AI-Based Tool to Guide Students on Literature Review: A Case StudyAbstractThis study aimed to compare the effectiveness of traditional literature review methods withAI-based search tools (ChatGPT 03Mini and Perplexity Pro Paid
matching industry expectations.GAI, as defined by ChatGPT -a conversational AI model developed by OpenAI-, “refers to aclass of artificial intelligence models designed to create new content, such as text, image, audio,or video, that resembles human-generated data. These models "generate" content by learningpatterns from large datasets during their training process”. Given its capabilities and rapidadoption across industries, integrating GAI into technical training may become essential forpreparing students for the workforce.With this in mind, this research aims to identify Industrial Engineering (IE) areas with significantGAI activity and use these insights to explore how IE education can be enhanced to better equipgraduates for the evolving job
course forum to use as prompts. Anexpert team of instructors evaluated each bot’s response for accuracy (hallucination) andhelpfulness. We used ChatGPT Pro as a baseline “generalist” chatbot.Overall, the specialist bots hallucinated less and were considered more helpful for studentquestions than the generalist bot. The best specialist bot was correct 80% of the time and helpful70% of the time. The generalist bot was correct 70% of the time and helpful only 26% of thetime. There were minimal performance differences between the specialist bots with varyingscopes.Our experience can guide educators using generative AI. First, a custom RAG chatbot is morehelpful than a general-purpose chatbot. Second, a single chatbot with a course-wide scope has
Engineering Education, 2025 Educators’ Perspectives on the use of Generative AI Tools in Teaching and Educational Research in EngineeringAbstractSince the release of ChatGPT by OpenAI in November 2022, the integration of generative AI(genAI) into teaching and education has gained significant attention and experienced rapid growthwithin university engineering programs. This paper investigates the application of genAI inengineering education and research, focusing on the potential benefits and challenges of itsadoption. Specifically, the study: A) Analyzes how educators and students perceive and utilizegenAI and ChatGPT in engineering education; B) Explores the advantages, challenges, andlimitations associated with these technologies
designs in mechanical engineering [65], making ethical choices during prototypingin time-sensitive situations such as hackathons [66], and learning disciplinary skills needed fordesign projects through personalized learning [67]. Lastly, a handful of papers explore howGenAI tools can give timely, relevant, and epistemic feedback during design. One exampleis the use of ChatGPT to analyze progress reports, instrumental to team collaborations, byrecommending readability improvements and clarifying complex ideas [68].3.3 PositionsOur review found 33 position papers revealing diverse viewpoints on its integration, eth-ical considerations, and potential applications of GenAI in EE. Specifically, these papersare where authors argue their stance on or
applications inlaboratory-based engineering education. The research questions of the systematic literaturereview correspond to the overall research questions (see Introduction). In the further course ofthe literature research, the research questions were broken down into key components and 11main keywords were defined. The keywords are “lecturers” and “students”, “NLP” and “AI”,“engineering education”, “potential”, “risk” and “limitations”, “feedback”, “competencies”and “laboratory”. In addition, synonyms “ChatGPT”, “gen AI”, “higher education”, “technicaleducation”, “advantages”, “changes”, “opportunities”, “critics”, “disadvantages”,“experiences”, “digital labs” and “online labs” were used, to name but a few. Search stringswere defined from the
textual data. For instance, we recently codedapproximately 10,000 state K-12 computer science standards, requiring over 200 hours of workby subject matter experts. If LLMs are capable of completing a task such as this, the savings inhuman resources would be immense.Research Questions: This study explores two research questions: (1) How do LLMs compare tohumans in the performance of an education research task? and (2) What do errors in LLMperformance on this task suggest about current LLM capabilities and limitations?Methodology: We used a random sample of state K-12 computer science standards. We comparedthe output of three LLMs – ChatGPT, Llama, and Claude – to the work of human subject matterexperts in coding the relationship between each state
ThermodynamicsAbstractGenerative artificial intelligence (GenAI) has become ubiquitous. Convincing languagecomplemented by constant modifications and upgrades have made GenAI models, such asOpenAI’s ChatGPT, an appealing tool to address complex problems. According to a survey byIntelligent.com nearly a third of college students in AY 2022-2023 used ChatGPT for schoolworkand 77.4% of them were likely to recommend using it to study to another student. Despite theirappeal, these models have proven flawed in answering technical prompts. Their convincinglanguage may entice the user to trust the responses without verifying them. For example, theauthors failed to retrieve accurate thermodynamics properties of some common substances fromthree publicly available models (OpenAI’s
Biomechanics, Medical Devices, Clinical Imaging and Bioinstrumentation.Dr. Bhavana Kotla, The Ohio State University Visiting Assistant Professor, Department of Engineering Education, College of Engineering, The Ohio State University ©American Society for Engineering Education, 2025 Assessing the Impact of Generative AI in Developing and Using Grading Rubrics for Engineering CoursesAbstractEngineering education is rapidly integrating generative artificial-intelligence (GenAI) tools thatpromise faster, more consistent assessment—yet their reliability in discipline-specific contextsremains uncertain. This mixed-methods study compared ChatGPT-4, Claude 3.5, and PerplexityAI across
content across a broad spectrum (e.g., texts, images, orprogramming code) for various domains based on basic user prompts” (13). There are a varietyof AI-T that have GenAI capabilities. LLMs such as ChatGPT, OpenAI, and Google Bard can beused to create unique natural language texts for research paper summaries or outlines forexample (8). Meneske explains, “Midjourney and DeepBrain AI are diffusion models that cancreate diagrams (e.g., concept maps), images, and videos from textual or visual inputs.Engineering education, in particular, can benefit from integrating and utilizing generative AItechnologies to improve instructional resources, develop new technology-enhanced learningenvironments, reduce instructors’ workloads, and provide students with
STEM majors to reconnect with and definehuman talents and abilities to solve human problems and develop technological solutions.IntroductionGenerative Artificial Intelligence (GenAI) offers tools to transform K-12 science, engineering,technology, and mathematics (STEM) education. Teachers can use GenAI technology such asChatGPT to supplement their teaching methods or create content such as course outlines andquizzes; students can use it to help with homework and to receive formative feedback on theirwork [1, 2]. ChatGPT is a large-lanuage model (LLM) chatbot; it generates human-like textresponses based on training from a large amount of data [3]. A March 2023 survey of 1,002 K-12teachers found that over half of respondents (51%) reported using
, zhesong, bmaxim, kkattan}@umich.edu Department of Computer and Information Science, University of Michigan-Dearborn, USAAbstractThis paper presents an investigation into the use of Generative AI (GenAI), specifically ChatGPT,to automate quiz generation in higher education by conducting a case study in a graduateArtificial Intelligence (AI) course. The study aims to compare the quality and relevance ofAI-generated quizzes with manually created ones, addressing a critical question in computerscience education: Can Generative AI effectively support educators in creating assessments thatalign with course learning objectives?We conducted the study in a graduate-level AI course, which involved 47 students, one instructorand one
civil engineering and architecture professions[2], while the second article explores the integration of human and artificial intelligence in civilengineering [3]. In their analysis, the instructor asked the students to discuss how GenAI couldenhance efficiency and safety in the field and the ethical challenges associated with GenAI use.Students were asked to critically assess the AI-generated output, verify facts, and document theirinteractions with the GenAI tool by providing all prompts. Additionally, students were asked toprovide a brief reflective analysis of the AI tools they used, such as ChatGPT, and how theseinfluenced their learning. II. The Course and the AssignmentsStructural Steel Design is a senior-level elective and one of
, particularly alarge language model (LLM), in writing education, the systematic studies related to the ethicaluse of GAI are limited. While grounded in the ethical adaptation of GAI in grading and feedbackfor engineering lab writing, we focus on GAI’s capability to assist with engineering lab reportassessment. Lab report grading is time-consuming for lab instructors and teaching assistants.Moreover, constructing impactful feedback can be challenging for many reasons. In this pilotstudy, we used Copilot and ChatGPT 4o to conduct evaluation and feedback on student labreports of past courses when the instructors did not use generative AI technologies. The studyspace was limited to the two engineering labs in two institutions: strength of materials
equitable and effective AI integration. By carrying out thiscomprehensive review, our study will guide future research, inform policy decisions, and supportthe development of AI-enhanced educational practices that are both innovative and inclusive.AppendicesAppendix A Database Search Term Using Inclusion Criteria Number ERIC (Via (Belief* OR attitude* OR perception* OR behavior OR teaching 116 EBSCO) OR assessment OR pedagogy OR practice* OR challenge* OR adoption OR implementation) AND (Engineer*) AND (("generative artificial intelligence" OR "generative AI" OR "Gen AI") OR (chatbots OR ChatGPT OR "Microsoft Copilot" OR Gemini or LLaMA) OR (LLM
introducing GenAI into student assessments. This study is standaloneand preliminary; it is not planned to be part of a broader research program.BackgroundOver the past few years, text-based chatbots based on Generative Artificial Intelligence (GenAI)large language models (LLMs) have soared in both public availability and usage [1] [2]. Themost popular of these, ChatGPT, has grown in popularity at growth rates never seen in theinternet age [3]. This growth has driven advances in usability and functionality, while alsoraising questions of legal ethics and morality [2]. The consistent viewpoint is that GenAI is hereto stay and humans need to adapt to this new reality. Educators have shifted from awe ofGenAI’s capabilities, to fear of academic integrity
the latest OpenAI and Anthropic models: ChatGPT 4o [9] and Claude 3.5Sonnet [10]. These two models were selected based on previous benchmark results for reasoningand mathematics [11, 12]. In some of our experiments, the AI LLMs are used ‘as is’ or ‘off theshelf’ - no training and no instructions. In other experiments, the AI LLMs are trained, i.e.instructions are fed into the AI program along with one or more chapters of the course textbook.In evaluating the ability of LLM chatbots to act like a very good TA, we sought to investigatehow the AI TA performs for different amounts of instruction / training prior to asking questions.In our tests, all chatbots are configured with temperature set to 0.3 and a maximum token size of2048.3.3.1
Meslem, Bergische Universit¨at Wuppertal ©American Society for Engineering Education, 2025 WIP: AI in Online Laboratory Teaching - A Systematic Literature ReviewIntroductionThe presence of ChatGPT has recently, and in a short period of time, become increasinglyprevalent in the day-to-day life. Education, being a part and a reflection of the day-to-day life,has therefore also been affected by this change. The fast spread of this technology within thiscontext has however come with its challenges. These include the lack of an adequateunderstanding of it, of how to use it, and how to integrate it in an efficient way in the dailylife (Gill & Kaur, 2023). Many students
[4]. In2024, more research is available for AI in education and industry, including as a virtual assistantusing AI as a prompting tool [14], and as a development bot to enhance software design [18].With the popularity of ChatGPT increasing, from one million users in the first week during thelaunch in 2022, to more than 200 million weekly users in late 2024 [16], the usage of ChatGPTin college engineering courses is expected to follow a significant increase soon. Using AI in the engineering classroom has been seen to offer both advantages anddisadvantages. Students saw an increased confidence in decision-making, critical thinking andproblem-solving skills using AI tools, which may help develop professional skills [14]; however,the
focus of the literature. Within the first monthsof its launch, it was found that ChatGPT could pass law school exams, though it only managed aC+ [20]. This is just one example of the deluge of papers describing how large language modelscan perform reasonably well on traditional examinations (e.g., [21], [22], [23], [24], [25]). Thesemodels are trained using large and diverse sets of writing and employ statistical procedures topredict a response to a statement or question, which can lead to surprising coherence and theappearance of analytical reasoning.In STEM fields, where communication is less in written short responses and more often acombination of diagrams and equations, generative AI tools have seen uneven success in problem-solving. For
estimating methods [9].Additionally, Ghasemi and Dai [10] investigated the use of GPT-4 in construction estimating,mainly for cost analysis and bid pricing in a bridge rehabilitation project. The study found thatGPT-4 “holds the potential for construction estimating with reasonable accuracy.” Despiteshowing potential, the authors noted that issues related to consistency and reliability could limitGPT-4’s use in complex or novel estimating scenarios [10].AI in Engineering EducationArtificial intelligence (AI) is increasingly integrated into engineering education, reshaping howstudents learn and educators teach. ChatGPT and other generative AI tools are also gainingattention in engineering education. Qadir [11] discussed the potential of generative AI
University in the City of New York Sakul Ratanalert is a Senior Lecturer in Discipline in the Department of Chemical Engineering at Columbia University. He received his BS in Chemical and Biomolecular Engineering from Cornell University, and his MS in Chemical Engineering Practice and his PhD in Chemical Engineering from MIT. His current research interests include developing engaging learning activities and building students’ intuition and conceptual understanding. ©American Society for Engineering Education, 2025 Development of an MEB Novice Chatbot to Improve Chemical Engineering Critical ThinkingAbstractThe rise of ChatGPT, and other generative AI tools, has led