Asee peer logo

Explore the Possibility of Monitoring Project Member Interactions Using Natural Language Processing

Download Paper |

Conference

2025 ASEE Annual Conference & Exposition

Location

Montreal, Quebec, Canada

Publication Date

June 22, 2025

Start Date

June 22, 2025

End Date

August 15, 2025

Conference Session

DSAI Technical Session 7: Natural Language Processing and LLM Applications

Tagged Division

Data Science and Artificial Intelligence (DSAI) Constituent Committee

Tagged Topic

Diversity

Page Count

16

DOI

10.18260/1-2--56490

Permanent URL

https://peer.asee.org/56490

Download Count

5

Paper Authors

biography

Kaiwen Guo New York University Tandon School of Engineering

visit author page

Computer Science Senior at New York University

visit author page

author page

Malani Snowden New York University Tandon School of Engineering

biography

Rui Li New York University

visit author page

Dr. Li earned his master's degree in Chemical Engineering in 2009 from the Imperial College of London and his doctoral degree in 2020 from the University of Georgia, College of Engineering.

visit author page

Download Paper |

Abstract

This study looks into the use of team evaluation software, incorporating peer ratings, peer comments, and machine-learning-based analysis, to assess the project performance of student project teams. Teamwork is an essential competency for students. The early development of collaborative skills is critical for academic success and future career success.

Previous studies have suggested that the data-driven team evaluation could help with team performance evaluation. However, most of the team-based software will provides peer rating without detailed feedback of student team performance. CATME (Comprehensive Assessment of Team Member Effectiveness) greatly facilitates peer assessments by allowing students to rate and comment on each other's contributions, fostering accountability and constructive feedback. Additionally, machine learning algorithms analyze the collected data to identify patterns in team dynamics, on the five dimensions of CATME (Comprehensive Assessment of Team Member Effectiveness), individual participation and team synergy.

Natural Language Processing (NLP) tools plays a crucial role in evaluating team performance via analyzing communication, feedback, and interactions among team members. This study will further explore a variety of natural language processing tools, such as sentimental analysis, text classification, topic modeling, named entity recognition (identify potential project leaders), and keyword extraction.

By considering both human and machine evaluations, the study aims to provide a comprehensive assessment of team effectiveness, highlighting areas for growth for individual students. The findings suggest that this approach not only increase the efficiency of the evaluation process, but also possibly improve student engagement, and the overall quality of teamwork amongst student groups.

Guo, K., & Snowden, M., & Li, R. (2025, June), Explore the Possibility of Monitoring Project Member Interactions Using Natural Language Processing Paper presented at 2025 ASEE Annual Conference & Exposition , Montreal, Quebec, Canada . 10.18260/1-2--56490

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2025 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015