Doerry, E., & Palmer, J. D. (2011, June), Improving Efficacy of Peer-Evaluation in Team Project Scenarios  Paper presented at 2011 ASEE Annual Conference & Exposition, Vancouver, BC. 10.18260/1-2--18113

\bibitem{asee_peer_18113}
  Doerry, E., \& Palmer, J. D. (2011, June), \emph{Improving Efficacy of Peer-Evaluation in Team Project Scenarios}
  Paper presented at 2011 ASEE Annual Conference \& Exposition, Vancouver, BC.
  10.18260/1-2--18113

Eckehard Doerry and James Dean Palmer.  "Improving Efficacy of Peer-Evaluation in Team Project Scenarios".  2011 ASEE Annual Conference & Exposition, Vancouver, BC, 2011, June.  ASEE Conferences, 2011.  https://peer.asee.org/18113 Internet.  11 Feb, 2025

\bibitem{asee_peer_18113}
  Eckehard Doerry and James Dean Palmer.
  "Improving Efficacy of Peer-Evaluation in Team Project Scenarios".
  \emph{2011 ASEE Annual Conference \& Exposition, Vancouver, BC, 2011, June}.
  ASEE Conferences, 2011.
  https://peer.asee.org/18113 Internet.  11 Feb, 2025

@INPROCEEDINGS{asee_peer_18113
author = "Eckehard Doerry and James Dean Palmer"
title = "Improving Efficacy of Peer-Evaluation in Team Project Scenarios"
booktitle = "2011 ASEE Annual Conference \& Exposition"
year = "2011"
month = "June"
address = "Vancouver, BC"
publisher = "ASEE Conferences"
note = {https://peer.asee.org/18113}
number = {10.18260/1-2--18113}
}

TY  - CPAPER
AB  -        Tracking Individual Performance in Team Project ScenariosThe past decades have brought a growing awareness of the value of integrating training in abroad range of “soft skills” – including teaming, project management, and oral and writtencommunication – into the modern engineering curriculum. As a result, the vast majority ofengineering programs now include one or more project courses in the curricular core, in whichstudents work in teams to solve realistic engineering challenges.This renewed emphasis on team-based project work, along with recent ABET guidelinesrequiring programs to document learning outcomes at the individual level, has exacerbated anage-old problem with team-based projects: how to reliably measure individual contributions togroup performance in a team-based project scenario. In the worst case (often called “coat-tailing”), one or more team members contribute little or nothing, forcing their teammates to pickup the slack — and yet all team members end up receiving the same “team grade” when theproject concludes.In general, the problem is that, although team projects undoubtedly have strong potential fordeveloping critical teaming skills (e.g., project management; task decomposition, distribution,and monitoring; and team communication), individual performance in these skill areas is noteasily accessible to the instructor; monitoring and documenting the extent to which individuallearning actually occurs (e.g., for grading, for ABET) in team project contexts represents adifficult challenge.In this paper, we review existing approaches to evaluating student performance in project teams,then build on this to describe our own experiences in our team-based Capstone course over thepast decade. In particular, we describe an effective system we have developed to gain insightinto internal team dynamics and individual performance, based on structured task reports andpeer evaluations. Earlier evolutionary variants of our system and their weaknesses are describedas well, to rationalize and motivate the development of our current approach. Discussion issupported by examples and analyses from data collected over the years; by juxtaposing thesedata with actual problems encountered in corresponding teams, we are even able to identifyseveral typical “trouble profiles” for dysfunctional teams. Benefits include early detection ofinternal team difficulties, a low-overhead system for documenting individual contributions inteam contexts, and a strong mechanism for differentiating student grades based on individualperformance. Using our system, it is quite possible for one team member to receive a D, whileanother receives an A and team deliverables as a whole receive a B.We conclude by describing our current grant-funded effort to implement our project teammanagement system within a secure web portal linked to existing project course websites. Ourgoal is to fully-automate the team management process, further reducing the overhead on theinstructor while allowing real-time feedback to team members and automatically generatingdocumentation on contributions/performance for individual team members. This will also allowus to explore the intriguing potential for fuzzy detection of the “trouble profiles” mentionedabove, allowing the system to automatically flag developing problems for instructor attention.
AU  - Eckehard Doerry
AU  - James Dean Palmer
CY  - Vancouver, BC
DA  - 2011/06/26
PB  - ASEE Conferences
TI  - Improving Efficacy of Peer-Evaluation in Team Project Scenarios
UR  - https://peer.asee.org/18113
DO  - 10.18260/1-2--18113
ER  -