June 26, 2011
June 26, 2011
June 29, 2011
Computers in Education
22.261.1 - 22.261.15
Assessment of the CATME Peer Evaluation Tool EffectivenessIn project intensive courses student teams are used to enable completion of significant work and,hopefully, significant learning in one semester. Faculty desire to use peer evaluations and self-evaluations to assess how much each team member contributes to the overall effort and success ofthe team. Ideally, the evaluations and assessments will lead students to modify their behavior toimprove their effectiveness on teams. This paper describes an attempt to measure progress towardsthe goal of leveraging peer and self-evaluations to change student behavior.The Comprehensive Assessment of Team Member Effectiveness (CATME) was developed usingextensive university research. A web-based survey at www.catme.org makes it possible to collectdata on team-member effectiveness in five areas that research has shown to be important. 1. Contributing to the team’s work 2. Interacting with teammates 3. Keeping the team on track 4. Expecting quality 5. Having relevant knowledge skills and abilitiesThis tool was implemented in a junior level product design class. The class is focused on a team,semester long, externally sponsored, design and build project. Students were asked to complete peerand self-evaluations three times during the semester. Students reactions to the feedback theyreceived from the CATME system were gauged using survey and self-reflection tools.More importantly, the faculty hope to use the tool to catalyze change in student behavior over time.The authors used this tool toThe comprehensive assessment of team member effectiveness(CATME) software was used to assess junior engineering student’s team effectiveness. Anadditional survey was used to quantify what if any effects the feedback from the CATMEsoftware had on the student’s behavior.
Pung, C. P., & Farris, J. (2011, June), Assessment of the CATME Peer Evaluation Tool Effectiveness Paper presented at 2011 ASEE Annual Conference & Exposition, Vancouver, BC. 10.18260/1-2--17542
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2011 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015