Asee peer logo

CATME or ITP Metrics? Which One Should I Use for Design Team Development and Assessment?

Download Paper |

Conference

2018 ASEE Annual Conference & Exposition

Location

Salt Lake City, Utah

Publication Date

June 23, 2018

Start Date

June 23, 2018

End Date

July 27, 2018

Conference Session

Teamwork and Student Learning in Design

Tagged Division

Design in Engineering Education

Page Count

17

DOI

10.18260/1-2--30179

Permanent URL

https://peer.asee.org/30179

Download Count

2142

Paper Authors

biography

Marnie V. Jamieson University of Alberta

visit author page

Marnie V. Jamieson, M. Sc., P.Eng. is an Industrial Professor in Chemical Process Design
In the Department of Chemical and Materials Engineering at the University of Alberta and holds a M.Sc. in Chemical Engineering Education. Her current research focuses on the application of blended and active learning to design teaching and learning, student assessment, and continuous course improvement techniques. She managed and was a key contributor to a two-year pilot project to introduce Blended Learning into Engineering Capstone Design Courses, and is a co-author with John M. Shaw on a number of recent journal, book, and conference contributions on engineering design education.

visit author page

biography

John M. Shaw University of Alberta

visit author page

John M. Shaw PhD., P.Eng. is a Professor and NSERC Industrial Chair in Petroleum Thermodynamics in the Department of Chemical and Materials Engineering at the University of Alberta. He has used distance synchronous teaching/learning approaches since the 1990’s to co-instruct graduate courses with colleagues and students at remote locations, and has been a member of the University of Alberta Provost’s Digital Learning Committee since its inception. He won an undergraduate student-sponsored teaching/mentorship award in 2009 and led a two-year pilot project to introduce Blended Learning into Engineering Capstone Design Courses. He is a co-author with Marnie V. Jamieson on a number of recent journal, book, and conference contributions on engineering design education.

visit author page

Download Paper |

Abstract

Abstract The characteristics of and the correlation of high performing teams with individual satisfaction and excellent task results have been studied extensively. Consequently, these characteristics have become selection criteria for new graduates, and development and performance benchmarks for employees and entrepreneurs alike, that define aspects of corporate culture. The University of Alberta Faculty of Engineering design, and engineering and safety risk management instructors have been using the Comprehensive Assessment of Team Member Effectiveness (CATME) from Purdue University for peer evaluation and team selection for the past several years. Different departments use CATME to varying degrees and for various purposes. The Individual and Team Performance Metrics Lab (ITP Metrics), at the University of Calgary Psychology Department in cooperation with the Schulich School of Engineering also at the University of Calgary have developed a set of research-backed team and leadership tools including peer evaluation tools and team formation tools for student and industry use. These on-line assessment tools differ in methodology, scope, emphasis user interface, feedback format, and cost. The selection of a peer evaluation and feedback system, for student use and evaluation, should consider the development of skills, as well as the reliability of the method to assess differential grades for students on teams when required. The method of data collection, the type of feedback and the contextual validity of the feedback may impact students’ development of useful team behaviours and personal strategies for working in team environments. In this contribution, a comparative analysis of CATME and ITP Metrics is provided. Instructor experiences with these assessment tools are then reported and discussed based on student pre and post skill self-evaluation in a design course where CATME and then ITP Metrics evaluations were used for sequential student cohorts.

Jamieson, M. V., & Shaw, J. M. (2018, June), CATME or ITP Metrics? Which One Should I Use for Design Team Development and Assessment? Paper presented at 2018 ASEE Annual Conference & Exposition , Salt Lake City, Utah. 10.18260/1-2--30179

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2018 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015