Asee peer logo

Reliability of the Global Real-time Assessment Tool for Teaching Enhancement (G-RATE)

Download Paper |


2013 ASEE Annual Conference & Exposition


Atlanta, Georgia

Publication Date

June 23, 2013

Start Date

June 23, 2013

End Date

June 26, 2013



Conference Session

Training and Mentoring of Graduate Teaching Assistants

Tagged Division

Graduate Studies

Page Count


Page Numbers

23.1032.1 - 23.1032.7



Permanent URL

Download Count


Request a correction

Paper Authors

author page

Nikitha Sambamurthy Purdue University, West Lafayette


Jeremi S London Purdue University, West Lafayette

visit author page

Jeremi S. London is a graduate student at Purdue University. She is pursing a Ph.D. in Engineering Education. In 2008, she earned a Bachelor of Science in Industrial Engineering from Purdue, and a Master of Science in Industrial Engineering from Purdue in 2013. Her research interests include: the use of cyberlearning in science, technology, engineering, and mathematics (STEM) education; assessing the impact of cyberlearning; and exploring ways computer simulations can be used to understand complex education systems. In addition to conducting mixed methods research in formal academic settings, she has worked in various Industrial Engineering roles at Anheuser-Busch, Inc., and General Electric-Healthcare. She continues to conduct education policy research as part of her internship role in the Division of Undergraduate Education at the National Science Foundation.

visit author page

author page

Jeeyeon Hahn Purdue University

author page

Jiabin Zhu Purdue University, West Lafayette


Monica Farmer Cox Purdue University, West Lafayette

visit author page

Monica F. Cox, Ph.D., is an Associate Professor in the School of Engineering
Education at Purdue University and is the Inaugural Director of the Engineering Leadership Minor. She obtained a B.S. in mathematics from Spelman College, a M.S. in industrial engineering from the University of Alabama, and a Ph.D. in Leadership and Policy Studies from Peabody College of Vanderbilt University. Teaching interests relate to the professional development of graduate engineering students and to leadership, policy, and change in science, technology, engineering, and mathematics education. Primary research projects explore the preparation of engineering doctoral students for careers in academia and industry and the development of engineering education assessment tools. She is a National Science Foundation Faculty Early Career (CAREER) award winner and is a recipient of a Presidential Early Career Award for Scientists and Engineers (PECASE).

visit author page

Download Paper |


Reliability of the Global Real-time Assessment Tool for Teaching Enhancement (G-RATE)In response to the need for research-based assessment tools for effective teaching and to providefeedback to graduate teaching assistants about their instructional interactions in a classroom, theGlobal Real-time Assessment Tool for Teaching Enhancement (G-RATE) has been developed.The G-RATE has a flexible and easy-to-use interface that allows use in lecture and laboratoryenvironments to collect data from a variety of stakeholders, including undergraduate students,instructors, researchers, and administrators.This paper presents a brief overview of the revised version of the Observer function of the G-RATE (Cox, Hahn, McNeill, Cekic, Zhu, & London, 2011) (Figure 1), which collects real-timeclassroom data framed within the context of Bransford, Brown, and Cocking’s (1999) “HowPeople Learn” framework and reports information about the reliability of this function. Usingboth pen-and-paper and video vignettes of engineering classroom occurrences, researchers reportthe process for determining the interrater (interobserver) reliability of this function and reportpossible changes to the G-RATE based upon reliability measures. Future work related to theObserver function is presented. Figure 1. Revised Observer function of the G-RATEREFERENCECox, M.F., Hahn, J., McNeill, N., Cekic, O., Zhu, J. & London, J. (2011). Enhancing the Quality of Engineering Graduate Teaching Assistants through Multidimensional Feedback. Advances in Engineering Education, 2(3), 1-20.Bransford, J. D., Brown, A. L., & Cocking, R. R. (Eds). How People Learn: Brain, Mind, Experience, and School. Washington, DC: National Academy Press, 1999.

Sambamurthy, N., & London, J. S., & Hahn, J., & Zhu, J., & Cox, M. F. (2013, June), Reliability of the Global Real-time Assessment Tool for Teaching Enhancement (G-RATE) Paper presented at 2013 ASEE Annual Conference & Exposition, Atlanta, Georgia. 10.18260/1-2--22417

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2013 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015