Computer-Mediated Peer Review: A Comparison of Calibrated Peer Review and Moodle’s Workshop
- Conference
- Location
-
Columbus, Ohio
- Publication Date
-
June 24, 2017
- Start Date
-
June 24, 2017
- End Date
-
June 28, 2017
- Conference Session
- Tagged Division
-
Computers in Education
- Page Count
-
13
- DOI
-
10.18260/1-2--28064
- Permanent URL
-
https://peer.asee.org/28064
- Download Count
-
690
Paper Authors
Patricia Carlson Rose-Hulman Institute of Technology
Dr. Patricia ”Pat” A. Carlson is a transplanted middle westerner, having spent her childhood in Norfolk, Va. She came to Rose-Hulman Institute of Technology early in her teaching career and has taught a variety of courses over the past three decades. Dr. Carlson has held a number of American Society for Engineering Education summer fellowships that have taken her to NASA-Goddard, NASA-Langley, the Army Research Laboratory in Aberdeen, Maryland, and NASA’s Classroom of the Future in Wheeling, W.Va. She was on loan to the Air Force Human Resources Laboratory from 1989 to 1995, managing a project to transition advanced instructional technologies to ten different middle schools located in five states. She is on the editorial board of three professional publications and has served as National Research Council Senior Fellow assigned to the Air Force Human Resources Laboratory. In her spare time, Pat enjoys reading and gardening.
Ryan Smith Rose-Hulman Institute of Technology
Ryan Smith has served as webmaster and system administrator of the PRISM Project for the past 14 years. He is a 2002 computer engineering graduate of Rose-Hulman Institute of Technology. As part of his duties, Smith manages the PRISM server infrastructure, performs database administration, manages systems security, and coordinates distance education online courses on the PRISM website. In addition, Smith researches new web technologies to implement for the PRISM Project. In 2008, Smith received the Hoosier Educational Computer Coordinators HERO award for his contributions to integrating technology in Indiana education. In 2011, the PRISM team received the Rose-Hulman Institute of Technology Excellence in Service Award.
Abstract
Based on our extensive experience with Computer-Mediated Peer Review (CMPR) software in engineering education, we compare Calibrated Peer Review (developed at UCLA) and Moodle’s Workshop. Our examination includes four criteria for each platform’s effectiveness, both for students and for instructors. First, does the software include a cohesive mental model to facilitate a complex task? Second, does the scaffolding elicit / improve reliable student response? Third, are students encouraged to use peer commentary in the learning process? Fourth, does the platform collect and return empirical results that can be used as measures of course learning outcomes? We end with suggestions for improving return-on-investment for instructors and with advice for dealing with student receptivity.
Carlson, P., & Smith, R. (2017, June), Computer-Mediated Peer Review: A Comparison of Calibrated Peer Review and Moodle’s Workshop Paper presented at 2017 ASEE Annual Conference & Exposition, Columbus, Ohio. 10.18260/1-2--28064
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2017 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015