Developing Reviewer Profiles Using Analysis of Prior Authorship
- Conference
- Location
-
Salt Lake City, Utah
- Publication Date
-
June 23, 2018
- Start Date
-
June 23, 2018
- End Date
-
July 27, 2018
- Conference Session
- Tagged Division
-
Computers in Education
- Page Count
-
10
- DOI
-
10.18260/1-2--30311
- Permanent URL
-
https://peer.asee.org/30311
- Download Count
-
401
Paper Authors
Matthew A. Verleger Ph.D. (He/His/Him) Embry-Riddle Aeronautical University
Matthew Verleger is an Associate Professor of Engineering Fundamentals at Embry-Riddle Aeronautical University in Daytona Beach, Florida. His research interests are focused on using action research methodologies to develop immediate, measurable improvements in classroom instruction and the use of Model-Eliciting Activities (MEAs) in teaching students about engineering problem solving. Dr. Verleger is an active member of ASEE. He also serves as the developer and site manager for the Model-Eliciting Activities Learning System (MEALearning.com), a site designed for implementing, managing, and researching MEAs in large classes.
Abstract
Peer review is a cornerstone of academic research dissemination. It is a fundamental prerequisite for “good” research, even though the process of selecting reviewers is largely shrouded in mystery. Under ideal conditions, reviewers are experts on a paper’s topic, but the process of identifying that expertise varies widely from publication venue to venue. The purpose of this paper is to (1) identify some of the methods currently used by conference and journal editors, and (2) present an alternative methodology used by the author to identify and assign reviewers for a division of ASEE during the summer of 2017.
The author, as program chair of a large division, developed software that data-mined the prior ASEE conference papers of any potential reviewer to identify the words and phrases frequently used in their prior ASEE papers. Using this data, a Reviewer Profile was developed that identified areas of expertise. Using a similar process, papers being reviewed were profiled to the types of expertise necessary – a Paper Need Profile. For each paper, a list of potential reviewers was selected based on alignment between the Reviewer Profiles and Paper Need Profile for that paper. The list was further filtered to remove (co-)authors and reviewers who had already been assigned at least two papers. The remaining list was then used to select the final reviewers.
This paper will present details of the Reviewer Profile algorithm, the Paper Need Profile algorithm, the matching algorithm, and an analysis of the effectiveness of the overall assignment methodology. The conclusion will explore how this work may translate into classroom peer review as well as a discussion of how this methodology could be applied across ASEE and in other professional publication venues.
Verleger, M. A. (2018, June), Developing Reviewer Profiles Using Analysis of Prior Authorship Paper presented at 2018 ASEE Annual Conference & Exposition , Salt Lake City, Utah. 10.18260/1-2--30311
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2018 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015