Asee peer logo

Lessons Learned: Faculty Search Committees’ Attitudes Towards and Against Rubrics

Download Paper |

Conference

2023 ASEE Annual Conference & Exposition

Location

Baltimore , Maryland

Publication Date

June 25, 2023

Start Date

June 25, 2023

End Date

June 28, 2023

Conference Session

Faculty Development Division (FDD) Technical Session 4

Tagged Division

Faculty Development Division (FDD)

Tagged Topic

Diversity

Page Count

6

DOI

10.18260/1-2--43450

Permanent URL

https://peer.asee.org/43450

Download Count

198

Paper Authors

biography

Gabriella Coloyan Fleming University of Texas, Austin Orcid 16x16 orcid.org/0000-0002-6771-8741

visit author page

Dr. Gabriella Coloyan Fleming is a research associate in the Center for Equity in Engineering within the Cockrell School of Engineering at the University of Texas at Austin. She earned her B.S. in Mechanical Engineering from Carnegie Mellon University in 2012 and her M.S. and Ph.D. in Mechanical Engineering from UT Austin in 2014 and 2018, respectively. In addition to leading research and practice in the Center for Equity, her research interests include DEI topics in graduate education, faculty hiring, and the pathway to an academic career.

visit author page

Download Paper |

Abstract

This work describes the lessons learned from a study on faculty search committees about how and why rubrics were or were not used in their faculty search processes. Many institutions are recommending search committees use rubrics to provide fairer evaluation of candidates, and it has been shown that the use of rubrics in the faculty search process can help reduce some gender bias. Yet, many search committees have been slow to incorporate rubrics in the faculty candidate evaluation process. As part of a broader study on how faculty search committees evaluate candidates, we conducted 16 semi-structured interviews with the search committee chair and/or a member of 11 faculty search committees in science and engineering. Part of the interview protocol included questions about rubrics and the steps committees used to evaluate and advance candidates through each stage of the search process. The results of the study show that many search committees did not use a rubric at any stage in their search process, despite participating in a workshop that recommended using a rubric as a tool for equitable and inclusive hiring. Rubrics were most commonly used at the first stage of candidate evaluation (narrowing down the pool from all applicants to the first round of interviews), though some committees used a rubric to evaluate candidates in the first round of interviews. Additionally, a wide range of attitudes emerged. The most stubborn resistance came from searches where committee members felt rubrics were “not applicable” to a given search because their search spanned multiple research areas or their field was too interdisciplinary. Conversely, other search committees felt their process would not have been possible without rubrics because they help reduce bias and create a way value non-traditional metrics (i.e., those other than numbers of publications or citations). In learning about faculty’s attitudes towards and against rubrics, proponents can make more persuasive arguments for how and why they should be used to achieve a more equitable faculty search. We prefer to present this work as a lightning talk.

Fleming, G. C. (2023, June), Lessons Learned: Faculty Search Committees’ Attitudes Towards and Against Rubrics Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--43450

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2023 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015