Hicks, N. M., & Douglas, K. A. (2018, June), Efforts to Improve Undergraduate Grader Consistency: A Qualitative Analysis  Paper presented at 2018 ASEE Annual Conference & Exposition , Salt Lake City, Utah. 10.18260/1-2--30366

\bibitem{asee_peer_30366}
  Hicks, N. M., \& Douglas, K. A. (2018, June), \emph{Efforts to Improve Undergraduate Grader Consistency: A Qualitative Analysis}
  Paper presented at 2018 ASEE Annual Conference \& Exposition , Salt Lake City, Utah.
  10.18260/1-2--30366

Nathan M. Hicks and Kerrie A. Douglas.  "Efforts to Improve Undergraduate Grader Consistency: A Qualitative Analysis".  2018 ASEE Annual Conference & Exposition , Salt Lake City, Utah, 2018, June.  ASEE Conferences, 2018.  https://peer.asee.org/30366 Internet.  27 Apr, 2025

\bibitem{asee_peer_30366}
  Nathan M. Hicks and Kerrie A. Douglas.
  "Efforts to Improve Undergraduate Grader Consistency: A Qualitative Analysis".
  \emph{2018 ASEE Annual Conference \& Exposition , Salt Lake City, Utah, 2018, June}.
  ASEE Conferences, 2018.
  https://peer.asee.org/30366 Internet.  27 Apr, 2025

@INPROCEEDINGS{asee_peer_30366
author = "Nathan M. Hicks and Kerrie A. Douglas"
title = "Efforts to Improve Undergraduate Grader Consistency: A Qualitative Analysis"
booktitle = "2018 ASEE Annual Conference \& Exposition "
year = "2018"
month = "June"
address = "Salt Lake City, Utah"
publisher = "ASEE Conferences"
note = {https://peer.asee.org/30366}
number = {10.18260/1-2--30366}
}

TY  - CPAPER
AB  - In this research paper, we explore the difficult decisions faced by large-scale, multi-section courses in early undergraduate engineering education regarding fair and consistent assessment of student learning across sections.  Our previous analysis of grading patterns of undergraduate graders in a first-year engineering course revealed that divergent decisions likely stemmed from two sources: insufficient grader training and ambiguities in rubrics and assignments.  After revising rubrics and implementing grader training for a semester, we conducted think-aloud interviews with 17 undergraduate graders regarding grading, rubrics, and training.  Qualitative analysis identified four technical aspects of rubrics that led to divergent grading decisions (wordiness, redundancies, unexpected solutions, and grade misfit) and five aspects that limited training effectiveness (length, misalignment, insufficient feedback, limited consequences, and philosophical misunderstanding).  These findings contribute nuance to and extend upon aspects of rubric design and undergraduate grader training that have been previously identified in the literature.  Recommendations related to issues identified are provided.
AU  - Nathan M. Hicks
AU  - Kerrie A. Douglas
CY  - Salt Lake City, Utah
DA  - 2018/06/23
PB  - ASEE Conferences
TI  - Efforts to Improve Undergraduate Grader Consistency: A Qualitative Analysis
UR  - https://peer.asee.org/30366
DO  - 10.18260/1-2--30366
ER  -