Salt Lake City, Utah
June 23, 2018
June 23, 2018
July 27, 2018
Educational Research and Methods
In this research paper, we explore the difficult decisions faced by large-scale, multi-section courses in early undergraduate engineering education regarding fair and consistent assessment of student learning across sections. Our previous analysis of grading patterns of undergraduate graders in a first-year engineering course revealed that divergent decisions likely stemmed from two sources: insufficient grader training and ambiguities in rubrics and assignments. After revising rubrics and implementing grader training for a semester, we conducted think-aloud interviews with 17 undergraduate graders regarding grading, rubrics, and training. Qualitative analysis identified four technical aspects of rubrics that led to divergent grading decisions (wordiness, redundancies, unexpected solutions, and grade misfit) and five aspects that limited training effectiveness (length, misalignment, insufficient feedback, limited consequences, and philosophical misunderstanding). These findings contribute nuance to and extend upon aspects of rubric design and undergraduate grader training that have been previously identified in the literature. Recommendations related to issues identified are provided.
Hicks, N. M., & Douglas, K. A. (2018, June), Efforts to Improve Undergraduate Grader Consistency: A Qualitative Analysis Paper presented at 2018 ASEE Annual Conference & Exposition , Salt Lake City, Utah. https://peer.asee.org/30366
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2018 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015