Baltimore , Maryland
June 25, 2023
June 25, 2023
June 28, 2023
Chemical Engineering Division (ChED) Technical Session 9: Student Experiences in Laboratory Courses
Chemical Engineering Division (ChED)
14
10.18260/1-2--44166
https://peer.asee.org/44166
237
Jennifer Brown is an Associate Professor in the Chemical and Biological Engineering Department at Montana State University in Bozeman MT.
Stephanie Wettstein is an Assistant Professor in the Chemical and Biological Engineering department at Montana State University in Bozeman, MT. She has been the faculty advisor of the MSU SWE chapter since 2013.
Dr. Hacker is Professor Emeritus in the Department of Educational Psychology and participates in both the Learning Sciences Program and the Reading and Literacy Program.
The purpose of this work was to test the inter-rater reliability (IRR) of a rubric used to grade technical reports in a senior-level chemical engineering laboratory course that has multiple instructors that grade deliverables. The rubric consisted of fifteen constructs that provided students detailed guidance on instructor expectations with respect to the report sections, formatting and technical writing aspects such as audience, context and purpose. Four student reports from previous years were scored using the rubric, and IRR was assessed using a two-way mixed, consistency, average-measures intraclass correlation (ICC) for each construct. Then, the instructors met as a group to discuss their scoring and reasoning. Multiple revisions were made to the rubric based on instructor feedback and constructs rated by ICC as poor. When fair or poor constructs were combined, the ICCs improved. In addition, the overall score construct continued to be rated as excellent, indicating that while different instructors may have variation at the individual construct level, they evaluate the overall quality of the report consistently. A key learning from this process was the importance of the instructor discussion around their reasoning for the scores and the importance of an ‘instructor orientation’ involving discussion and practice using the rubrics in the case of multiple instructors or a change in instructors. The developed rubric has the potential for broad applicability to engineering laboratory courses with technical writing components and could be adapted for alternative styles of technical writing genre.
Brown, J. R., & Wettstein, S. G., & Hacker, D. J. (2023, June), Rubric Development for Technical Reports in Chemical Engineering Unit Operations Laboratory Courses Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--44166
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2023 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015