Raj, J. N., & Muppa, A., & Nirmal, R., & Kamath, T. W., & Dipukumar, A., & Laddha, A., & Boicu, M. (2025, June), BOARD # 97: WIP: The Effectiveness of Rubric-Based LLM Feedback for Programming Assessments  Paper presented at 2025 ASEE Annual Conference & Exposition , Montreal, Quebec, Canada . 10.18260/1-2--55914

\bibitem{asee_peer_55914}
  Raj, J. N., \& Muppa, A., \& Nirmal, R., \& Kamath, T. W., \& Dipukumar, A., \& Laddha, A., \& Boicu, M. (2025, June), \emph{BOARD \# 97: WIP: The Effectiveness of Rubric-Based LLM Feedback for Programming Assessments}
  Paper presented at 2025 ASEE Annual Conference \& Exposition , Montreal, Quebec, Canada .
  10.18260/1-2--55914

Joel Nirupam Raj, Ashwath Muppa, Rhea Nirmal, Teo W. Kamath, Achyut Dipukumar, Aarush Laddha, and Mihai Boicu.  "BOARD # 97: WIP: The Effectiveness of Rubric-Based LLM Feedback for Programming Assessments".  2025 ASEE Annual Conference & Exposition , Montreal, Quebec, Canada , 2025, June.  ASEE Conferences, 2025.  https://peer.asee.org/55914 Internet.  27 Aug, 2025

\bibitem{asee_peer_55914}
  Joel Nirupam Raj, Ashwath Muppa, Rhea Nirmal, Teo W. Kamath, Achyut Dipukumar, Aarush Laddha, and Mihai Boicu.
  "BOARD \# 97: WIP: The Effectiveness of Rubric-Based LLM Feedback for Programming Assessments".
  \emph{2025 ASEE Annual Conference \& Exposition , Montreal, Quebec, Canada , 2025, June}.
  ASEE Conferences, 2025.
  https://peer.asee.org/55914 Internet.  27 Aug, 2025

@INPROCEEDINGS{asee_peer_55914
author = "Joel Nirupam Raj, Ashwath Muppa, Rhea Nirmal, Teo W. Kamath, Achyut Dipukumar, Aarush Laddha, and Mihai Boicu"
title = "BOARD \# 97: WIP: The Effectiveness of Rubric-Based LLM Feedback for Programming Assessments"
booktitle = "2025 ASEE Annual Conference \& Exposition "
year = "2025"
month = "June"
address = "Montreal, Quebec, Canada "
publisher = "ASEE Conferences"
note = {https://peer.asee.org/55914}
number = {10.18260/1-2--55914}
}

TY  - CPAPER
AB  - Automated feedback systems are becoming more important in programming education as class sizes grow, and instructor resources are limited. Recent advances in large language models (LLMs) offer a practical way for educators to provide structured feedback for students on various assignments.  A pre-experiment involved four student researchers solving Project Euler problems and showed an average improvement of 17.5 points on a scoring rubric out of 100 after code revision using feedback generated from Claude 3.5 Sonnet. There were also notable gains in time complexity, efficiency, and edge case handling, with percentage increases 24.45%, 22.59%, and 22%, respectively. Building on these results, we designed a classroom-based experiment involving students across various programming courses. Students will be divided into control (human feedback) and treatment (LLM feedback) groups, with feedback graded with a 14-criteria rubric. Claude 3.7 Sonnet will be the LLM used in this study, as it is the latest model released by Anthropic. The study evaluates both quantitative score improvements and students’ perceptions of feedback quality. The results of this study aim to inform the integration of LLMs into education assessment practices. 
AU  - Joel Nirupam Raj
AU  - Ashwath Muppa
AU  - Rhea Nirmal
AU  - Teo W. Kamath
AU  - Achyut Dipukumar
AU  - Aarush Laddha
AU  - Mihai Boicu
CY  - Montreal, Quebec, Canada 
DA  - 2025/06/22
PB  - ASEE Conferences
TI  - BOARD # 97: WIP: The Effectiveness of Rubric-Based LLM Feedback for Programming Assessments
UR  - https://peer.asee.org/55914
DO  - 10.18260/1-2--55914
ER  -