How Much Deadline Flexibility on Formative Assessments Should We Be Giving to Our Students?

Chenyan Zhao; Matthew West; Mariana Silva

Download Paper | Permalink

Conference: 2023 ASEE Annual Conference & Exposition
Location: Baltimore , Maryland
Publication Date: June 25, 2023
Start Date: June 25, 2023
End Date: June 28, 2023
Conference Session: COED: Grading Systems
Tagged Division: Computers in Education Division (COED)
Tagged Topic: Diversity
Page Count: 16
DOI: 10.18260/1-2--43372
Permanent URL: https://peer.asee.org/43372
Download Count: 491

Paper Authors

biography

Chenyan Zhao University of Illinois, Urbana-Champaign orcid.org/0000-0001-9520-2438

visit author page

Undergraduate computer science and mathematics student at University of Illinois Urbana-Champaign. Research interest in AI in computer science education

visit author page

biography

Matthew West University of Illinois, Urbana-Champaign orcid.org/0000-0002-7605-0050

visit author page

Matthew West is a Professor in the Department of Mechanical Science and Engineering at the University of Illinois at Urbana-Champaign.

visit author page

biography

Mariana Silva University of Illinois, Urbana-Champaign

visit author page

Mariana Silva is a Teaching Associate Professor in the Department of Computer Science at the University of Illinois at Urbana-Champaign. Silva is known for her teaching innovations and educational studies in large-scale assessments and collaborative learning. She has participated in two major overhauls of large courses in the College of Engineering: she played a key role in the re-structure of the three Mechanics courses in the Mechanical Science and Engineering Department, and the creation of the new computational-based linear algebra course, which was fully launched in Summer 2021. Silva research focuses on the use of web-tools for class collaborative activities, and on the development of online learning and assessment tools. Silva is passionate about teaching and improving the classroom experience for both students and instructors.

visit author page

Download Paper | Permalink

Abstract

Recent studies have proposed new ways of providing learning experiences and measuring students’ achievement of learning goals, grounded on the principles of growth mindset, mastery learning, and specifications grading. In one initiative called “A’s for All (as time and interest allow)”, students are given the support to achieve the proficiency they want (not necessarily an A) as long as they are willing to put in the time and effort, thus providing students more control over their learning. One mechanism to support proficiency at different paces is to soften some of the assignment deadlines. This can be easily implemented using computer-based assignments that are autograded with immediate feedback, following a mastery approach.

In this study we investigate one particular flexible deadline policy, in which the summative assessment (exam) dates are kept fixed but the formative assessments are given more flexible deadlines. We collected data from an upper-division required undergraduate computer science course offered at a large public research university including 375 students in Fall 2021. The course followed a flipped format, where students completed the following formative assessments: pre-lecture assignments with checkpoints, in-class collaborative learning activities and homework. All assessments were computer-based and auto-graded with unlimited attempts and immediate feedback. The summative assessments (exams) were scheduled every other week, starting from week 3, including the content of 3-4 homework and pre-lecture assignments.

The formative assessments used a mixed deadline schedule. To receive full credit in homework and pre-lectures, students were required to complete them within one week from the starting date. We kept this deadline to encourage students to stay on track with the course material. A flexible deadline was added for the formative assessments, namely that students were able to submit homework until the end of the semester for 96% credit and pre-lectures for 80% credit (there was no late deadline offered for group activities, since they were completed during lecture). This end-of-semester deadline offers an intermediate position between completely fixed deadlines, and completely flexible (where students can decide to take summative assessments at a later time as well).

Our first finding is that the flexible schedule resulted in fewer students completing the formative assessments, both before the exams and by the end of the semester. In particular, only 22% of the students completed the homework before the 100% deadline, 50% completed before the corresponding quiz, and 68% completed before the end of the semester. For comparison, in Fall 2019 74% of the students in the same course completed the homework by the one-week deadline.

Our second finding is that formative assessment completion was correlated with better performance on the exams, even when controlling for student GPA. We split the class into three groups based on their submission pattern: group 1 submitted the majority of assignments of each type (homework and pre-lectures) by the quiz date, group 3 did not submit the majority of assignments of any type by the quiz date, and group 2 was the remaining students with a mixed assignment completion rate. Linear regression results controlling for student GPA show that students in group 1 had 13.3% higher scores in exams and group 3 had 11.3% lower scores in exams, both compared to group 2.

We concluded that the system of fixed summative assessment dates and flexible formative assessment deadlines was detrimental to a substantial number of students. When the summative assessment dates are fixed, we thus conclude that more strict deadline policies are needed for formative assessments in order to support good time management practices.

Citation
Format

Zhao, C., & West, M., & Silva, M. (2023, June), How Much Deadline Flexibility on Formative Assessments Should We Be Giving to Our Students? Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--43372

TY  - CPAPER
AB  - Recent studies have proposed new ways of providing learning experiences and measuring students’ achievement of learning goals, grounded on the principles of growth mindset, mastery learning, and specifications grading. In one initiative called “A’s for All (as time and interest allow)”, students are given the support to achieve the proficiency they want (not necessarily an A) as long as they are willing to put in the time and effort, thus providing students more control over their learning. One mechanism to support proficiency at different paces is to soften some of the assignment deadlines. This can be easily implemented using computer-based assignments that are autograded with immediate feedback, following a mastery approach.

In this study we investigate one particular flexible deadline policy, in which the summative assessment (exam) dates are kept fixed but the formative assessments are given more flexible deadlines. We collected data from an upper-division required undergraduate computer science course offered at a large public research university including 375 students in Fall 2021. The course followed a flipped format, where students completed the following formative assessments: pre-lecture assignments with checkpoints, in-class collaborative learning activities and homework. All assessments were computer-based and auto-graded with unlimited attempts and immediate feedback. The summative assessments (exams) were scheduled every other week, starting from week 3, including the content of 3-4 homework and pre-lecture assignments.

The formative assessments used a mixed deadline schedule. To receive full credit in homework and pre-lectures, students were required to complete them within one week from the starting date. We kept this deadline to encourage students to stay on track with the course material. A flexible deadline was added for the formative assessments, namely that students were able to submit homework until the end of the semester for 96% credit and pre-lectures for 80% credit (there was no late deadline offered for group activities, since they were completed during lecture). This end-of-semester deadline offers an intermediate position between completely fixed deadlines, and completely flexible (where students can decide to take summative assessments at a later time as well). 

Our first finding is that the flexible schedule resulted in fewer students completing the formative assessments, both before the exams and by the end of the semester. In particular, only 22% of the students completed the homework before the 100% deadline, 50% completed before the corresponding quiz, and 68% completed before the end of the semester. For comparison, in Fall 2019 74% of the students in the same course completed the homework by the one-week deadline. 

Our second finding is that formative assessment completion was correlated with better performance on the exams, even when controlling for student GPA. We split the class into three groups based on their submission pattern: group 1 submitted the majority of assignments of each type (homework and pre-lectures) by the quiz date, group 3 did not submit the majority of assignments of any type by the quiz date, and group 2 was the remaining students with a mixed assignment completion rate. Linear regression results controlling for student GPA show that students in group 1 had 13.3% higher scores in exams and group 3 had 11.3% lower scores in exams, both compared to group 2.

We concluded that the system of fixed summative assessment dates and flexible formative assessment deadlines was detrimental to a substantial number of students. When the summative assessment dates are fixed, we thus conclude that more strict deadline policies are needed for formative assessments in order to support good time management practices.

AU  - Chenyan Zhao
AU  - Matthew West
AU  - Mariana Silva
CY  - Baltimore , Maryland
DA  - 2023/06/25
PB  - ASEE Conferences
TI  - How Much Deadline Flexibility on Formative Assessments Should We Be Giving to Our Students?
UR  - https://peer.asee.org/43372
DO  - 10.18260/1-2--43372
ER  -