Asee peer logo

VISUALIZING STUDENT CALIBRATION BY DEVELOPING TAG-ENHANCED OPEN LEARNER MODELS: TOWARDS SELF-REGULATED LEARNING

Download Paper |

Conference

2022 ASEE Illinois-Indiana Section Conference

Location

Anderson, Indiana

Publication Date

April 9, 2022

Start Date

April 9, 2022

End Date

April 9, 2022

Page Count

10

DOI

10.18260/1-2--42141

Permanent URL

https://peer.asee.org/42141

Download Count

125

Request a correction

Paper Authors

author page

Suneer Angra University of Illinois Urbana-Champaign

author page

Drashti Sikligar University of Illinois at Urbana-Champaign

author page

Colin Widmer Castleberry University of Illinois at Urbana - Champaign

biography

Jennifer R Amos University of Illinois at Urbana - Champaign

visit author page

Jennifer Amos is a Teaching Professor in Bioengineering and also has affiliate appointments in the Health Sciences Engineering Center, Carle Illinois College of Medicine, and Educational Psychology units. Amos’ research revolves around assessment in engineering and medical education. Her work serves to support development and testing of student facing assessment dashboards to aid students in self-regulated learning processes.

visit author page

Download Paper |

Abstract

In the near future we might be facing an increase in class diversity, increase in class size, and shift to online platforms. Moreover, the current COVID crisis highlighted inequities in access to education as it moved online. In such scenarios students’ ability to self-regulate their learning and instructors’ ability to dynamically adapt their teaching become important. But current assessment techniques struggle to facilitate adaptive teaching or to promote self-regulated learning.

Accurate knowledge monitoring or self-evaluation is a critical part of self-regulated learning. Calibration describes the relationship between the learner’s performance and the perception of their performance on a task. Towards this, we explore how asking students to self-evaluate and visualizing their calibration affects their calibration accuracy over time. We leverage Open Learner Models to create and share such visualizations. Also, introducing descriptive digital tags into assessment material is a useful method to effectively organize and analyze both group and individual student performance information for such visualizations.

We added digital tags to create tag-organized assessments for an undergraduate bioengineering course. The assessments prompted students to self-evaluate after each question. When students were weekly presented with tag-enhanced OLMs, one visualizing their calibration and other their relative performance to class, there was an overall improvement in calibration accuracy moving from Exam 1 to Exam 3, both for low and high performers.

Angra, S., & Sikligar, D., & Castleberry, C. W., & Amos, J. R. (2022, April), VISUALIZING STUDENT CALIBRATION BY DEVELOPING TAG-ENHANCED OPEN LEARNER MODELS: TOWARDS SELF-REGULATED LEARNING Paper presented at 2022 ASEE Illinois-Indiana Section Conference , Anderson, Indiana. 10.18260/1-2--42141

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2022 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015