Asee peer logo

Student and Teacher Perceptions of a Classroom Response System: Demographic Comparisons in a First Semester Calculus Course

Download Paper |

Conference

2021 ASEE Virtual Annual Conference Content Access

Location

Virtual Conference

Publication Date

July 26, 2021

Start Date

July 26, 2021

End Date

July 19, 2022

Conference Session

Mathematics Division Technical Session 1

Tagged Division

Mathematics

Tagged Topic

Diversity

Page Count

12

Permanent URL

https://peer.asee.org/37740

Download Count

35

Request a correction

Paper Authors

biography

Patricia A. Ralston University of Louisville

visit author page

Dr. Patricia A. S. Ralston is Professor and Chair of the Department of Engineering Fundamentals at the University of Louisville. She received her B.S., MEng, and PhD degrees in chemical engineering from the University of Louisville. Dr. Ralston teaches undergraduate engineering mathematics and is currently involved in educational research on the effective use of technology in engineering education, the incorporation of critical thinking in undergraduate engineering education, and retention of engineering students. She leads a research group whose goal is to foster active interdisciplinary research which investigates learning and motivation and whose findings will inform the development of evidence-based interventions to promote retention and student success in engineering. Her fields of technical expertise include process modeling, simulation, and process control.

visit author page

biography

Campbell R. Bego University of Louisville Orcid 16x16 orcid.org/0000-0002-8125-3178

visit author page

An Assistant Professor with research in engineering education, Campbell R. Bego, PhD, PE, is interested
in improving STEM student learning and gaining understanding of STEM-specific learning mechanisms
through controlled implementations of evidence-based practices in the classroom. Dr. Bego has
an undergraduate Mechanical Engineering degree from Columbia University, a Professional Engineering
license in the state of NY, and a doctorate in Cognitive Science.

visit author page

Download Paper |

Abstract

This paper assesses the implementation of formative assessment in a Calculus I course for engineering students with Pearson’s Classroom response system (CRS): Learning Catalytics. Formative assessment is an instructional technique in which teachers quickly assess students during class for minimal reward/penalty. This assessment helps both students and teachers to identify knowledge gaps and address them [1]. This can be greatly beneficial to entry-level mathematics courses in engineering programs, where misconceptions often go unnoticed until an important summative exam that is critical for student grades. In fact, some research has already shown that formative assessment benefits students in calculus courses [2]–[4].

Although formative assessment has been used for many years with clickers, recent advancements in technology have made it easier to implement formative assessment in class. Technologies now include phone and computer-based Classroom Response Systems (CRSs) such as TopHat, Kahoot and Mentimeter. Reviews have suggested that CRSs provide benefits for students by increasing engagement and offering instant, formative assessment [5], [6]. However, research on these technologies is limited. Recently, the Classroom Response System Perceptions (CRiSP) questionnaire [7] was developed to assess student perceptions of a CRS’s usability and its effect on their engagement and learning. Use of this survey is limited in the literature, but provides very helpful feedback to instructors as they work to add useful formative assessment in their courses.

The current study measures student and teacher perceptions of CRS Learning Catalytics as it was used for formative assessment in two sections of Calculus I classes in fall 2019 (N = 140). The implementation of formative assessment was a deliberate modification of a primarily lecture-based Calculus I course, and the CRS was intentionally used during most lectures each week. The lead instructor of the course had 38 years of experience with primarily lecture-style instruction. At the end of the semester, students were given the CRiSP questionnaire, and the lead teacher reflected on the implementation. Our research questions include: RQ1: Did students perceive Learning Catalytics to be usable and effective for engagement and learning? RQ2: Were there differences in perceptions for at-risk student groups (female, or low SES; the racial minority student population in this sample was too small for analysis)? RQ3: How did the instructor perceive the use of the Learning Catalytics? We first used descriptive statistics to evaluate learner perceptions of usability, engagement, and learning using responses to the CRiSP questionnaire. The survey results showed that students perceived Learning Catalytics to have a positive influence on all three components. In the full paper, survey responses will be compared across gender (female, N = 41) and socio-economic status (Pell-Eligible, N = 38) using statistical analyses of variance (ANOVAs), using weighted means if necessary due to unequal sample sizes. Instructor perceptions will also be described.

Ralston, P. A., & Bego, C. R. (2021, July), Student and Teacher Perceptions of a Classroom Response System: Demographic Comparisons in a First Semester Calculus Course Paper presented at 2021 ASEE Virtual Annual Conference Content Access, Virtual Conference. https://peer.asee.org/37740

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2021 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015