Asee peer logo

Engage AI: Leveraging Video Analytics for Instructor-class Awareness in Virtual Classroom Settings

Download Paper |

Conference

2021 ASEE Virtual Annual Conference Content Access

Location

Virtual Conference

Publication Date

July 26, 2021

Start Date

July 26, 2021

End Date

July 19, 2022

Conference Session

Computers in Education 6: Best of CoED

Tagged Division

Computers in Education

Page Count

13

DOI

10.18260/1-2--37031

Permanent URL

https://peer.asee.org/37031

Download Count

556

Paper Authors

biography

Jeremy Stairs University of Toronto

visit author page

Jeremy Stairs is an undergraduate student in computer engineering and artificial intelligence at the University of Toronto (graduating May 2021).

visit author page

biography

Raman Mangla University of Toronto

visit author page

Raman Mangla is an undergraduate student studying computer engineering with focus on software and artificial intelligence at the University of Toronto (graduating May 2021).

visit author page

biography

Manik Chaudhery University of Toronto

visit author page

Manik Chaudhery is an undergraduate student studying Computer Engineering at the University Of Toronto with a focus on Artificial Intelligence and Business. Manik will be graduating in May 2021.

visit author page

biography

Janpreet Singh Chandhok University of Toronto

visit author page

Janpreet Singh Chandhok is an undergraduate student in computer engineering and artificial intelligence at the University of Toronto (graduating May 2021)

visit author page

biography

Hamid S. Timorabadi University of Toronto

visit author page

Hamid Timorabadi received his B.Sc, M.A.Sc, and Ph.D. degrees in Electrical Engineering from the University of Toronto. He has worked as a project, design, and test engineer as well as a consultant to industry. His research interests include the application of digital signal processing in power systems.

visit author page

Download Paper |

Abstract

Work in Progress Engage AI: Leveraging video analytics for instructor-class awareness in virtual classroom settings

A difficulty for teachers in COVID-era online teaching settings is assessing engagement and student attention. We developed a system called Engage AI for assessing engagement during live lectures. Engage AI uses video-based machine learning models to detect drowsiness and emotions like happiness and neutrality, and aggregates them in a dashboard that instructors can view as they speak. No video data is transmitted outside of students’ web browsers, and individual students are anonymous to the instructor. Testing in undergraduate engineering lectures resulted in 78.2% of students reporting feeling at least potentially more engaged during the lecture and at least 34.4% reporting feeling more engaged during the lecture. These approaches could be applicable to many forms of remote and in-person education.

Stairs, J., & Mangla, R., & Chaudhery, M., & Chandhok, J. S., & Timorabadi, H. S. (2021, July), Engage AI: Leveraging Video Analytics for Instructor-class Awareness in Virtual Classroom Settings Paper presented at 2021 ASEE Virtual Annual Conference Content Access, Virtual Conference. 10.18260/1-2--37031

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2021 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015