Asee peer logo

“What did I just miss?!” Presenting ClassTranscribe, an Automated Live-captioning and Text-searchable Lecture Video System, and Related Pedagogical Best Practices

Download Paper |

Conference

2019 ASEE Annual Conference & Exposition

Location

Tampa, Florida

Publication Date

June 15, 2019

Start Date

June 15, 2019

End Date

June 19, 2019

Conference Session

Technical Session 13: Digital Learning

Tagged Division

Computers in Education

Page Count

13

DOI

10.18260/1-2--31926

Permanent URL

https://peer.asee.org/31926

Download Count

713

Paper Authors

biography

Chirantan Mahipal University of Illinois, Urbana-Champaign

visit author page

I'm a Computer Science grad student at University of Illinois, Urbana-Champaign, working under the mentorship of Prof. Lawrence Angrave. Prior to this, I was working as a Research Fellow at Microsoft Research in the Technology for Emerging Markets (TEM) group.

visit author page

biography

Lawrence Angrave University of Illinois at Urbana-Champaign Orcid 16x16 orcid.org/0000-0001-9762-7181

visit author page

Lawrence Angrave is an award winning Teaching Professor at the department of computer science at University of Illinois at Urbana-Champaign (UIUC). His interests include (but are not limited to) joyful teaching, empirically-sound educational research, campus and online courses, computer science, engaging underrepresented students, improving accessibility and creating novel methods to create, adapt and enhance learning opportunities and learning communities.

visit author page

biography

Yuren Xie University of Illinois at Urbana-Champaign

visit author page

I am a senior Computer Science and Statistics and Mathematics student studying at the University of Illinois at Urbana-Champaign. I really appreciate that I can live in a world where science and technology have been being used to make the world better, and it is my honor that I can get involved in this huge revolution. My belief is to make the world better with the combination of education and computer science.

visit author page

biography

Biswadeep Chatterjee University of Illinois, Urbana-Champaign

visit author page

Currently a undergraduate computer science student at the University of Illinois Urbana-Champaign

visit author page

biography

Hongyu Wang University of Illinois, Urbana-Champaign Orcid 16x16 orcid.org/0000-0003-4661-5003

visit author page

Hongyu Wang is currently a CS undergraduate student at the University of Illinois, Urbana-Champaign.

visit author page

biography

Zhengru Qian University of Illinois, Urbana-Champaign

visit author page

Computer Science Undergraduate

visit author page

Download Paper |

Abstract

Captioning of recorded video content has been available for over four decades, but its importance and pedagogical use has seen a recent revival due to the legal accessibility compliance requirements of MOOC and online content, and secondly, due to efforts by universities to bring digital accessibility to their on-campus learning environments.

We present an open-source web-platform, ClassTranscribe, and related pedagogical practices, to enhance student learning both during lectures, and during later searching and viewing of recorded lectures. Using recent advances in automated Speech-To-Text (STT) technologies, it is possible to provide low-cost, accurate, and timely, text-searchable recorded lecture videos, and, in-class live-captioning that is informed by domain-specific words. Using a crowd-sourced approach, captions of lecture recordings can be incrementally improved above the limitations of automated STT approaches. The design of the ClassTranscribe platform is extensible and scalable. We demonstrate captioning of content by integrating with two websites used to host lecture videos, youtube.com and echo360.com.

Secondly, we report on suggested technology and practices to support live class captioning for instructors who use PowerPoint, a document camera, live coding, and other presentation styles. Using Universal Design for Learning, we discuss lecture captions and recorded lectures as an assistive technology that can also assist all students. As an example of this, we describe how distractions in lecture and a student’s limited attention span may cause students to lose focus, context ("What did I just miss?!"), and fail to grasp the topic. By providing a live caption history on student devices, students can refocus, reconnect, and thus have an opportunity to learn the current lecture topic being presented.

Mahipal, C., & Angrave, L., & Xie, Y., & Chatterjee, B., & Wang, H., & Qian, Z. (2019, June), “What did I just miss?!” Presenting ClassTranscribe, an Automated Live-captioning and Text-searchable Lecture Video System, and Related Pedagogical Best Practices Paper presented at 2019 ASEE Annual Conference & Exposition , Tampa, Florida. 10.18260/1-2--31926

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2019 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015