Virtual On line
June 22, 2020
June 22, 2020
June 26, 2021
Design in Engineering Education
Those who teach design contend with issues of authenticity and engagement. A problem that is too narrow or open can be challenging for students, yet finding that Goldilocks middle ground is complicated by many factors. Framing agency—making decisions that are consequential to framing and solving design problems—appears to provide clarity about student engagement with different types of design problems. However, detecting framing agency in design team talk is a labor intensive process. The purpose of this study was to evaluate a variety of text mining approaches for suitability in detecting framing agency in transcribed talk. We found no correlation between human-coding and sentiment analysis. However, interestingly, polarity derived from sentiment analysis did differentiate between a team that displayed almost no framing agency and those that did, with the former showing a high level of positivity. This reflects the lack of struggle, high certainty and agreeability the team displayed as they quickly agreed they all had similar and therefore correct answers. We also trained a Regularized Support Vector Machine Classifier to predict levels of framing agency, with the human-coded data as training data. The model showed 89% accuracy in detecting high framing agency. Given the recent increase in quality of auto-transcription tools, such approaches may lead to in-situ detectors in future.
Raihanian Mashhadi, A., & Svihla, V. (2020, June), Automating Detection of Framing Agency in Design Team Talk Paper presented at 2020 ASEE Virtual Annual Conference Content Access, Virtual On line . 10.18260/1-2--34199
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2020 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015