Asee peer logo

Work in Progress for Two Questions: Confusion Matrix Analysis of Student Think-Alouds during a Dynamics Concept Inventory Exam

Download Paper |

Conference

2023 ASEE Annual Conference & Exposition

Location

Baltimore , Maryland

Publication Date

June 25, 2023

Start Date

June 25, 2023

End Date

June 28, 2023

Conference Session

Will This Be on the Mechanics Test? Concept Inventories and Understanding Exams

Tagged Division

Mechanics Division (MECHS)

Page Count

9

DOI

10.18260/1-2--44110

Permanent URL

https://peer.asee.org/44110

Download Count

150

Paper Authors

biography

Julian Ly Davis University of Southern Indiana Orcid 16x16 orcid.org/0000-0003-4109-3904

visit author page

Jul Davis is an Associate Professor of Engineering at the University of Southern Indiana in Evansville, Indiana. He received his PhD in 2007 from Virginia Tech in Engineering Mechanics where he studied the vestibular organs in the inner ear using finite element models and vibration analyses. After graduating, he spent a semester teaching at a local community college and then two years at University of Massachusetts (Amherst) studying the biomechanics of biting in bats and monkeys, also using finite element modeling techniques. In 2010, he started his career teaching in all areas of mechanical engineering at the University of Southern Indiana (USI). He loves teaching all of the basic mechanics courses, and of course his Vibrations and Finite Element Analysis courses.

visit author page

biography

Andrew Jason Hill University of Southern Indiana

visit author page

Jason Hill is an associate professor of engineering and director of civil engineering at the University of Southern Indiana. He holds B.S., M.S., and Ph.D. degrees in civil engineering from Tennessee Technological University. His research interests include rainfall-runoff modeling, stream restoration, and wetland hydrology.

visit author page

Download Paper |

Abstract

Concept inventory question results are frequently used to evaluate students' overall understanding of course material. These questions focus only on foundational concepts rather than detailed problem solving. Dynamics concept inventory (DCI) exam results were analyzed for two semesters. Students were asked to audibilize their thoughts while taking the exam and being recorded. The video recordings of students taking the exam were transcribed for two questions. Results of two independent analyses of the transcriptions were summarized statistically in a confusion matrix. The confusion matrix is a 2x2 matrix with column headings scoring student oral reasoning and row headings scoring question outcome. These results are expected to illuminate the influence of luck verses true understanding during the exam.

Davis, J. L., & Hill, A. J. (2023, June), Work in Progress for Two Questions: Confusion Matrix Analysis of Student Think-Alouds during a Dynamics Concept Inventory Exam Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--44110

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2023 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015