Novice-led paired thematic analysis: A method for conceptual change in engineering

Devlin B. Montfort; Geoffrey L Herman; Shane A. Brown; Holly M Matusovich; Ruth A. Streveler

Download Paper | Permalink

Conference: 2013 ASEE Annual Conference & Exposition
Location: Atlanta, Georgia
Publication Date: June 23, 2013
Start Date: June 23, 2013
End Date: June 26, 2013
ISSN: 2153-5965
Conference Session: Educational Research and Methods (ERM) Poster Session
Tagged Division: Educational Research and Methods
Page Count: 9
Page Numbers: 23.933.1 - 23.933.9
DOI: 10.18260/1-2--22318
Permanent URL: https://peer.asee.org/22318
Download Count: 561

Paper Authors

author page

Devlin B. Montfort Washington State University

biography

Geoffrey L Herman University of Illinois, Urbana-Champaign orcid.org/0000-0002-9501-2295

visit author page

Professor Geoffrey L Herman is a Visiting Assistant Professor with the Illinois Foundry for Innovation in Engineering Education at the University of Illinois at Urbana-Champaign. He earned his Ph.D. in Electrical and Computer Engineering at the University of Illinois and conducted post-doctoral research in the School of Engineering Education at Purdue University. He now serves as the Intrinsic Motivation Course Conversion project lead with the iFoundry and on the steering committee of the College of Engineering's Strategic Instructional Initiatives Program.

visit author page

biography

Shane A. Brown P.E. Washington State University orcid.org/0000-0003-3669-8407

visit author page

Dr. Shane Brown conducts research on cognition and conceptual change in engineering. He received his bachelor’s and Ph.D. degrees from Oregon State University, both in civil engineering. His Ph.D. degree includes a minor in science and mathematics education. His master’s degree is in environmental engineering from the University of California, Davis. Dr. Brown is a licensed professional civil engineer and has six years of experience designing water and wastewater treatment facilities in central California. He was the recipient of the NSF CAREER award in 2011. Dr. Brown’s research interests are in conceptual change, epistemology, and social or situated cognition. Specifically, his research focuses on theoretical approaches to understanding why some engineering concepts are harder to learn than others, including the role of language and context in the learning process.

visit author page

author page

Holly M Matusovich Virginia Tech

biography

Ruth A. Streveler Purdue University, West Lafayette

visit author page

Ruth A. Streveler is an Associate Professor in the School of Engineering Education at Purdue University. Dr. Streveler has been the Principle Investigator or co-Principle Investigator of ten grants funded by the US National Science Foundation. She has published articles in the Journal of Engineering Education and the International Journal of Engineering Education and has contributed to the Cambridge Handbook of Engineering Education Research. She has presented workshops to over 500 engineering faculty on four continents. Dr. Streveler’s primary research interests are investigating students’ understanding of difficult concepts in engineering science and helping engineering faculty conduct rigorous research in engineering education.

visit author page

Download Paper | Permalink

Abstract

Novice-led paired thematic analysis: A method for conceptual change in engineeringConceptual change research is a major focus of STEM education researchers and fundingagencies. The dominant research methods have evolved over nearly 50 years and rely heavily oninterviews and thematic analysis of student statements. The purpose of this paper is to introducea new analysis technique. This analysis technique developed pragmatically over the course of ayear of collaborative analysis between two post-doctoral researchers. The project focused oninvestigating sets of student interviews in order to begin to develop a theory of conceptualchange in engineering.Novice-led paired thematic analysis is built on a dyadic interaction between researchers whereone researcher is significantly more familiar with and knowledgeable about the content area ofthe interviews. In these particular cases, the novice had usually had one pertinent undergraduatecourse within the last ten years without any follow-up engagement with the material. Themethod involves an iterative movement between three stages: 1) Instruction, 2) Parallel Coding,3) Discussion. These three stages periodically culminated in a fourth stage in which sustaineddisagreements from the Discussion stage are challenged and compared in terms of additionalresearch on the subject area (if necessary) and additional analysis.There is likely an ideal level of “novice,” or at least some practical range outside of which thebeneficial practices are overwhelmed by either too little or too much instruction. A key featureis the lack of shared assumptions; a novice who is familiar enough with the content to be able toimmediately discern the meaning and intent of the interview practices will not be able tointerrogate the data from a new perspective. Comparisons between the novice’s learningprocesses and the understanding of the student identify areas where purely expert analysis wouldunfairly devalue student reasoning, or conversely, where experts would inappropriately moresophisticated reasoning that students actually offered.

Citation
Format

Montfort, D. B., & Herman, G. L., & Brown, S. A., & Matusovich, H. M., & Streveler, R. A. (2013, June), Novice-led paired thematic analysis: A method for conceptual change in engineering Paper presented at 2013 ASEE Annual Conference & Exposition, Atlanta, Georgia. 10.18260/1-2--22318

TY - CPAPER
AB - Novice-led paired thematic analysis: A method for conceptual change in engineeringConceptual change research is a major focus of STEM education researchers and fundingagencies. The dominant research methods have evolved over nearly 50 years and rely heavily oninterviews and thematic analysis of student statements. The purpose of this paper is to introducea new analysis technique. This analysis technique developed pragmatically over the course of ayear of collaborative analysis between two post-doctoral researchers. The project focused oninvestigating sets of student interviews in order to begin to develop a theory of conceptualchange in engineering.Novice-led paired thematic analysis is built on a dyadic interaction between researchers whereone researcher is significantly more familiar with and knowledgeable about the content area ofthe interviews. In these particular cases, the novice had usually had one pertinent undergraduatecourse within the last ten years without any follow-up engagement with the material. Themethod involves an iterative movement between three stages: 1) Instruction, 2) Parallel Coding,3) Discussion. These three stages periodically culminated in a fourth stage in which sustaineddisagreements from the Discussion stage are challenged and compared in terms of additionalresearch on the subject area (if necessary) and additional analysis.There is likely an ideal level of “novice,” or at least some practical range outside of which thebeneficial practices are overwhelmed by either too little or too much instruction. A key featureis the lack of shared assumptions; a novice who is familiar enough with the content to be able toimmediately discern the meaning and intent of the interview practices will not be able tointerrogate the data from a new perspective. Comparisons between the novice’s learningprocesses and the understanding of the student identify areas where purely expert analysis wouldunfairly devalue student reasoning, or conversely, where experts would inappropriately moresophisticated reasoning that students actually offered.
AU - Devlin B. Montfort
AU - Geoffrey L Herman
AU - Shane A. Brown P.E.
AU - Holly M Matusovich
AU - Ruth A. Streveler
CY - Atlanta, Georgia
DA - 2013/06/23
PB - ASEE Conferences
TI - Novice-led paired thematic analysis: A method for conceptual change in engineering
UR - https://peer.asee.org/22318
DO - 10.18260/1-2--22318
ER -