Asee peer logo

Connecting Dots: Coding Multiple Data Sources to Enhance Qualitative Analysis

Download Paper |

Conference

2019 ASEE Annual Conference & Exposition

Location

Tampa, Florida

Publication Date

June 15, 2019

Start Date

June 15, 2019

End Date

June 19, 2019

Conference Session

NEE - 3: Improving Homework and Problem-solving Performance

Tagged Division

New Engineering Educators

Page Count

10

DOI

10.18260/1-2--32536

Permanent URL

https://peer.asee.org/32536

Download Count

86

Request a correction

Paper Authors

biography

Devayan Debashis Bir Iowa State University

visit author page

Devayan D. Bir is a Ph.D. student in the Department of Aerospace Engineering at Iowa State University. He earned his B.E. from Hindustan University, Chennai, India, and a M.S. from Iowa State University at Ames in Aerospace Engineering. Prior to pursuing his M.S., he worked as a CFD analyst for two years. His current research interests include student retention, online and flipped instruction, and STEM teaching at the K-12 level using quantitative and qualitative inquiry. He is particularly interested in teaching undergraduate students and has taught Mechanics of Materials at the university.

visit author page

author page

Benjamin Ahn Iowa State University

biography

Bora Cetin Iowa State University

visit author page

Assistant Professor in the Department of Civil, Construction, and Environmental Engineering

visit author page

biography

Secil Akinci-Ceylan Iowa State University

visit author page

Secil Akinci-Ceylan is a PhD student in Education at Iowa State University. She received her BA in Linguistics at Hacettepe University, Turkey in 2008. She holds a Master's degree in Teaching English as a Second Language in Applied Linguistics Program at Iowa State University. She worked as a lecturer at Izmir Institute of Technology between 2009 and 2012 and then at Iowa State University in 2016 and 2017.

visit author page

biography

Kristen Sara Cetin P.E. Iowa State University

visit author page

Dr. Kristen S Cetin is an Assistant Professor at Iowa State University in the Department of Civil, Construction and Environmental Engineering.

visit author page

biography

Andrea E. Surovek South Dakota School of Mines and Technology

visit author page

Dr. Andrea Surovek is a research scientist working in the areas of biomimicry for sustainable construction and engineering education at the South Dakota School of Mines and Technology. She is the recipient of the ASEE CE Division Seeley Fellowship and the Mechanics Division Beer and Johnston Outstanding New Mechanics Educator Award. She is a fellow of ASCE and ASCE/SEI. She received her PhD from Georgia Tech, and also holds degrees in both Civil Engineering and Visual and Performing Arts from Purdue University.

visit author page

biography

Kristin Lerdal South Dakota School of Mines and Technology

visit author page

Kristin Lerdal is an Undergraduate Research Assistant studying creativity in engineering education at the South Dakota School of Mines and Technology. She is working towards a Bachelors of Science degree in Civil Engineering with an Environmental Emphasis.

visit author page

biography

Mary Michelle Anton Iowa State University

visit author page

My name is Mary Anton and I am a third-year undergraduate at Iowa State University. I am majoring in mathematics with teaching licensure and am pursuing a Learning Technologies minor. I hope to teach middle school or high school mathematics after graduation.

visit author page

author page

Kyle R. Thompson Iowa State University

Download Paper |

Abstract

This research paper elaborates on the process used by a team of researchers to create a codebook from interviews of Civil Engineers, including students, professors, and professionals, solving ill-structured problems. The participants solved two ill-structured problems while they verbalized their solution process. In addition to recording the participant verbalization, the solution to their problems were also collected with the use of a smart pen. Creating a codebook from interviews is a key element of qualitative engineering education research forming the basis for the analysis. While individuals can create codebooks for analysis, a team-based approach is advantageous especially when dealing with large amounts of data. A team-based approach involves an iterative process of inter-rater reliability essential to the trustworthiness of the data analysis. In addition to coding the transcripts as a team, which consisted of novice, intermediate, and experts in the engineering education field, the audio and written solution to the problems were also coded. The use of multiple data sources to obtain data, and not just the verbatim transcripts, is lesser studied in engineering education literature and provides opportunities for a more detailed qualitative analysis. Initial codes were created from existing literature, which were refined through an iterative process. This process consisted of coding data, team consensus on coded data, codebook refinement, and recoding data with the refined codes. Results show that coding verbatim transcripts might not provide and accurate representation of data which may lead to erroneous results. Benefits, challenges and recommendations regarding the use multiple sources to obtain valid data are discussed while considering the amount of time required to conduct such analysis.

Bir, D. D., & Ahn, B., & Cetin, B., & Akinci-Ceylan, S., & Cetin, K. S., & Surovek, A. E., & Lerdal, K., & Anton, M. M., & Thompson, K. R. (2019, June), Connecting Dots: Coding Multiple Data Sources to Enhance Qualitative Analysis Paper presented at 2019 ASEE Annual Conference & Exposition , Tampa, Florida. 10.18260/1-2--32536

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2019 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015