June 15, 2019
June 15, 2019
June 19, 2019
New Engineering Educators
This research paper elaborates on the process used by a team of researchers to create a codebook from interviews of Civil Engineers, including students, professors, and professionals, solving ill-structured problems. The participants solved two ill-structured problems while they verbalized their solution process. In addition to recording the participant verbalization, the solution to their problems were also collected with the use of a smart pen. Creating a codebook from interviews is a key element of qualitative engineering education research forming the basis for the analysis. While individuals can create codebooks for analysis, a team-based approach is advantageous especially when dealing with large amounts of data. A team-based approach involves an iterative process of inter-rater reliability essential to the trustworthiness of the data analysis. In addition to coding the transcripts as a team, which consisted of novice, intermediate, and experts in the engineering education field, the audio and written solution to the problems were also coded. The use of multiple data sources to obtain data, and not just the verbatim transcripts, is lesser studied in engineering education literature and provides opportunities for a more detailed qualitative analysis. Initial codes were created from existing literature, which were refined through an iterative process. This process consisted of coding data, team consensus on coded data, codebook refinement, and recoding data with the refined codes. Results show that coding verbatim transcripts might not provide and accurate representation of data which may lead to erroneous results. Benefits, challenges and recommendations regarding the use multiple sources to obtain valid data are discussed while considering the amount of time required to conduct such analysis.
Bir, D. D., & Ahn, B., & Cetin, B., & Akinci-Ceylan, S., & Cetin, K. S., & Surovek, A. E., & Lerdal, K., & Anton, M. M., & Thompson, K. R. (2019, June), Connecting Dots: Coding Multiple Data Sources to Enhance Qualitative Analysis Paper presented at 2019 ASEE Annual Conference & Exposition , Tampa, Florida. 10.18260/1-2--32536
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2019 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015