Qualitative Analysis of Student Experience in a Chemical Engineering Laboratory

Heather Chenette; Gregory T. Neumann; Daniel Anastasio

Download Paper | Permalink

Conference: 2023 ASEE Annual Conference & Exposition
Location: Baltimore , Maryland
Publication Date: June 25, 2023
Start Date: June 25, 2023
End Date: June 28, 2023
Conference Session: Chemical Engineering Division (ChED) Technical Session 9: Student Experiences in Laboratory Courses
Tagged Division: Chemical Engineering Division (ChED)
Page Count: 15
DOI: 10.18260/1-2--44657
Permanent URL: https://peer.asee.org/44657
Download Count: 67

Request a correction

Paper Authors

biography

Heather Chenette Rose-Hulman Institute of Technology

visit author page

Heather Chenette is an Associate Professor of Chemical Engineering at Rose-Hulman Institute of Technology. Her professional interests include leveraging qualitative methods to understand and enhance student learning in the classroom and creating opportunities for students to learn about polymers, membrane materials, and bioseparation processes through research experiences.

visit author page

biography

Gregory T. Neumann Rose-Hulman Institute of Technology

visit author page

Gregory received his B.S. in Chemical Engineering from Rose-Hulman Institute of Technology and later received his Ph.D. in Chemical and Biomolecular Engineering from the University of Notre Dame. his research interests are in heterogeneous catalysis as we

visit author page

biography

Daniel Anastasio Rose-Hulman Institute of Technology

visit author page

Daniel Anastasio is an associate professor at Rose-Hulman Institute of Technology. He received a B.S. and Ph.D. in Chemical Engineering from the University of Connecticut in 2009 and 2015, respectively. His primary areas of research are game-based learning, authentic process safety education, and membrane separations.

visit author page

Download Paper | Permalink

Abstract

A multi-dimensional survey was created and administered to two different student cohorts to better understand the change in self-perceived and actual student abilities in a CHE laboratory course. One cohort experienced a traditional lab structure with a companion face-to-face lecture course (N=47), and the other cohort included pre-lab modules integrated with in-lab activities that served as intentional scaffolding for the student learning experience (N=18). Prior work explored student experiences in the laboratory by analyzing survey results from the Self-Assessment and Direct Skills Test [1-4]. These assessments contained primarily close-ended questions with some open-ended prompts. The overall study was motivated by the desire to understand the impact curriculum revisions have on student experience and abilities, with the goal to improve the educational experience using evidence-based practices. The original guiding research questions that drove this facet of the study were: What are the perceived objectives and perceived learning experiences of students in our CHE lab? To what extent does it differ between the traditional course and the revised course and over time? Distinct from prior work, the methodology for this effort followed the six phases for thematic analysis outlined by Braun and Clarke [5] and was applied using a phenomenological lens where the authors seek to describe different ways a group of people (chemical engineering students) understand a phenomenon (CHE laboratory course). Through this lens, the authors considered student responses to one open-ended question asked both at the beginning and at the end of the course. The question related to student expectations (before) and capabilities (after). Semantic and latent content were considered, and an inductive approach to identifying themes was applied. This work documents the process of applying those six phases, as well as the exploration of initial frameworks for coded thematic elements. We present codes and themes that emerged from the combined cohorts and discuss the extent to which those themes differ and evolve between the two cohorts. In support of these themes we present "quantitized" data visualized in a variety of ways as well as selected excerpts of student responses. In addition to reporting on the research question itself, this paper will serve as a process guide for analysis of a small set of qualitative data in the context of chemical engineering education. The intent is to make thematic analysis more accessible for faculty who might otherwise not consider this approach in pedagogical work.

[1] G. Neumann, D. Anastasio, H. Chenette, and T. Ribera, “Work in Progress: Developing a Multi-dimensional Method for Student Assessment in Chemical Engineering Laboratory Courses,” presented at 2018 ASEE Annual Conference. [2] G. Neumann, D. Anastasio, and H. Chenette, (2019, November), Using Multidimensional Metrics to Assess Changes to Student Attitudes and Ability in a Capstone Laboratory Sequence presented at 2019 AIChE Annual Meeting. [3] H. Chenette, G. Neumann, and D. Anastasio, “What’s Happening in Lab? Multi-Dimensional Assessment Tools to Track Student Experience through a Unit Operations Laboratory Sequence,” Chemical Engineering Education, vol. 55, no. 3, pp. 147–156, 2021. [4] H. Chenette, D. Anastasio, and G. Neumann, “Qualitative Analysis of Skills in a CHE Laboratory Course,” in 2021 ASEE Virtual Annual Conference Content Access, 2021. [5] V. Braun and V. Clarke, “Using thematic analysis in psychology,” Qualitative Research in Psychology, vol. 3, no. 2, pp. 77–101, Jan. 2006, doi: 10.1191/1478088706qp063oa.

Citation
Format

Chenette, H., & Neumann, G. T., & Anastasio, D. (2023, June), Qualitative Analysis of Student Experience in a Chemical Engineering Laboratory Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--44657

TY - CPAPER
AB - A multi-dimensional survey was created and administered to two different student cohorts to better understand the change in self-perceived and actual student abilities in a CHE laboratory course. One cohort experienced a traditional lab structure with a companion face-to-face lecture course (N=47), and the other cohort included pre-lab modules integrated with in-lab activities that served as intentional scaffolding for the student learning experience (N=18).
Prior work explored student experiences in the laboratory by analyzing survey results from the Self-Assessment and Direct Skills Test [1-4]. These assessments contained primarily close-ended questions with some open-ended prompts. The overall study was motivated by the desire to understand the impact curriculum revisions have on student experience and abilities, with the goal to improve the educational experience using evidence-based practices. The original guiding research questions that drove this facet of the study were:
What are the perceived objectives and perceived learning experiences of students in our CHE lab? To what extent does it differ between the traditional course and the revised course and over time?
Distinct from prior work, the methodology for this effort followed the six phases for thematic analysis outlined by Braun and Clarke [5] and was applied using a phenomenological lens where the authors seek to describe different ways a group of people (chemical engineering students) understand a phenomenon (CHE laboratory course). Through this lens, the authors considered student responses to one open-ended question asked both at the beginning and at the end of the course. The question related to student expectations (before) and capabilities (after). Semantic and latent content were considered, and an inductive approach to identifying themes was applied. This work documents the process of applying those six phases, as well as the exploration of initial frameworks for coded thematic elements. We present codes and themes that emerged from the combined cohorts and discuss the extent to which those themes differ and evolve between the two cohorts. In support of these themes we present &quot;quantitized&quot; data visualized in a variety of ways as well as selected excerpts of student responses.
In addition to reporting on the research question itself, this paper will serve as a process guide for analysis of a small set of qualitative data in the context of chemical engineering education. The intent is to make thematic analysis more accessible for faculty who might otherwise not consider this approach in pedagogical work.

[1] G. Neumann, D. Anastasio, H. Chenette, and T. Ribera, “Work in Progress: Developing a Multi-dimensional Method for Student Assessment in Chemical Engineering Laboratory Courses,” presented at 2018 ASEE Annual Conference.
[2] G. Neumann, D. Anastasio, and H. Chenette, (2019, November), Using Multidimensional Metrics to Assess Changes to Student Attitudes and Ability in a Capstone Laboratory Sequence presented at 2019 AIChE Annual Meeting.
[3] H. Chenette, G. Neumann, and D. Anastasio, “What’s Happening in Lab? Multi-Dimensional Assessment Tools to Track Student Experience through a Unit Operations Laboratory Sequence,” Chemical Engineering Education, vol. 55, no. 3, pp. 147–156, 2021.
[4] H. Chenette, D. Anastasio, and G. Neumann, “Qualitative Analysis of Skills in a CHE Laboratory Course,” in 2021 ASEE Virtual Annual Conference Content Access, 2021.
[5] V. Braun and V. Clarke, “Using thematic analysis in psychology,” Qualitative Research in Psychology, vol. 3, no. 2, pp. 77–101, Jan. 2006, doi: 10.1191/1478088706qp063oa.

AU - Heather Chenette
AU - Gregory T. Neumann
AU - Daniel Anastasio
CY - Baltimore , Maryland
DA - 2023/06/25
PB - ASEE Conferences
TI - Qualitative Analysis of Student Experience in a Chemical Engineering Laboratory
UR - https://peer.asee.org/44657
DO - 10.18260/1-2--44657
ER -