Examining Student Cognitive Engagement in Integrated STEM  (Fundamental)

Benny Mart Hiwatig; Gillian Roehrig; Joshua Ellis; Mark Rouleau

Download Paper | Permalink

Conference: 2022 ASEE Annual Conference & Exposition
Location: Minneapolis, MN
Publication Date: August 23, 2022
Start Date: June 26, 2022
End Date: June 29, 2022
Conference Session: PCEE Technical Session 5: STEM Teacher Instructional Moves
Page Count: 24
DOI: 10.18260/1-2--41220
Permanent URL: https://peer.asee.org/41220
Download Count: 287

Paper Authors

biography

Benny Mart Hiwatig University of Minnesota - Twin Cities

visit author page

Benny Mart Hiwatig is a PhD candidate in the STEM Education program at the University of Minnesota. He earned his bachelor's degree in Secondary Education and took master's coursework in Chemistry Education in the Philippines, where he also taught high school chemistry. He is currently involved in a research project that aims to develop an observation protocol for STEM lessons and relevant training materials that are directed at improving the quality of STEM instruction in K-12 spaces. His primary research interests include assessment of student learning in STEM contexts, exploration of how integrated STEM is enacted in the secondary level (especially in chemistry classes), and assessment and promotion of students' conceptual understanding of chemical concepts.

visit author page

author page

Gillian Roehrig University of Minnesota - Twin Cities

biography

Joshua Ellis Florida International University

visit author page

Associate Professor of STEM Education

visit author page

biography

Mark Rouleau

visit author page

Associate professor in the Social Sciences department at Michigan Technological University with a background in computational social science, research design, and social science research methods for assessment and evaluation purposes

visit author page

Download Paper | Permalink

Abstract

While there are many approaches to integrated STEM instruction (iSTEM), the integration of engineering design is the most widely-studied and practiced pedagogical approach to iSTEM in K-12 classrooms. Research has shown that the inclusion of engineering-design improves students’ attitudes, as well as interest and engagement in pursuing STEM-related careers. Furthermore, studies have shown enhanced 21st century skills for students engaged in iSTEM learning contexts. However, more research is needed to understand how iSTEM and its critical features are operationalized to promote positive student outcomes. To address this need, this study examined the relationship between student cognitive engagement in iSTEM and its hypothesized predictors: curricular opportunities for STEM content integration, engagement in multiple solution development, agency in STEM practices, evidence-based reasoning, data practices, and collaboration. The study is guided by Roehrig et al.’s (2021) Detailed Conceptual Framework of Integrated STEM and Moore et al.'s (2014) framework for Quality K-12 Engineering Education. We utilized multinomial logistic regression (MLR) analysis due to the polytomous categorical distribution of the outcome variable. This study used classroom video data from previous work that examined the presence of critical features of K-12 iSTEM. Scores using a novel and validated iSTEM observation protocol (Dare et al., 2021) from 2,007 iSTEM lessons were used. Through preliminary analyses, we determined that the assumptions for MLR have been sufficiently met. Three categories of the outcome variable, student cognitive engagement, reported on were lessons that provide opportunities for students to (1) analyze/evaluate STEM concepts, (2) use/apply STEM concepts, and (3) know/understand STEM concepts (which was set as the baseline or reference category). All predictor variables except for curricular opportunities for collaboration and data practices were statistically significant in the model. The final MLR model has a total of 12 predictor categories. The deviance goodness-of-fit test indicated that the model was a good fit to the observed data, χ²(234) = 207.605, p = .892, with 137 (36.2%) cells having zero frequencies. The final model statistically significantly predicted the outcome variable over and above the intercept-only model, p < .001. Furthermore, it has a pseudo R-squared value of .643 (Nagelkerke R²) and correctly classified 72.8% of cases. Among other findings, we found that the odds of multidisciplinary lessons providing opportunities for students to analyze and/or evaluate STEM concepts was 2.401 times higher than that for monodisciplinary lessons, χ²(1) = 24.963, p < .001. In addition, lessons with opportunities for students to redesign a solution to the engineering task are more likely to provide opportunities for students to analyze/evaluate STEM concepts (exp(ꞵ) = 126.038) compared to lessons without such curricular opportunity, χ²(1) = 22.033, p < .001. In conclusion, engineering-centric iSTEM instruction that engage students in higher levels of cognition are marked by the presence of multidisciplinary content, engagement in designing solutions to an engineering problem, agency in STEM practices, and evidence-based reasoning.

Citation
Format

Hiwatig, B. M., & Roehrig, G., & Ellis, J., & Rouleau, M. (2022, August), Examining Student Cognitive Engagement in Integrated STEM (Fundamental) Paper presented at 2022 ASEE Annual Conference & Exposition, Minneapolis, MN. 10.18260/1-2--41220

TY - CPAPER
AB - While there are many approaches to integrated STEM instruction (iSTEM), the integration of engineering design is the most widely-studied and practiced pedagogical approach to iSTEM in K-12 classrooms. Research has shown that the inclusion of engineering-design improves students’ attitudes, as well as interest and engagement in pursuing STEM-related careers. Furthermore, studies have shown enhanced 21st century skills for students engaged in iSTEM learning contexts. However, more research is needed to understand how iSTEM and its critical features are operationalized to promote positive student outcomes. To address this need, this study examined the relationship between student cognitive engagement in iSTEM and its hypothesized predictors: curricular opportunities for STEM content integration, engagement in multiple solution development, agency in STEM practices, evidence-based reasoning, data practices, and collaboration. The study is guided by Roehrig et al.’s (2021) Detailed Conceptual Framework of Integrated STEM and Moore et al.'s (2014) framework for Quality K-12 Engineering Education. We utilized multinomial logistic regression (MLR) analysis due to the polytomous categorical distribution of the outcome variable. This study used classroom video data from previous work that examined the presence of critical features of K-12 iSTEM. Scores using a novel and validated iSTEM observation protocol (Dare et al., 2021) from 2,007 iSTEM lessons were used. Through preliminary analyses, we determined that the assumptions for MLR have been sufficiently met. Three categories of the outcome variable, student cognitive engagement, reported on were lessons that provide opportunities for students to (1) analyze/evaluate STEM concepts, (2) use/apply STEM concepts, and (3) know/understand STEM concepts (which was set as the baseline or reference category). All predictor variables except for curricular opportunities for collaboration and data practices were statistically significant in the model. The final MLR model has a total of 12 predictor categories. The deviance goodness-of-fit test indicated that the model was a good fit to the observed data, χ²(234) = 207.605, p = .892, with 137 (36.2%) cells having zero frequencies. The final model statistically significantly predicted the outcome variable over and above the intercept-only model, p < .001. Furthermore, it has a pseudo R-squared value of .643 (Nagelkerke R²) and correctly classified 72.8% of cases. Among other findings, we found that the odds of multidisciplinary lessons providing opportunities for students to analyze and/or evaluate STEM concepts was 2.401 times higher than that for monodisciplinary lessons, χ²(1) = 24.963, p < .001. In addition, lessons with opportunities for students to redesign a solution to the engineering task are more likely to provide opportunities for students to analyze/evaluate STEM concepts (exp(ꞵ) = 126.038) compared to lessons without such curricular opportunity, χ²(1) = 22.033, p < .001. In conclusion, engineering-centric iSTEM instruction that engage students in higher levels of cognition are marked by the presence of multidisciplinary content, engagement in designing solutions to an engineering problem, agency in STEM practices, and evidence-based reasoning.
AU - Benny Mart Hiwatig
AU - Gillian Roehrig
AU - Joshua Ellis
AU - Mark Rouleau
CY - Minneapolis, MN
DA - 2022/08/23
PB - ASEE Conferences
TI - Examining Student Cognitive Engagement in Integrated STEM (Fundamental)
UR - https://peer.asee.org/41220
DO - 10.18260/1-2--41220
ER -