Work-In-Progress:  Engineering Self-Efficacy in First-Year Design

Megan Gray; Ann Saterbak; Sophia T. Santillan; Michael Rizk; Jessica Sperling

Download Paper | Permalink

Conference: 2020 ASEE Virtual Annual Conference Content Access
Location: Virtual On line
Publication Date: June 22, 2020
Start Date: June 22, 2020
End Date: June 26, 2021
Conference Session: First-Year Programs: Metacognition, Self-Efficacy, and Motivation #2
Tagged Division: First-Year Programs
Tagged Topic: Diversity
Page Count: 15
DOI: 10.18260/1-2--35706
Permanent URL: https://peer.asee.org/35706
Download Count: 586

Request a correction

Paper Authors

biography

Megan Gray Duke University

visit author page

Megan Gray is a Research Analyst in Evaluation and Engagement at Duke University's Social Science Research Institute (SSRI). She serves as a project manager and researcher for both qualitative and quantitative evaluation and research efforts, in partnership with community-based programs as well as campus-based initiatives. Megan came to Duke from the nonprofit field, where she evaluated and monitored implementation of county-wide early childhood programs. Her prior experience includes school-based social work, teen pregnancy prevention/positive youth development programming, and public health evaluation.

visit author page

biography

Ann Saterbak Duke University

visit author page

Ann Saterbak is Professor of the Practice in the Biomedical Department and Director of First-Year Engineering at Duke University. Saterbak is the lead author of the textbook, Bioengineering Fundamentals. Saterbak’s outstanding teaching was recognized through university-wide and departmental teaching awards. In 2013, Saterbak received the ASEE Biomedical Engineering Division Theo C. Pilkington Outstanding Educator Award. For her contribution to education within biomedical engineering, she was elected Fellow in the Biomedical Engineering Society and the American Society of Engineering Education.

visit author page

biography

Sophia T. Santillan Duke University

visit author page

Sophia Santillan joined Duke as an assistant professor of the practice in summer 2017. As a STEM teacher and professor, she is interested in research in student learning and classroom practice. After earning her bachelor's, master's, and doctoral degrees from Duke, Santillan taught at the United States Naval Academy as an assistant professor. She has also worked at the high school level, where she taught across the four-year math curriculum, including advanced courses. She also designed, proposed, and taught two introductory engineering courses for high school students.

visit author page

author page

Michael Rizk Duke University

biography

Jessica Sperling Duke University

visit author page

Dr. Sperling is an applied social scientist and evaluator. She leads the Applied Research, Evaluation, and Engagement area of Duke University's Social Science Research Institute.

visit author page

Download Paper | Permalink

Abstract

This work-in-progress paper describes the implementation and results of surveys to understand the impact of a first-year engineering design course on students. During the Engineering Design and Communication (EGR 101) course, students work in teams to learn and apply the engineering design process to a client-based problem drawn from a community partner. The learning outcomes are to 1) apply the engineering design process to meet the needs of a client; 2) iteratively prototype a solution; 3) work collaboratively on a team; and 4) communicate the critical steps in the design process in written, oral, and visual formats. Students work on one project team for the entire semester, with the focus of delivering a built and tested solution to the client.

To better understand the effects of this course, we used a quantitative evaluation process. The survey addresses how the course contributes to students’ self-efficacy and commitment in four areas: professional development, professional skills, engineering/academics, and creativity. Using a repeated-measures design, all students taking the course in fall 2018 were invited to participate in a survey at the beginning and end of the semester (113 paired responses). The survey utilized scale measures assessing intended outcome constructs, with scales adopted and/or adapted from other relevant existing measures. Measurements and analyses included determination of internal reliability for included scale measures (Chronbach’s alpha), assessment of statistical significance in observed pre/post change using paired t-test (P<0.05), and/or assessment of strength of effect in pre/post change using effect size (Cohen’s d).

Significant, positive change was seen in general engineering self-efficacy, engineering skills (tinkering) self-efficacy, and engineering design self-efficacy; moreover, engineering design self-efficacy demonstrated notably high strength of effect, as measured by effect size. Within the area of personal development, students showed statistically significant growth in general self-efficacy, but not grit/perseverance. Positive changes in all three of the areas of professional skills, including teamwork, communication, and leadership, were significant and of medium to high effect size. However, these changes across the semester were not seen in engineering academic engagement, which attempted to measure how likely students were to select engineering as a major.

These results provide early evidence of effectiveness for the EGR 101 course in core intended outcomes; results indicate that it is indeed building students’ self-efficacy in terms of professional and engineering design skills. Ongoing efforts to further this work are twofold. First, we implemented a parallel data collection process with a second wave of student participants in fall 2019; this will allow us to both build our sample size and determine if the effects are evident across multiple course offerings. Second, current work is underway to evaluate whether these changes persist into students’ second year. Particularly, the study will explore whether academic engagement (i.e., declaring a major) is a function of any of these measure parameters. The combination of this current and planned research trajectory will contribute to improve our evidence-based understanding of the contributions of a first-year design-focused course on undergraduates’ academic and personal development.

Citation
Format

Gray, M., & Saterbak, A., & Santillan, S. T., & Rizk, M., & Sperling, J. (2020, June), Work-In-Progress: Engineering Self-Efficacy in First-Year Design Paper presented at 2020 ASEE Virtual Annual Conference Content Access, Virtual On line . 10.18260/1-2--35706

TY - CPAPER
AB - This work-in-progress paper describes the implementation and results of surveys to understand the impact of a first-year engineering design course on students. During the Engineering Design and Communication (EGR 101) course, students work in teams to learn and apply the engineering design process to a client-based problem drawn from a community partner. The learning outcomes are to 1) apply the engineering design process to meet the needs of a client; 2) iteratively prototype a solution; 3) work collaboratively on a team; and 4) communicate the critical steps in the design process in written, oral, and visual formats. Students work on one project team for the entire semester, with the focus of delivering a built and tested solution to the client.

To better understand the effects of this course, we used a quantitative evaluation process. The survey addresses how the course contributes to students’ self-efficacy and commitment in four areas: professional development, professional skills, engineering/academics, and creativity. Using a repeated-measures design, all students taking the course in fall 2018 were invited to participate in a survey at the beginning and end of the semester (113 paired responses). The survey utilized scale measures assessing intended outcome constructs, with scales adopted and/or adapted from other relevant existing measures. Measurements and analyses included determination of internal reliability for included scale measures (Chronbach’s alpha), assessment of statistical significance in observed pre/post change using paired t-test (P&amp;lt;0.05), and/or assessment of strength of effect in pre/post change using effect size (Cohen’s d).

Significant, positive change was seen in general engineering self-efficacy, engineering skills (tinkering) self-efficacy, and engineering design self-efficacy; moreover, engineering design self-efficacy demonstrated notably high strength of effect, as measured by effect size. Within the area of personal development, students showed statistically significant growth in general self-efficacy, but not grit/perseverance. Positive changes in all three of the areas of professional skills, including teamwork, communication, and leadership, were significant and of medium to high effect size. However, these changes across the semester were not seen in engineering academic engagement, which attempted to measure how likely students were to select engineering as a major.

These results provide early evidence of effectiveness for the EGR 101 course in core intended outcomes; results indicate that it is indeed building students’ self-efficacy in terms of professional and engineering design skills. Ongoing efforts to further this work are twofold. First, we implemented a parallel data collection process with a second wave of student participants in fall 2019; this will allow us to both build our sample size and determine if the effects are evident across multiple course offerings. Second, current work is underway to evaluate whether these changes persist into students’ second year. Particularly, the study will explore whether academic engagement (i.e., declaring a major) is a function of any of these measure parameters. The combination of this current and planned research trajectory will contribute to improve our evidence-based understanding of the contributions of a first-year design-focused course on undergraduates’ academic and personal development.

AU - Megan Gray
AU - Ann Saterbak
AU - Sophia T. Santillan
AU - Michael Rizk
AU - Jessica Sperling
CY - Virtual On line
DA - 2020/06/22
PB - ASEE Conferences
TI - Work-In-Progress: Engineering Self-Efficacy in First-Year Design
UR - https://peer.asee.org/35706
DO - 10.18260/1-2--35706
ER -