Asee peer logo

Lessons Learned: Findings from an External Evaluation of a STEM Teaching and Learning Center (Lessons Learned Paper #2 of 2)

Download Paper |

Conference

2022 ASEE Annual Conference & Exposition

Location

Minneapolis, MN

Publication Date

August 23, 2022

Start Date

June 26, 2022

End Date

June 29, 2022

Conference Session

Faculty Development Division Technical Session 2

Page Count

8

DOI

10.18260/1-2--41150

Permanent URL

https://peer.asee.org/41150

Download Count

140

Request a correction

Paper Authors

biography

Sarah Zappe Pennsylvania State University

visit author page

Dr. Sarah Zappe is an educational psychologist specializing in applied educational testing and measurement. She is the Director of the Leonhard Center for the Enhancement of Engineering Education at Penn State and Assistant Dean of Teaching and Learning in the College of Engineering. She holds an affiliate faculty position in the Educational Psychology Department at Penn State. Sarah is widely recognized for her expertise in instrument development, educational assessment, and faculty development. She is a national leader in engineering education research and has served as an external evaluator on many NSF grants. She is currently deputy editor for the Journal of Engineering Education. Her primary research interests include test development and validity, entrepreneurship education, creativity in engineering education, and faculty development. In her free time, Sarah enjoys spending time paddle boarding, traveling, photography, watercolor, and spending time with her 13-year old son (Ethan) and two golden retrievers.

visit author page

biography

Deb Jordan Colorado School of Mines

visit author page

Director of the Trefny Innovative Instruction Center at Colorado School of Mines; leading the team in their work with faculty and staff to continuously expand high-quality, research-based, and innovative learning experiences for Mines students.

visit author page

biography

Sam Spiegel Colorado School of Mines

visit author page

Dr. Spiegel is Assistant Vice President for Online Education and was the founding Director, Trefny Innovative Instruction Center at the Colorado School of Mines. He served as Chair, Disciplinary Literacy in Science and as Associate Director, Engineering Education Research Center at the University of Pittsburgh; Director of Research & Development for a multimedia company; and as founding Director of the Center for Integrating Research & Learning (CIRL) at the National High Magnetic Field Laboratory. His current efforts focus on innovation of teaching practices in STEM fields and systemic change within higher education.

visit author page

biography

Megan Sanders Colorado School of Mines

visit author page

Megan is the Senior Assessment Associate in the Trefny Innovative Instruction Center at Colorado School of Mines.

visit author page

biography

Stephanie Cutler Pennsylvania State University

visit author page

Dr. Stephanie Cutler has degrees in Mechanical Engineering, Industrial and Systems Engineering, and a PhD in Engineering Education from Virginia Tech. She is an Associate Research Professor and the Assessment and Instructional Support Specialist in the Leonhard Center for the Enhancement of Engineering Education at Penn State. Her primary research interest include faculty development, the peer review process, the doctoral experience, and the adoption of evidence-based teaching strategies. She is currently serving as the ASEE Educational Research and Methods division Vice Chair of Programs for ASEE 2022.

visit author page

Download Paper |

Abstract

This abstract is for a Lessons Learned Paper for the Faculty Development Division. In 2020, a teaching and learning center located in the Western United States hired two consultants to conduct an external evaluation. Our co-authors who conducted the external evaluation have submitted a corresponding abstract for a parallel paper that details the approach taken for the evaluation. While that paper focuses on the methodology and approach, this paper focuses on the following: 1) the rationale for conducting the external evaluation, 2) the justification for allocating budget and resources for the external evaluation, 3) the findings from the external evaluation, 4) the value of the findings for the Center, and 5) the response the Center will make to the findings.

The primary purpose of the evaluation was to gather perceptions about 1) the perceived roles and responsibilities of the Center, 2) the impact of the Center on the university and teaching, 3) the perceptions of effective teaching, and 4) recommendations for the Center to improve their services. As part of the evaluation, interviews were conducted with three different groups of stakeholders: university’s executive council (n=9), department heads (n=18), and a sample of faculty members (n=20). The findings were presented to the Center team in the form of a report with an executive summary. The evaluation team met with the Center multiple times to discuss the findings and how to utilize the results.

The different stakeholder groups had varying perspectives. Overall, the executive council interviews provided the most visionary perspective about the Center, speaking to the big picture of the university and how the Center fits within that picture. Faculty provided more specific perspectives focused on the individual classroom. These participants discussed the day-to-day work of teaching and how the Center helps support them. Department heads provided a middle-ground perspective. They hear faculty perspectives and experiences, without having as much day-to-day experience themselves. They are working to provide an overall vision for their department, but don’t seem to have a complete sense of the overall vision for the University or how the Center fits within that. The middle perspective seems to have resulted with the department heads not working as closely with the Center (in many cases) and possessing the most critical perspectives.

Across all stakeholders groups, there was a large level of appreciation for the Center and the support they provide the university as well as individual faculty. Multiple participants were very positive in their discussions of the Center and very supportive of their efforts, often contextualizing any recommendations with “they already do so much” or “this is getting really nitpicky.” The transition to remote instruction during the COVID-19 pandemic was a specific instance where all levels of stakeholders highlighted how well the Center was able to support the university to create a much smoother transition than expected. These findings and others are discussed in more detail in the full paper.

Zappe, S., & Jordan, D., & Spiegel, S., & Sanders, M., & Cutler, S. (2022, August), Lessons Learned: Findings from an External Evaluation of a STEM Teaching and Learning Center (Lessons Learned Paper #2 of 2) Paper presented at 2022 ASEE Annual Conference & Exposition, Minneapolis, MN. 10.18260/1-2--41150

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2022 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015