Asee peer logo

Lessons learned - Conducting an External Evaluation of a STEM Teaching and Learning Center (Lessons Learned Paper #1 of 2)

Download Paper |

Conference

2022 ASEE Annual Conference & Exposition

Location

Minneapolis, MN

Publication Date

August 23, 2022

Start Date

June 26, 2022

End Date

June 29, 2022

Conference Session

Faculty Development Division Technical Session 2

Page Count

8

DOI

10.18260/1-2--41149

Permanent URL

https://peer.asee.org/41149

Download Count

214

Request a correction

Paper Authors

biography

Sarah Zappe Pennsylvania State University

visit author page

Dr. Sarah Zappe is an educational psychologist specializing in applied educational testing and measurement. She is the Director of the Leonhard Center for the Enhancement of Engineering Education at Penn State and Assistant Dean of Teaching and Learning in the College of Engineering. She holds an affiliate faculty position in the Educational Psychology Department at Penn State. Sarah is widely recognized for her expertise in instrument development, educational assessment, and faculty development. She is a national leader in engineering education research and has served as an external evaluator on many NSF grants. She is currently deputy editor for the Journal of Engineering Education. Her primary research interests include test development and validity, entrepreneurship education, creativity in engineering education, and faculty development. In her free time, Sarah enjoys spending time paddle boarding, traveling, photography, watercolor, and spending time with her 13-year old son (Ethan) and two golden retrievers.

visit author page

biography

Stephanie Cutler Pennsylvania State University

visit author page

Dr. Stephanie Cutler has degrees in Mechanical Engineering, Industrial and Systems Engineering, and a PhD in Engineering Education from Virginia Tech. She is an Associate Research Professor and the Assessment and Instructional Support Specialist in the Leonhard Center for the Enhancement of Engineering Education at Penn State. Her primary research interest include faculty development, the peer review process, the doctoral experience, and the adoption of evidence-based teaching strategies. She is currently serving as the ASEE Educational Research and Methods division Vice Chair of Programs for ASEE 2022.

visit author page

biography

Sam Spiegel Colorado School of Mines

visit author page

Dr. Spiegel is Assistant Vice President for Online Education and was the founding Director, Trefny Innovative Instruction Center at the Colorado School of Mines. He served as Chair, Disciplinary Literacy in Science and as Associate Director, Engineering Education Research Center at the University of Pittsburgh; Director of Research & Development for a multimedia company; and as founding Director of the Center for Integrating Research & Learning (CIRL) at the National High Magnetic Field Laboratory. His current efforts focus on innovation of teaching practices in STEM fields and systemic change within higher education.

visit author page

biography

Deb Jordan Colorado School of Mines

visit author page

Director of the Trefny Innovative Instruction Center at Colorado School of Mines; leading the team in their work with faculty and staff to continuously expand high-quality, research-based, and innovative learning experiences for Mines students.

visit author page

biography

Megan Sanders Colorado School of Mines

visit author page

Megan is the Senior Assessment Associate in the Trefny Innovative Instruction Center at Colorado School of Mines.

visit author page

Download Paper |

Abstract

This abstract is for a Lessons Learned Paper for the Faculty Development Division. In 2020, the authors conducted an external evaluation of a STEM-focused teaching and learning center located in the western United States. The authors, who also work in a different engineering-focused teaching and learning center, worked with the director and employees within the center to identify key stakeholders and questions that were used to guide the evaluation. The purpose of this paper is to discuss the approach that was taken for the external evaluation, along with the lessons learned from this approach. Our co-authors at the respective teaching and learning have submitted a corresponding abstract for a parallel paper that details the findings from this evaluation. The process of conducting the evaluation and the results may be of interest to those working in teaching and learning centers who have considered or would potentially consider conducting an external evaluation.

The primary purpose of the evaluation was to gather perceptions about 1) the perceived roles and responsibilities of the Center, 2) the impact of the Center on the university and teaching, 3) the perceptions of effective teaching, and 4) recommendations for the Center to improve their services. The evaluation results were intended to be used to improve the Center’s services, to demonstrate to leadership the many areas in which the Center was involved in (oftentimes beyond the primary teaching and learning mission), and to gather baseline data on faculty perceptions of effective teaching.

As part of the evaluation, interviews were conducted with three different groups of stakeholders: university’s executive council (n=9), the department heads (n=18), and a sample of faculty members (n=20). The interviews took place in 2020, with the executive council interviewed in February (just prior to the COVID-19 pandemic) and the remaining interviews conducted in the summer of 2020 (after the COVID-19 pandemic started).

While the findings of the evaluation will be reported in the parallel paper, this paper will provide a detailed methodology of the evaluation methodology and approach. Some of the lessons learned included preparing for the unexpected, as the COVID-19 pandemic slightly derailed plans for the evaluation. However, the evaluation provided a new opportunity to gather information about how the teaching and learning center was able to pivot and adjust to the changed circumstances at the institution.

Zappe, S., & Cutler, S., & Spiegel, S., & Jordan, D., & Sanders, M. (2022, August), Lessons learned - Conducting an External Evaluation of a STEM Teaching and Learning Center (Lessons Learned Paper #1 of 2) Paper presented at 2022 ASEE Annual Conference & Exposition, Minneapolis, MN. 10.18260/1-2--41149

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2022 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015