Swartz, E. M., & Striker, R., & Singelmann, L., & Alvarez Vazquez, E., & Pearson, M., & Ng, S. S. (2021, July), Innovating Assessment: Using Innovative Impact as a Metric to Evaluate Student Outcomes in an Innovation-Based Learning Course  Paper presented at 2021 ASEE Virtual Annual Conference Content Access, Virtual Conference. 10.18260/1-2--37338

\bibitem{asee_peer_37338}
  Swartz, E. M., \& Striker, R., \& Singelmann, L., \& Alvarez Vazquez, E., \& Pearson, M., \& Ng, S. S. (2021, July), \emph{Innovating Assessment: Using Innovative Impact as a Metric to Evaluate Student Outcomes in an Innovation-Based Learning Course}
  Paper presented at 2021 ASEE Virtual Annual Conference Content Access, Virtual Conference.
  10.18260/1-2--37338

Ellen M. Swartz, Ryan Striker P.E., Lauren Singelmann, Enrique Alvarez Vazquez, Mary Pearson, and Stanley Shie Ng.  "Innovating Assessment: Using Innovative Impact as a Metric to Evaluate Student Outcomes in an Innovation-Based Learning Course".  2021 ASEE Virtual Annual Conference Content Access, Virtual Conference, 2021, July.  ASEE Conferences, 2021.  https://peer.asee.org/37338 Internet.  21 Jan, 2025

\bibitem{asee_peer_37338}
  Ellen M. Swartz, Ryan Striker P.E., Lauren Singelmann, Enrique Alvarez Vazquez, Mary Pearson, and Stanley Shie Ng.
  "Innovating Assessment: Using Innovative Impact as a Metric to Evaluate Student Outcomes in an Innovation-Based Learning Course".
  \emph{2021 ASEE Virtual Annual Conference Content Access, Virtual Conference, 2021, July}.
  ASEE Conferences, 2021.
  https://peer.asee.org/37338 Internet.  21 Jan, 2025

@INPROCEEDINGS{asee_peer_37338
author = "Ellen M. Swartz, Ryan Striker P.E., Lauren Singelmann, Enrique Alvarez Vazquez, Mary Pearson, and Stanley Shie Ng"
title = "Innovating Assessment: Using Innovative Impact as a Metric to Evaluate Student Outcomes in an Innovation-Based Learning Course"
booktitle = "2021 ASEE Virtual Annual Conference Content Access"
year = "2021"
month = "July"
address = "Virtual Conference"
publisher = "ASEE Conferences"
note = {https://peer.asee.org/37338}
number = {10.18260/1-2--37338}
}

TY  - CPAPER
AB  - This paper evaluates the use of an Innovative Impact Scale (IIS) alongside Webb’s Depth of Knowledge (DoK) as metrics for student assessment within an Innovation-Based Learning (IBL) course. The IBL model provides students with the freedom and responsibility to choose and direct their own learning while encouraging innovative thinking through collaborations that are both multidisciplinary and multi-institutional. Through these collaborations, students determine a current societal challenge and are expected to contribute their individual knowledge and skills towards finding an innovative solution. Within the IBL model, student assessment is not performed via the traditional methods of homework or exams. Instead, students are evaluated on their ability to relate and apply core course concepts towards a team innovation that introduces novelty.

This Innovation-Based Learning model has been implemented within a cardiovascular engineering course for its third consecutive semester and is currently offered across four institutions. The diversity of the participating universities and the enrolled students (both undergraduate and graduate) fosters an environment for innovative thinking. However, being an innovative multidisciplinary course creates difficulties when evaluating students on their course outcomes. Based on their individual backgrounds and skills, each student creates learning objectives that are unique and personalized while also contributing to their team’s innovation project. With such diversity of student work, applying a single grading rubric is impractical. Another problem occurs in evaluating the innovation itself. How can instructors consistently rank the novelty and value of such diverse student work? To tackle these problems, a grading scheme that involves multiple expert assessments of both the value and the impact of a student’s innovation needed to be developed. 

This work presents and describes the development of the Innovative Impact Scale and how it has been integrated alongside Webb’s Depth of Knowledge levels as metrics to assess the innovative learning outcomes of students enrolled in an IBL course. Data on student learning outcomes collected from the course’s online platform will be assessed. To determine the effectiveness of using the IIS alongside Webb’s DoK as an assessment tool, multiple instructors from the institutions involved will review student learning outcomes. Instructor reviews will be assessed to compute inter-rater agreement scores, with instances producing the strongest agreements and disagreements evaluated and results discussed.
AU  - Ellen M. Swartz
AU  - Ryan Striker P.E.
AU  - Lauren Singelmann
AU  - Enrique Alvarez Vazquez
AU  - Mary Pearson
AU  - Stanley Shie Ng
CY  - Virtual Conference
DA  - 2021/07/26
PB  - ASEE Conferences
TI  - Innovating Assessment: Using Innovative Impact as a Metric to Evaluate Student Outcomes in an Innovation-Based Learning Course
UR  - https://peer.asee.org/37338
DO  - 10.18260/1-2--37338
ER  -