Hamidi, F., & Moulton, A., & Grimes, S., & Grimes, S., & Coy, A. (2020, June), Using Retrospective Surveys to Assess the Impact of Participating in an Afterschool Maker Learning Program on Youth   Paper presented at 2020 ASEE Virtual Annual Conference Content Access, Virtual On line . 10.18260/1-2--35470

\bibitem{asee_peer_35470}
  Hamidi, F., \& Moulton, A., \& Grimes, S., \& Grimes, S., \& Coy, A. (2020, June), \emph{Using Retrospective Surveys to Assess the Impact of Participating in an Afterschool Maker Learning Program on Youth }
  Paper presented at 2020 ASEE Virtual Annual Conference Content Access, Virtual On line .
  10.18260/1-2--35470

Foad Hamidi, Adena Moulton, Shawn Grimes, Stephanie Grimes, and Andrew Coy.  "Using Retrospective Surveys to Assess the Impact of Participating in an Afterschool Maker Learning Program on Youth ".  2020 ASEE Virtual Annual Conference Content Access, Virtual On line , 2020, June.  ASEE Conferences, 2020.  https://peer.asee.org/35470 Internet.  15 Jan, 2025

\bibitem{asee_peer_35470}
  Foad Hamidi, Adena Moulton, Shawn Grimes, Stephanie Grimes, and Andrew Coy.
  "Using Retrospective Surveys to Assess the Impact of Participating in an Afterschool Maker Learning Program on Youth ".
  \emph{2020 ASEE Virtual Annual Conference Content Access, Virtual On line , 2020, June}.
  ASEE Conferences, 2020.
  https://peer.asee.org/35470 Internet.  15 Jan, 2025

@INPROCEEDINGS{asee_peer_35470
author = "Foad Hamidi, Adena Moulton, Shawn Grimes, Stephanie Grimes, and Andrew Coy"
title = "Using Retrospective Surveys to Assess the Impact of Participating in an Afterschool Maker Learning Program on Youth "
booktitle = "2020 ASEE Virtual Annual Conference Content Access"
year = "2020"
month = "June"
address = "Virtual On line "
publisher = "ASEE Conferences"
note = {https://peer.asee.org/35470}
number = {10.18260/1-2--35470}
}

TY  - CPAPER
AB  - Afterschool maker programs provide opportunities for engaging youth in hands-on projects that require creative problem solving, teamwork and the acquiring and application of technical skills. These programs can introduce participants to engineering concepts and skills before college. As interest in them grows and more organizations offer programs to hundreds of youth, it is increasingly important to identify valid and scalable methods for evaluating their quality by conducting assessments that capture the impact of participation on youth.

In this evaluation paper, we report the results of investigating the impact of an afterschool maker program on 94 youth. Twice over a year, we collected data using a series of survey tools including two Upper Elementary School and Middle/High School Student Attitudes toward STEM (S-STEM) Surveys (Technology and Engineering and 21st Century Skills)  and the Alternative Uses Test (AUT). Additionally, we conducted interviews with representative youth about their perceptions and attitudes towards the surveys. 

While the AUT results showed a positive change in the youth, initial results from pre- and post-program STEM-S evaluations showed insignificant and in some cases negative shifts in youth's attitudes. The interviews showed that youth had difficulty accurately assessing changes in themselves due to the time lapse between pre- and post-program surveys. Additionally, they did not see the value of completing the surveys. We subsequently changed the format of the surveys to a retrospective mode to help the youth better reflect on their attitudes and skills. The results of the retrospective surveys showed significant positive shits in the youth's attitudes towards STEM. We present detailed results and recommendations on how to apply them in other similar programs.   

AU  - Foad Hamidi
AU  - Adena Moulton
AU  - Shawn Grimes
AU  - Stephanie Grimes
AU  - Andrew Coy
CY  - Virtual On line 
DA  - 2020/06/22
PB  - ASEE Conferences
TI  - Using Retrospective Surveys to Assess the Impact of Participating in an Afterschool Maker Learning Program on Youth 
UR  - https://peer.asee.org/35470
DO  - 10.18260/1-2--35470
ER  -