Edgcomb, A. D., & Yuen, J. S., & Vahid, F. (2015, June), Does Student Crowdsourcing of Practice Questions and Animations Lead to Good Quality Materials?  Paper presented at 2015 ASEE Annual Conference & Exposition, Seattle, Washington. 10.18260/p.23899

\bibitem{asee_peer_23899}
  Edgcomb, A. D., \& Yuen, J. S., \& Vahid, F. (2015, June), \emph{Does Student Crowdsourcing of Practice Questions and Animations Lead to Good Quality Materials?}
  Paper presented at 2015 ASEE Annual Conference \& Exposition, Seattle, Washington.
  10.18260/p.23899

Alex Daniel Edgcomb, Joshua Sai Yuen, and Frank Vahid.  "Does Student Crowdsourcing of Practice Questions and Animations Lead to Good Quality Materials?".  2015 ASEE Annual Conference & Exposition, Seattle, Washington, 2015, June.  ASEE Conferences, 2015.  https://peer.asee.org/23899 Internet.  15 Apr, 2024

\bibitem{asee_peer_23899}
  Alex Daniel Edgcomb, Joshua Sai Yuen, and Frank Vahid.
  "Does Student Crowdsourcing of Practice Questions and Animations Lead to Good Quality Materials?".
  \emph{2015 ASEE Annual Conference \& Exposition, Seattle, Washington, 2015, June}.
  ASEE Conferences, 2015.
  https://peer.asee.org/23899 Internet.  15 Apr, 2024

@INPROCEEDINGS{asee_peer_23899
author = "Alex Daniel Edgcomb, Joshua Sai Yuen, and Frank Vahid"
title = "Does Student Crowdsourcing of Practice Questions and Animations Lead to Good Quality Materials?"
booktitle = "2015 ASEE Annual Conference \& Exposition"
year = "2015"
month = "June"
address = "Seattle, Washington"
publisher = "ASEE Conferences"
note = {https://peer.asee.org/23899}
number = {10.18260/p.23899}
}

TY  - CPAPER
AB  -     Experiments in Student Crowdsourcing of Practice Question and                         Animation CreationModern, web-native textbooks use practice questions and animations to improve studentperformance. Practice questions help student’s learn and digest written material.Animations visually explain concepts. However, creating practice questions andanimations is time intensive. Educational content has been crowdsourced by Wikipediaand Khan Academy using content creators and raters. Content creators produce newcontent; raters sort the content by quality.This paper investigates whether student crowdsourcing can develop good-quality practicequestions and animations. We conducted four experiments to determine whether studentscan: (1) create good-quality practice questions, (2) reliably rate practice questions, (3)create good-quality animations, and (4) reliably rate animations. Experiments (1) and (2)contained 25 participants from an introductory embedded systems course (IES), andexperiments (3) and (4) contained a total of 587 participants from a basic computingcourse (BCC). IES students created 90 practice questions, each rated from 1 to 5 (5 isbest) by a professor. Using the same rating scale, the professor also rated the 19 student-voted-best BCC-student-made animations.4 of the 90 practice questions achieved a rating of 4; none achieved 5. 2 of the 19 BCCstudent-made animations rated by the professor achieved 5. For practice questions, theaverage of the top 20% of student ratings was strongly correlated with the professorrating with R-value = 0.82 (p-value = 0.02). For animations, the average of the top 10%of student ratings was strongly correlated with the professor ratings with R-value = 0.88(p-value < 0.001).Students can reliably rate practice questions and animations. Some students can makegood-quality animations, but students cannot make good-quality practice questions.
AU  - Alex Daniel Edgcomb
AU  - Joshua Sai Yuen
AU  - Frank Vahid
CY  - Seattle, Washington
DA  - 2015/06/14
PB  - ASEE Conferences
TI  - Does Student Crowdsourcing of Practice Questions and Animations Lead to Good Quality Materials?
UR  - https://peer.asee.org/23899
DO  - 10.18260/p.23899
ER  -