June 15, 2014
June 15, 2014
June 18, 2014
Educational Research and Methods
24.1365.1 - 24.1365.12
Wanna Take a Survey? Exploring Tools to Increase Undergraduate Student Response Rates to Real-Time Experience SurveysStudents, particularly in higher education, are constantly bombarded with surveys imploring theiropinions on specific issues. Previous studies have shown that they feel little need to answer thesesurveys because of the thought that another student will answer in their place. This in turn,results in low response rates. Consequently, low survey response rates are a pervasive problem inresearch on undergraduate students. This study aims to address this problem by finding the bestmethod of survey data collection that satisfies the needs of the researcher while grabbing theattention of the student.In particular, this study focuses on discovering the most effective method for collecting dataabout student’s experiences learning engineering in real-time. Real-time data collection for thisstudy is described as gathering information about learning experiences within the context of thecurrent situation. Capturing data in the moment helps to eliminate possible memory loss withregard to experiences and also clarifies the context of the question and answer. With emphasis ongathering data in real-time, this study compares the data collection tools from popular socialmedia, institutional, and traditional online survey software. We address the research question:What real-time data collection tools are most likely to be successful with undergraduateengineering students and why? Also called, experience sampling methods, real-time datacollection is situated within the motivation framework of Flow.The data for our study come from focus groups with undergraduate students. We used semi-structured questions to gather information about a series of proposed survey tools includingsocial media such as Facebook and Twitter, standard survey software such as Qualtrics, andclassroom technologies such as clickers or interactive software. Focus groups were recorded,transcribed ver batim and coded looking for patterns in preferences and underlying reasons forthese preferences.The outcomes from this study include ways of prompting students to take the surveys (impetus)and suggestions for the format of the survey to increase response rates. Surprisingly we foundthat students suggested pen and paper as a top choice over electronic methods, even though thisapproach was not among our suggested options. These outcomes can help researchers developeffective strategies for real-time data collection.
Smalls, D. A., & Matusovich, H. M., & McCord, R. (2014, June), Wanna Take a Survey? Exploring Tools to Increase Undergraduate Student Response Rates to Real-Time Experience Surveys Paper presented at 2014 ASEE Annual Conference & Exposition, Indianapolis, Indiana. https://peer.asee.org/23298
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2014 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015