Assessing an Assessment: A Case Study of the NSSE 'Experiences with Information Literacy' Module

Debbie Morrow

Download Paper | Permalink

Conference: 2020 ASEE Virtual Annual Conference Content Access
Location: Virtual On line
Publication Date: June 22, 2020
Start Date: June 22, 2020
End Date: June 26, 2021
Conference Session: Professional Issues and Opportunities for Engineering Librarians
Tagged Division: Engineering Libraries
Page Count: 23
DOI: 10.18260/1-2--34173
Permanent URL: https://peer.asee.org/34173
Download Count: 477

Request a correction

Paper Authors

biography

Debbie Morrow Grand Valley State University

visit author page

Debbie Morrow currently serves as Liaison Librarian to the School of Engineering and the other units within the Padnos College of Engineering & Computing at Grand Valley State University, to the Mathematics, Statistics, and Physics departments, and to the Honors College at GVSU. In that position her primary role is to support students in courses in her liaison areas both in and outside of their classrooms. Helping students make connections between information literacy skills and the "life long learning" skills ABET seeks to see in engineering program graduates is an ongoing challenge. Prior to becoming a Liaison Librarian, Debbie served as Systems Librarian at GVSU and at Michigan Technological University for a combined 25 years. She earned her MLIS at the University of Illinois Urbana-Champaign in 1983.

visit author page

Download Paper | Permalink

Abstract

This case study explores anomalous results from an administration of the 'Experiences with Information Literacy' (IL) add-on Topical Module to the National Survey of Student Engagement (NSSE) at Grand Valley State University (Allendale, Michigan) in 2016, and finds that wording of NSSE survey questions can significantly influence results in certain contexts. Overall, summary responses for participating students compared positively to the aggregate means for all participating Large Public institutions in the 2016 NSSE cohort, on both the core NSSE survey and the IL module. However, analysis of local responses to the IL module questions broken out by individual colleges within the university revealed an anomaly. Students in GVSU's College of Engineering and Computing appeared to report very low engagement on nearly all of the items in the IL module; further disaggregated into separate programs comprising the college, data appeared to perhaps indicate that Engineering students’ educational experience with respect to information literacy learning at GVSU is qualitatively different from that of their peers in other academic and professional disciplines, even within their own college, which also includes Computer Science and Occupational Safety and Health. In 2018 Senior GVSU Engineering majors received a modified NSSE-IL survey (with permission obtained from NSSE), to explore whether Senior GVSU Engineering majors may be graduating with lesser information literacy learning preparation than other GVSU graduates. Results suggest that revising NSSE-IL framing questions does result in some significant changes in rates of certain responses, some tending in a positive direction toward the institutional mean, others tending negatively away from it. We conclude that NSSE-IL in 2016 has in fact allowed us to observe an anomaly, that Seniors in one specific program do not share a perception of information literacy experiences in common with their peers in other programs at the same institution; this, in spite of wording in the survey instrument that includes built-in assumptions that, taken at face value, could have led to an inaccurate or misleading profile of GVSU Engineering graduates' experience.

Citation
Format

Morrow, D. (2020, June), Assessing an Assessment: A Case Study of the NSSE 'Experiences with Information Literacy' Module Paper presented at 2020 ASEE Virtual Annual Conference Content Access, Virtual On line . 10.18260/1-2--34173

TY  - CPAPER
AB  - This case study explores anomalous results from an administration of the &#39;Experiences with Information Literacy&#39; (IL) add-on Topical Module to the National Survey of Student Engagement (NSSE) at Grand Valley State University (Allendale, Michigan) in 2016, and finds that wording of NSSE survey questions can significantly influence results in certain contexts. Overall, summary responses for participating students compared positively to the aggregate means for all participating Large Public institutions in the 2016 NSSE cohort, on both the core NSSE survey and the IL module. However, analysis of local responses to the IL module questions broken out by individual colleges within the university revealed an anomaly. Students in GVSU&#39;s College of Engineering and Computing appeared to report very low engagement on nearly all of the items in the IL module; further disaggregated into separate programs comprising the college, data appeared to perhaps indicate that Engineering students’ educational experience with respect to information literacy learning at GVSU is qualitatively different from that of their peers in other academic and professional disciplines, even within their own college, which also includes Computer Science and Occupational Safety and Health. In 2018 Senior GVSU Engineering majors received a modified NSSE-IL survey (with permission obtained from NSSE), to explore whether Senior GVSU Engineering majors may be graduating with lesser information literacy learning preparation than other GVSU graduates. Results suggest that revising NSSE-IL framing questions does result in some significant changes in rates of certain responses, some tending in a positive direction toward the institutional mean, others tending negatively away from it. We conclude that NSSE-IL in 2016 has in fact allowed us to observe an anomaly, that Seniors in one specific program do not share a perception of information literacy experiences in common with their peers in other programs at the same institution; this, in spite of wording in the survey instrument that includes built-in assumptions that, taken at face value, could have led to an inaccurate or misleading profile of GVSU Engineering graduates&#39; experience.

AU  - Debbie Morrow
CY  - Virtual On line 
DA  - 2020/06/22
PB  - ASEE Conferences
TI  - Assessing an Assessment: A Case Study of the NSSE 'Experiences with Information Literacy' Module
UR  - https://peer.asee.org/34173
DO  - 10.18260/1-2--34173
ER  -