Asee peer logo

A Rubric-Based Assessment of Information Literacy in Graduate Course Term Papers

Download Paper |

Conference

2023 ASEE Annual Conference & Exposition

Location

Baltimore , Maryland

Publication Date

June 25, 2023

Start Date

June 25, 2023

End Date

June 28, 2023

Conference Session

Engineering Libraries Division (ELD) Technical Session 3: Instruction & Information Literacy

Tagged Division

Engineering Libraries Division (ELD)

Tagged Topic

Diversity

Page Count

26

DOI

10.18260/1-2--42493

Permanent URL

https://peer.asee.org/42493

Download Count

384

Paper Authors

biography

Bridget M. Smyser Northeastern University

visit author page

Dr. Smyser is a Teaching Professor in the Mechanical and Industrial Engineering department at Northeastern University.

visit author page

biography

Jodi Bolognese Northeastern University

visit author page

Jodi Bolognese is the Engineering Librarian at Northeastern University, where she serves as liaison to the College of Engineering. Previously, she worked in product management for STEM learning technologies.

visit author page

Download Paper |

Abstract

The Materials Processing course at Unnamed University enrolls both Master’s level students with a concentration in Materials and undergraduates who select the course as an elective for their combined BS/MS degree. For the term project, students work in teams to research and write a journal quality review article detailing the state of the art for a particular process. The goal of this study was to assess students’ information literacy (IL) skills as demonstrated in this term project to identify IL skills with which graduate and upper-level undergraduate students may need more support. A secondary goal was to examine any differences in information literacy between the undergraduate students and the graduate students, many of whom are speaking English as a second language.

A customized version of the VALUE rubric for Information Literacy was used to assess a sample of 25 term projects from two semesters spanning 2021-2022. A Mechanical Engineering faculty member rated half the criteria that required more subject matter expertise. An Engineering Librarian rated the other half of the criteria that are more research-oriented. This method resulted in substantial time savings and increased expertise in overall ratings.

Initial results show strong positive correlations between the ability to recognize key concepts that require evidence and the ability to provide that evidence using appropriate sources. These positive correlations are significant at α = 0.05. Recognizing key concepts that require evidence is one of the weakest skills, along with the ability to cite sources accurately and synthesize information from several sources to achieve the purpose of the work. A concerning initial finding was a negative correlation between the number of graduate students on a team and the ability to cite sources accurately. Although this finding is only significant at α = 0.1, the data seem to back up previous anecdotal evidence as observed by the instructor. More work is required to determine the effect of English language learners on outcomes.

Smyser, B. M., & Bolognese, J. (2023, June), A Rubric-Based Assessment of Information Literacy in Graduate Course Term Papers Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--42493

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2023 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015