Asee peer logo

A Process for Systematically Collecting Plan of Study Data for Curricular Analytics

Download Paper |

Conference

2023 ASEE Annual Conference & Exposition

Location

Baltimore , Maryland

Publication Date

June 25, 2023

Start Date

June 25, 2023

End Date

June 28, 2023

Conference Session

Student Experiences and Development – Session 1

Tagged Division

Educational Research and Methods Division (ERM)

Page Count

20

DOI

10.18260/1-2--42466

Permanent URL

https://peer.asee.org/42466

Download Count

174

Request a correction

Paper Authors

biography

David Reeping University of Cincinnati Orcid 16x16 orcid.org/0000-0002-0803-7532

visit author page

Dr. David Reeping is an Assistant Professor in the Department of Engineering and Computing Education at the University of Cincinnati. He earned his Ph.D. in Engineering Education from Virginia Tech and was a National Science Foundation Graduate Research Fellow. He received his B.S. in Engineering Education with a Mathematics minor from Ohio Northern University. His main research interests include transfer student information asymmetries, threshold concepts, curricular complexity, and advancing quantitative and fully integrated mixed methods.

visit author page

biography

Sushant Makarand Padhye University of Cincinnati

visit author page

Sushant Padhye is a freshman majoring in electrical engineering and an Undergraduate Research Assistant at the University of Cincinnati.

visit author page

author page

Nahal Rashedi

Download Paper |

Abstract

This theory paper describes challenges and opportunities with analyzing engineering curricula using the Curricular Analytics framework by offering a data collection framework for systematically collecting plans of study at scale. Introduced by Heileman and colleagues in 2017, the Curricular Analytics framework enables researchers and practitioners to quantify the interconnectedness of their prerequisite structures to unveil gatekeeper courses and forecast the impact of curricular policies or changes using network-analytic metrics. These metrics can be calculated using available data; all one needs to do is transform a plan of study into a list of courses, prerequisites, and corequisites.

Although the data requirements are minimal, there are distinct challenges to employing this framework across disciplines and institutions at scale – especially if longitudinal analyses are planned. For example, curricula are not always completely defined, leaving space for students to select electives with varying degrees of flexibility. Without specifying these electives, the curriculum’s complexity may be underestimated. Moreover, there are deeper data entry considerations; prerequisites can often be a complicated series of ANDs and ORs, with language like “at least” or “X of the following.” These configurations do not lead to obvious network representations. Finally, finding accurate plan of study information, even for recent years, can be challenging. Prerequisite and course information can be inaccurate or may not have been appropriately maintained by the respective institutional office. This paper focuses on standardized procedures and conventions employed in response to obstacles encountered during the first year of a project to collect plans of study for five engineering disciplines across the US: Civil Engineering, Electrical Engineering, Mechanical Engineering, Chemical Engineering, and Industrial Engineering. The sampling frame, in this case, was the Multi-Institution Database for Engineering Longitudinal Development (MIDFIELD). We chose to sample the most recent ten years since the last record per institution. To synthesize a standard operating procedure for collecting plan of study data at scale, we reflected on the processes taken during our initial data collection. The data sources we drew upon were (1) written records from weekly meetings; (2) the Microsoft Teams chat log for the project where personnel collaborated and posted questions for one another; and (3) reflections from the five undergraduate research assistants. We applied the constant comparative technique to find common data collection and entry issues, resulting in a flow diagram for standardized data entry usable across majors.

We anticipate this work being useful to researchers and practitioners interested in systematic analyses of curricula, especially in combination with student data to explore retention-related issues for first-time-in-college students. The dataset being created will be freely available, and others are encouraged to add their own plans of study. We offer the standard operating procedures in this paper, along with data conventions, to best facilitate the large-scale analysis of this type of network data. As the dataset grows, we anticipate the ability of the community to understand and interrogate the programmatic barriers to student success in engineering across the nation will also expand – leading to a cornucopia of previously unexplored questions at scale.

Reeping, D., & Padhye, S. M., & Rashedi, N. (2023, June), A Process for Systematically Collecting Plan of Study Data for Curricular Analytics Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--42466

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2023 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015