PAT: A Program Asessment Tool for Engineering Programs

Hatice O. Ozturk; Dianne Raubenheimer

Download Paper | Permalink

Conference: 2011 ASEE Annual Conference & Exposition
Location: Vancouver, BC
Publication Date: June 26, 2011
Start Date: June 26, 2011
End Date: June 29, 2011
ISSN: 2153-5965
Conference Session: Developments in BME Pedagogy and Assessment
Tagged Division: Biomedical
Page Count: 14
Page Numbers: 22.1143.1 - 22.1143.14
DOI: 10.18260/1-2--18357
Permanent URL: https://peer.asee.org/18357
Download Count: 493

Paper Authors

biography

Hatice O. Ozturk North Carolina State University

visit author page

Hatice O. Ozturk holds a joint appointment between Biomedical Engineering and Electrical and Computer Engineering Departments in the College of Engineering at North Carolina State University as a Teaching Associate Professor. She divides her time within each department between teaching, program assessment, advising and research.

visit author page

biography

Dianne Raubenheimer North Carolina State University

visit author page

Dr. C. Dianne Raubenheimer is Director of Assessment in the College or Engineering and Adjunct Assistant Professor in the Department of Adult and Higher Education at NC State University. Within the College of Engineering she serves as the coordinator of ABET and other accreditation processes, acts as a resource/consultant to faculty in the different programs, develops and implements assessment plans, and serves as the primary educational assessment/data analyst adviser on the Dean’s staff. A particular interest is in helping faculty to develop and implement classroom-based assessment and action research plans to establish the effectiveness of instruction and to use the data to improve teaching and student learning. She is currently working with several engineering faculty assessing the impact of in-class use of technology on teaching and student learning. Dianne has also worked as an education consultant for a number of organizations conducting program evaluations and is currently serving as external evaluator on several grants. Her research interests focus on faculty development, action research, the role of technology in teaching and learning, and assessment in higher education.

visit author page

Download Paper | Permalink

Abstract

PAT: An online Program Assessment Tool for Engineering ProgramsOver the last decade Engineering Criteria 2000 significantly changed the way in whichengineering programs undertake assessment and report for accreditation purposes. Sinceimplementation of EC2000, engineering programs are required to demonstrate theachievements of their program educational objectives and program outcomes byfollowing a documented assessment plan. The sustainability of this assessment processbecame a problem for all those involved. Program coordinators started to look for waysof automating the process and of changing the accreditation activities from a year-longfrenzy prior to the visit, to something that is ongoing and sustainable.In the meantime, several commercial software programs became available, ostensibly tofacilitate the assessment and reporting processes. Being a large engineering college with18 engineering programs, it wasn’t possible to converge upon a common commercialsoftware tool that everyone agreed upon. It was decided that any tool selected would needto fit to the existing assessment plans, not the other way around, and that its main featureswould be flexibility, scalability and sustainability. Thus, we conceptualized and built thesoftware for an in-house program assessment tool, which was developed with activeparticipation of the engineering program assessment coordinators, and it has foundwidespread support throughout the college. PAT (Program Assessment Tool) combinesthe best features of all the assessment plans and procedures in our College ofEngineering.Using the Biomedical Engineering program as a case study, we will present in detail themany assessment features of the software tool. These include: • Program assessment matrix, involving both direct and indirect measures, • Program sub-outcomes matrix, • Course based assessment tasks for assessing student achievement of outcomes, • Assessment metrics indicating acceptable levels of student performance, • Uploading of grades, including automatic linkage to online grade books, • Automatic analysis of assessment data, for course and program outcome achievement, • Commentary and reporting features, • Syllabus and CV generators, • Levels of access by different roles (faculty, assessment coordinators, administrators).We will also discuss the process through which PAT was developed, piloted and refined.

Citation
Format

Ozturk, H. O., & Raubenheimer, D. (2011, June), PAT: A Program Asessment Tool for Engineering Programs Paper presented at 2011 ASEE Annual Conference & Exposition, Vancouver, BC. 10.18260/1-2--18357

TY  - CPAPER
AB  - PAT: An online Program Assessment Tool for Engineering ProgramsOver the last decade Engineering Criteria 2000 significantly changed the way in whichengineering programs undertake assessment and report for accreditation purposes. Sinceimplementation of EC2000, engineering programs are required to demonstrate theachievements of their program educational objectives and program outcomes byfollowing a documented assessment plan. The sustainability of this assessment processbecame a problem for all those involved. Program coordinators started to look for waysof automating the process and of changing the accreditation activities from a year-longfrenzy prior to the visit, to something that is ongoing and sustainable.In the meantime, several commercial software programs became available, ostensibly tofacilitate the assessment and reporting processes. Being a large engineering college with18 engineering programs, it wasn’t possible to converge upon a common commercialsoftware tool that everyone agreed upon. It was decided that any tool selected would needto fit to the existing assessment plans, not the other way around, and that its main featureswould be flexibility, scalability and sustainability. Thus, we conceptualized and built thesoftware for an in-house program assessment tool, which was developed with activeparticipation of the engineering program assessment coordinators, and it has foundwidespread support throughout the college. PAT (Program Assessment Tool) combinesthe best features of all the assessment plans and procedures in our College ofEngineering.Using the Biomedical Engineering program as a case study, we will present in detail themany assessment features of the software tool. These include:   • Program assessment matrix, involving both direct and indirect measures,   • Program sub-outcomes matrix,   • Course based assessment tasks for assessing student achievement of outcomes,   • Assessment metrics indicating acceptable levels of student performance,   • Uploading of grades, including automatic linkage to online grade books,   • Automatic analysis of assessment data, for course and program outcome       achievement,   • Commentary and reporting features,   • Syllabus and CV generators,   • Levels of access by different roles (faculty, assessment coordinators,       administrators).We will also discuss the process through which PAT was developed, piloted and refined.
AU  - Hatice O. Ozturk
AU  - Dianne Raubenheimer
CY  - Vancouver, BC
DA  - 2011/06/26
PB  - ASEE Conferences
TI  - PAT: A Program Asessment Tool for Engineering Programs
UR  - https://peer.asee.org/18357
DO  - 10.18260/1-2--18357
ER  -