Asee peer logo

Test Preparation and Test Quality Assessment: What I Wish Someone Had Told Me in the Beginning

Download Paper |

Conference

2012 ASEE Annual Conference & Exposition

Location

San Antonio, Texas

Publication Date

June 10, 2012

Start Date

June 10, 2012

End Date

June 13, 2012

ISSN

2153-5965

Conference Session

Assessments, Assessments, and Assessments

Tagged Division

New Engineering Educators

Page Count

9

Page Numbers

25.1274.1 - 25.1274.9

DOI

10.18260/1-2--22031

Permanent URL

https://peer.asee.org/22031

Download Count

591

Paper Authors

biography

David B. Meredith Pennsylvania State University, Fayette

visit author page

David Meredith is an Associate Professor of general engineering with more than 30 years of teaching experience at Penn State, Fayette, the Eberly campus. He teaches both engineering and engineering technology classes. He is a registered Professional Engineer and active in ASHRAE, ABET, and NCEES. He has received numerous awards from the campus, college, university and other organizations for excellence in teaching, scholarship, community service, and advising.

visit author page

Download Paper |

Abstract

Test Preparation and Test Quality Assessment – What I Wish Someone Had Told Me in the BeginningHow does an instructor prepare a test and feel confident that it is fair, balanced and the correct length? That issueworried me as I entered the teaching profession three decades ago. After a decade of writing multiple choicequestions for the Professional Engineering exam and two decades of national involvement with the ABETaccreditation process, it is time to pass some of the “tricks of the trade” along to the next generation of newfaculty members.As a starting point for this discussion, the assumption that course outcomes have been linked to not only Programoutcomes but also ABET outcomes will be reviewed. While discussing the selection of an appropriate evaluationmethod, I will also discuss some of the topics that do NOT lend themselves to timed tests. Suggestions onalternative methods of evaluation for those topics will be offered.This paper will focus on how to prepare good True/False and Multiple Choice questions to test knowledge andskill. It will also present a simplified version of the method psychometricians use to evaluate the quality of thesetypes of exam questions for both difficulty and discrimination. Since many engineering and technology questionsinvolve calculations, a test evaluation method that works for me will be discussed. This method is a good firststep to demonstrate course improvement to ABET. Since much of how we teach is driven by ABET criteria andthe need for continuous quality improvement, this experience should prove valuable to new faculty who maynever have prepared for an ABET visit.

Meredith, D. B. (2012, June), Test Preparation and Test Quality Assessment: What I Wish Someone Had Told Me in the Beginning Paper presented at 2012 ASEE Annual Conference & Exposition, San Antonio, Texas. 10.18260/1-2--22031

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2012 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015