June 16, 2002
June 16, 2002
June 19, 2002
7.1293.1 - 7.1293.7
Main Menu Session 3530
Validity of Student Self-Assessments
Sanjiv Sarin, Donald Headley North Carolina A&T State University
This paper examines the validity of self-assessment as a tool for measuring student abilities, in particular, whether self-assessments can be used as valid substitutes for instructor evaluations. Data is obtained from in-class student self-assessments and subsequent course tests that measure the same abilities. Correlation between self-assessment ratings and test scores are used to comment on the validity of self-assessments. Some observations are also made regarding the extent to which students over or under report their abilities on self-reports.
Interest in valid methods for assessing student outcomes has grown in higher education. This is especially true in engineering education as a consequence of the new Engineering Criteria 2000 (EC 2000) requirements that became fully effective starting from the Fall 2001 visitation cycle. The new EC 2000 criteria represent a major shift in the philosophy behind accreditation of engineering programs. Instead of focusing on resources and inputs provided to an engineering program, the new accreditation criteria emphasize student learning, i.e., outcomes. The use of outcomes assessment data to guide the improvement of educational processes is a cornerstone of EC 20001.
Given the limitations of achievement tests in fulfilling outcomes assessment requirements, the assessment community has recommended several alternative approaches for assessing student outcomes. These include portfolios, capstone design project evaluations, student, alumni and employer surveys, and placement data of graduates. Yet, written surveys administered to current students are the most frequently used assessment instruments, due in part to two reasons – one, they are relatively inexpensive to conduct, and, two, a high response rate is almost guaranteed. A natural question is whether these student self-assessments are valid substitutes for test questions created and scored by an instructor.
This paper reports the results of a study undertaken to examine the validity of student self- assessment surveys as a tool for measuring the mastery of concepts. The term validity is defined as the correlation between self-assessment and test scores on the same measures. The paper reports results of data collected from three courses (two sophomore and one junior) taught over one academic year. The data represent over one hundred students in these courses. St udents
Proceedings of the 2002 American Society for Engineering Education Annual Conference & Exposition Copyright Ó 2002, American Society for Engineering Education
Headley, D., & Sarin, S. (2002, June), Validity Of Student Self Assessments Paper presented at 2002 Annual Conference, Montreal, Canada. 10.18260/1-2--11265
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2002 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015