June 26, 2011
June 26, 2011
June 29, 2011
Educational Research and Methods
22.1234.1 - 22.1234.13
Relationship between direct measures of ABET-TAC student outcomes achievementand indirect measures of student’s learning gathered from student evaluation ofteaching surveys.AbstractAssessment and evaluation of student learning are important considerations forEngineering Technology programs. ABET-TAC standards require that educationalobjectives and outcomes be chosen by the program and its constituents, measured byvarious means, and that the results be used to improve the program. The data that iscollected should be cross-checked in some fashion for the results to be consideredvalid. A large part of our program’s data collection process is classified as directassessment, that is, using tests, papers, homework, and lab exercises that measure thestudent’s learning or achievement of (a) – (k) student outcomes. We collect data allthrough the curriculum, freshman through senior levels, usually for two to four studentoutcomes per course.In those same courses, the university requires a formal student evaluation of teachingsurvey at the end of the semester. Our university uses the nationally normed surveyfrom IDEA, based in Manhattan, Kansas, that includes asking the students to assesstheir own “progress on objectives” on up to 12 different objectives. The IDEA systemallows the class instructor to choose three or four of the 12 objectives that areemphasized in the class, on which IDEA concentrates its data collection and analysis.Our program constructed a correspondence table between our ABET-TAC (a) – (k)student outcomes and the IDEA objectives, and course instructors choose the IDEAobjectives that are the closest match to the student outcomes we are measuring in thatcourse. The results of the IDEA student surveys can be classified as an indirectmeasure, which can be used to check the validity of our own direct measurements.There is a wide variety of opinion in higher education research literature, on whetherstudent evaluation of teaching results in valid conclusions. This paper reviews theresearch on this contentious subject. We agree with the opinion accepted by many, thatby using a research-based choice of questions, and with proper analysis andadjustment for confounding factors, that student’s self-evaluation of their learning canbe considered valid. IDEA uses this approach when reporting results back to the courseinstructor.Our program has collected two year’s worth of data that includes our ABET-TACstudent outcomes assessment and the adjusted IDEA student progress on objectives,gathered from the same courses. A preliminary analysis shows there is a statisticallysignificant, small-value negative correlation between these two measures of studentlearning. This type of result has been reported by studies in other academic fields. Thefinal paper will report the complete analysis of the data collected. The paper will drawconclusions and make recommendations on how student evaluation of teaching couldbe included in ABET student outcomes data collection process.
Garry, B. G. (2011, June), Relationship between ABET-TAC Criterion 3 A-K Student Learning Outcomes Achievement Paper presented at 2011 ASEE Annual Conference & Exposition, Vancouver, BC. https://peer.asee.org/18481
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2011 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015