June 20, 2010
June 20, 2010
June 23, 2010
15.1036.1 - 15.1036.14
Results and Analysis of a Required Senior Exam To Assess Learning of Course Competencies.
As part of the ABET Accreditation Criterion, Program Outcomes refer to the outcomes that chemical engineering students should possess when they leave the university and enter the workforce. In 1999, as a response to ABET’s EC2000 criterion, a list of specific competencies was defined in the Chemical Engineering Program at Brigham Young University that, when taken together, constituted each Program Outcome. When the competencies were first developed, it became clear that the level of mastery expected from students varied from competency to competency. Exposure to the material was all that was required for some competencies. For others, it was our expectation that students should not graduate without demonstrating a specified level of mastery. The expected level of mastery is intimately connected to the types of practices, assessment, and feedback associated with a given competency. Consequently, a mastery level of 0, 1, 2, or 3 was assigned to each competency.
Level-0, which is described as optional, includes competencies that are desirable, but not required. Level-1 indicates some familiarity and experience, but defines no minimum level of performance. Level-2 includes chemical engineering skills in which students can solve engineering problems with the aid of reference materials. Level-3 competencies focus on fundamental concepts and principles upon which the skills/applications are based. Level-3 competencies provide the foundation for problem solving, and it is expected that students master these competencies sufficiently to solve engineering problems given little or no reference material.
When assigning levels to each competency, we identified 18 of the competencies as Level-3 competencies for assessment prior to graduation using a multiple-choice Level 3 (L3) competency exam. Similar to other competencies, these competencies are assessed at the course level with typical assessments such as homework, quizzes, and/or exams problems. The L3 exam is multiple-choice in format and is geared for approximately two hours. The exam is administered early in the senior year. Successful completion of the L3 exam is required for graduation.
This paper will discuss the results of the L3 exam since its inception as a graduation requirement in 2002. Insights will be discussed regarding pass rates, commonly missed competencies, comparisons between years of administration, and the feedback information to the curriculum. Critical assessment of the L3 exam process since inception will also be presented.
In 1999, Program Outcomes at Brigham Young University were established in response to ABET EC2000 requirements. Program Outcomes, as defined by ABET, “are narrower statements that describe what students are expected to know and be able to do by the time of graduation. These relate to the skills, knowledge, and behaviors that students acquire in their
Lewis, R., & Knotts, T., & Wilding, W. V., & Pitt, W., & Argyle, M. (2010, June), Results And Analysis Of A Required Senior Exam To Assess Learning Of Course Competencies. Paper presented at 2010 Annual Conference & Exposition, Louisville, Kentucky. https://peer.asee.org/16779
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2010 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015