June 28, 1998
June 28, 1998
July 1, 1998
3.401.1 - 3.401.8
Measuring Engineering Students’ Intellectual Development Using Neural Network and Expert System Technology
Ronald L. Miller, Barbara M. Olds, Michael J. Pavelich Colorado School of Mines
Students completing an undergraduate engineering degree are expected to develop intellectually in addition to acquiring specific engineering knowledge and skills. However, effectively measuring intellectual development involves a time-consuming and expensive interview conducted and evaluated by trained human experts. In order to develop a quick and inexpensive alternative method for making these measurements, we are writing a software package based on neural network and expert system technology to emulate the interview and evaluation process. If successful, the software will allow engineering programs to rapidly and reliably measure the intellectual development of their students as a formative and summative assessment tool. This paper describes our progress on the project and remaining research questions under investigation.
Introduction and Background
Most engineering programs expect that their students will develop intellectually in addition to acquiring knowledge and skills in a specific engineering discipline. However, nearly all measures of student achievement are focused on content knowledge, process ability (e.g. design), or communication skills; students are assumed to be developing intellectually, especially in their ability to think critically, but rarely are meaningful data collected and reported which support such an assumption.
Using the techniques presently available to us, measuring intellectual development is difficult, time-consuming, and expensive. However, the recent movement towards outcomes assessment now requires reliable measures of students’ abilities to make reasoned decisions as they solve complex problems. For example, ABET requires institutions to develop assessment processes which can demonstrate “that the outcomes important to the mission of the institution and the objectives of the program are being measured.” 
Numerous pencil-and-paper test instruments including the Watson-Glaser Critical Thinking Appraisal  and California Critical Thinking Skills Test  purport to measure some aspect of intellectual development or ability to think critically. These types of tests are typically inexpensive and easy to administer, but their validity in measuring true intellectual development and thinking ability is questionable because pencil-and-paper instruments rely on close-ended questions with one right answer; no information is collected describing how or why the student chose a particular answer and no mechanism exists to adapt exam questions based on prior responses from the student.
Pavelich, M. J., & Olds, B., & Miller, R. (1998, June), Measuring Engineering Students? Intellectual Development Using Neural Network And Expert System Technology Paper presented at 1998 Annual Conference, Seattle, Washington. https://peer.asee.org/7275
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 1998 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015