June 24, 2017
June 24, 2017
June 28, 2017
Design in Engineering Education
How can instructors leverage assessment instruments in design, build, and test courses to simultaneously improve student outcomes and assess student learning well enough to improve courses for future students?
We recognize the need for a framework for shaping and assessing student learning. In that spirit, we contend that in design, build, and test courses students learn when they are required to reflect on their experiences and identify their learning explicitly. Further, we posit that utilization of an assessment instrument, the learning statement (LS), can be used to both enable and assess student learning.
In our course, AME4163: Principles of Engineering Design, a senior-level, pre-capstone, engineering design course, students learn by reflecting on doing by writing statements anchored in Kolb’s experiential learning cycle. In Fall 2016 we collected over 11,000 learning statements from over 150 students. To address the challenge of analyzing and gleaning knowledge from the large number of learning statements we resorted to text mining to analyze student-submitted learning statements.
We assert that text mining empowers instructors to better assess student learning in design, build, and test courses. Utilizing current algorithms for identifying writing patterns, we form a picture of learning over the course of the semester. Employing this tool, we can quantify student learning through reflection on doing and improve the course for future offerings. We find that student insight is characterized by focusing on the future utility of learning, particularly in areas such as planning a design process and evaluating design concepts. In this paper, we cover the salient features of the course, the learning statements, text mining and initial findings.
Autrey, J. L., & Sieber, J. M., & Siddique, Z., & Mistree, F. (2017, June), Board # 38 : Work in Progress: Quantification of Learning through Learning Statements and Text Mining Paper presented at 2017 ASEE Annual Conference & Exposition, Columbus, Ohio. 10.18260/1-2--27843
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2017 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015