June 15, 2014
June 15, 2014
June 18, 2014
24.204.1 - 24.204.15
Assessing Metacognition During Problem-Solving in Two Senior Concurrent CoursesMetacognition refers to people’s abilities to predict their performances on various tasks and tomonitor their current levels of mastery and understanding1. Flavell2, 3 distinguished twocharacteristics of metacognition: knowledge of cognition (KC) and regulation of cognition (RC).KC includes knowledge of the skills required by different tasks, strategic knowledge and self-knowledge. RC includes the ability to monitor one’s comprehension and to control one’slearning activities. There is a considerable amount of data that supports the value of ametacognitive approach to instruction4. It includes an emphasis on learning with understandingand on problem solving, but part of the emphasis is on understanding the cognitive andemotional processes involved in these kinds of activities1-5. We designed and implementedseveral problem-solving learning environments6, 7 (PSLEs) for two chemical engineering seniorconcurrent courses entitled Kinetics and Homogeneous Reactor Design and Mass Transfer UnitOperations I at University ABC. In order to support a metacognitive approach to instruction, theteacher of both courses created a supportive social environment and inserted a series of questionprompts during PSLEs as a form of coaching, where the problems to be solved were representedas cases that were utilized in several ways (worked examples, case studies, structural analogues,prior experiences, alternative perspectives, and simulations) as instructional supports6, 7.The Metacognitive Awareness Inventory (MAI) designed by Schraw and Dennison8 was utilizedas a pre- (first day of classes) post- (last day of classes) test. MAI is a 52-item inventory thatmeasures adults’ metacognitive awareness. Items are classified into eight subcomponentssubsumed under two broader categories, KC and RC. Furthermore, in order to assessmetacognitive awareness during problem-solving activities, students had to answer thecorresponding problem as well as 2-3 embedded problem-solving prompts7 and 4-6 embeddedmetacognitive prompts (from MAI). MAI prompts were chosen based on the level of complexityof the problem and the type of knowledge and skills required to solve it. A final design challengewas used to simultaneously assess student attainment of learning outcomes for both courses,through the synthesis and analysis of the reaction and separation stages in a chemical plant.Students were asked to carry out a presentation of their solution methodology, obtained resultsand conclusions for this challenge. Presentations were videotaped to be further examined.Results for the pre-post MAI exhibit a significant (p0.05) in MAI. Analysis of final presentations allowed to identify students’ abilities to solvecomplex problems as well as their argumentative and metacognitive skills. The vast majority ofstudents attained expected both courses’ learning outcomes at an acceptable level. Bransford, J.D., Brown A.L. and Cocking, R.R. 2000. How People Learn. Brain, Mind, Experience and School. Expanded Edition. Washington D.C.: National Academy Press. Flavell, J. 1976. Metacognitive aspects of problem-solving. In L. B. Resnick (Ed.), The Nature of Intelligence (pp. 231–236). Hillsdale, NJ: Lawrence Erlbaum Associates. Flavell, J. 1979. Metacognition and cognitive monitoring: A new area of cognitive- developmental inquiry. American Psychologist, 34(10): 906–911. Bransford, J.D., Vye, N. and Bateman, H. 2002. Creating High-Quality Learning Environments: Guidelines from Research on How People Learn. In P. Albjerg Graham, N.G. Stacey (Eds.), The Knowledge Economy and Postsecondary Education: Report of a Workshop. Washington D.C.: National Academy Press. XXX [For blind review purposes]. 2013. Proceedings of the 2013 ASEE Annual Conference and Exposition, Atlanta, GA, June 23 – 26. Jonassen, D. H., Strobel, J., and Lee, C. B. 2006. Everyday problem solving in engineering: Lessons for engineering educators. Journal of Engineering Education, 95(2): 1–14. Jonassen, D. H. 2011. Learning to Solve Problems: A Handbook for Designing Problem- Solving Learning Environments. Routledge: New York. Schraw, G., and Dennison, R. S. 1994. Assessing metacognitive awareness. Contemporary Educational Psychology, 19: 460-475.
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2014 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015