Honolulu, Hawaii
June 24, 2007
June 24, 2007
June 27, 2007
2153-5965
Engineering Economy
19
12.1316.1 - 12.1316.19
10.18260/1-2--2549
https://peer.asee.org/2549
532
Sarah Ryan is an Associate Professor of Industrial and Manufacturing Systems Engineering at Iowa State University. She received an NSF CAREER award with its educational component to promote active learning and was part of the team that developed the PSLP under a National Science Foundation grant, pioneering its use in engineering economic analysis.
John Jackman is an Associate Professor of Industrial and Manufacturing Systems Engineering at Iowa State University. He brings to this project expertise in the engineering problem solving process, computer simulation, web-based immersive learning environments, and data acquisition and control.
Rahul Marathe is a post-doc with the department of Industrial & Manufacturing Systems Engineering at Iowa State University with research interests in the theory and applications of stochastic processes. He is an instructor for the engineering economic analysis course involved in implementing the project.
Pavlo Antonenko is a doctoral candidate in Curriculum and Instructional Technology, and in Human-Computer Interaction at Iowa State University. In this project he is responsible for structuring PSLP problems, evaluating students’ browsing behavior and learning outcomes, and conducting usability testing.
Piyamart Kumsaikaew is a Ph.D. candidate in Industrial Engineering at Iowa State University. She obtained a B.S. in Computer Engineering from King Mongkut's Institute of Technology Ladkrabang and a M.S. in Industrial Engineering from Iowa State University. She is currently conducting research on cognitive engineering methods in problem solving environments.
Dale Niederhauser is an Assistant Professor of Curriculum and Instructional Technology at Iowa State University. His primary research interests include examining how people learn from hypertext and teacher development with regard to technology integration.
Craig Ogilvie is an Associate Professor of Physics at Iowa State University with expertise in both problem-solving instruction and the experimental study of the quark-gluon plasma in nuclear physics.
Student Selection of Information Relevant to Solving Ill- Structured Engineering Economic Decision Problems
Abstract
Engineering economic decision problems encountered in practice are embedded in information- rich environments, where large volumes of data are available from multiple sources. However, the information that is most relevant to solving the problem may be unavailable, inaccessible, inaccurate, or uncertain. In contrast, typical engineering economy textbook problems present only the relevant information in a convenient format. To help bridge the gap between textbook and practice, we engage student teams in a series of ill-structured problems. Teams work in an online Problem Solving Learning Portal (PSLP) that provides access to a variety of information resources containing both relevant and irrelevant information. In one problem instance, some information relevant to the solution must be obtained from an external resource that is not available or mentioned in the PSLP.
Student work in the PSLP is organized into successive stages of specifying decision criteria, stating assumptions, expressing their solution in a spreadsheet file and written rationale, and conducting a sensitivity analysis on a single variable they judge to be critical. In addition, they cut and paste information from the resources they see as relevant into a “working memory” repository. We explore different methods for assessing students’ ability to select which information is relevant. Direct measures include simple counts of “hits” and “false alarms” in the working memory that are assessed as part of the grading rubric and analyzed using signal detection theory. Their choice of the parameter(s) on which to conduct the sensitivity analysis can be considered as an indirect measure because the most relevant information is that which provides the best prediction of the most critical parameter (i.e., the parameter that will have the greatest impact on the decision criterion). The online environment also tracks the information resources visited by the student teams and the time of visitation. Data collected from a large engineering economy course are used to evaluate the effectiveness of these assessment methods.
Introduction
Making good engineering decisions is a critical skill for every engineering discipline. The complexity of decision making is tied to multiple criteria which can often be in conflict. Large volumes of information from multiple sources of real-time and historical electronic information are a source of additional complexity. Informal information infrastructures (e.g., mobile communication or instant messaging) increase the immediacy and volume of information available. Both the formal and the informal information infrastructures can drown an individual or team of problem solvers in a sea of data. In addition, information elements that a problem solver perceives as necessary may be unavailable, inaccessible, inaccurate, or involve uncertainty.
Engineering economic decisions involve both technical data and estimates of economic impacts, which frequently extend far into the future. The decision maker must gather and combine
Ryan, S., & Jackman, J., & Marathe, R., & Antonenko, P., & Kumsaikaew, P., & Niederhauser, D., & Ogilvie, C. (2007, June), Student Selection Of Information Relevant To Solving Ill Structured Engineering Economic Decision Problems Paper presented at 2007 Annual Conference & Exposition, Honolulu, Hawaii. 10.18260/1-2--2549
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2007 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015