Conference Session

NSF Grantees' Poster Session

Collection

2012 ASEE Annual Conference & Exposition

Authors

Christopher B. Williams, Virginia Tech; Jacob Preston Moore, Virginia Tech; Aditya Johri, Virginia Tech; Robert Scott Pierce, Sweet Briar College; Chris North, Virginia Tech

Tagged Topics

NSF Grantees Poster Session

are effective interventions in providing students with a holistic understanding of adomain while also allowing understanding of relationships among parts and across theengineering curricula. Yet when the domain of application is large, concept maps becomeoverburdened with too much information and complexity. A function of the individual learners’cognitive load abilities, this phenomenon (termed “map shock”) results in student disengagementand reduction of expected learning gains. This limitation prevents the creation of concept mapsthat provide a unified framework for engineering knowledge across courses and curricula.To address these limitations, the authors apply theoretical research on adaptive expertise, conceptmaps, and information

Conference Session

NSF Grantees Poster Session

Collection

2023 ASEE Annual Conference & Exposition

Authors

Anthony Weiss, University of Missouri, Kansas City; Darran Cairns, West Virginia University; Tiffani Riggers-Piehl, University of Missouri, Kansas City; Jacob Marszalek, University of Missouri, Kansas City; Michelle Maher, University of Missouri, Kansas City

Tagged Topics

NSF Grantees Poster Session

Paper ID #39159Board 365: Reaching Consensus: Using Group Concept Mapping in aMulti-Site STEM Hub Research TeamMr. Anthony Weiss, University of Missouri, Kansas City Anthony Weiss is a Ph.D. candidate in Mechanical Engineering with a co-discipline in Education, Lead- ership, Policy, and Foundations at UMKC. Prior to this he received his BS in Mechanical Engineering Technology from Pittsburg State University in 2016 where he also was a student-athlete participating in Cross Country and Track and Field. He went on to get his BS in Mechanical Engineering in 2019 from UMKC and then completed his Masters in Mechanical

Conference Session

NSF Grantees Poster Session

Collection

2017 ASEE Annual Conference & Exposition

Authors

Ning Fang, Utah State University

Tagged Topics

NSF Grantees Poster Session

Paper ID #18001Student Perceptions of Concept Mapping in a Foundational UndergraduateEngineering CourseProf. Ning Fang, Utah State University Ning Fang is a Professor in the Department of Engineering Education at Utah State University, USA. He has taught a variety of courses at both graduate and undergraduate levels, such as engineering dy- namics, metal machining, and design for manufacturing. His areas of interest include computer-assisted instructional technology, curricular reform in engineering education, and the modeling and optimization of manufacturing processes. He earned his PhD, MS, and BS degrees in mechanical

Conference Session

NSF Grantees Poster Session

Collection

2019 ASEE Annual Conference & Exposition

Authors

Ning Fang, Utah State University

Tagged Topics

NSF Grantees Poster Session

Paper ID #24600Board 49: Enhancing Student Active Learning via Concept Mapping in anUndergraduate Engineering CourseProf. Ning Fang, Utah State University Ning Fang is a Professor in the Department of Engineering Education at Utah State University, U.S.A. He has taught a variety of courses at both graduate and undergraduate levels, such as engineering dy- namics, metal machining, and design for manufacturing. His areas of interest include computer-assisted instructional technology, curricular reform in engineering education, and the modeling and optimization of manufacturing processes. He earned his Ph.D., M.S., and B.S

Conference Session

NSF Grantees Poster Session

Collection

2019 ASEE Annual Conference & Exposition

Authors

Micah Lande, South Dakota School of Mines & Technology; Yue Liu, Arizona State University

Tagged Topics

NSF Grantees Poster Session

’ Design Process Concept MapsIntroductionIn our ongoing exploration of this EAGER EEC NSF-funded project, we share results of thedesign concept maps part of our research project. This paper is intended to share formativedevelopment of a coding scheme to assess and evaluate drawings by undergraduate engineeringstudents of their engineering design process. There is a spectrum of student responses anddeveloping a taxonomy, or categorization, is helpful to better understand where students beginand end from a design project learning experience. This can then inform and illustrate the waysin which students balance breadth and depth and learn and apply their engineering know how.Design may appear throughout a curriculum or be substantiated as a capstone

Conference Session

NSF Grantees’ Poster Session

Collection

2015 ASEE Annual Conference & Exposition

Authors

Ning Fang, Utah State University

Tagged Topics

NSF Grantees Poster Session

Paper ID #11222Using Students-Generated Concept Maps to Assess Students’ Conceptual Un-derstanding in a Foundational Engineering CourseProf. Ning Fang, Utah State University Ning Fang is a Professor in the College of Engineering at Utah State University, USA. He has taught a variety of courses at both graduate and undergraduate levels, such as engineering dynamics, metal machining, and design for manufacturing. His areas of interest include computer-assisted instructional technology, curricular reform in engineering education, the modeling and optimization of manufacturing processes, and lean product design. He earned his

Conference Session

NSF Grantees' Poster Session

Collection

2013 ASEE Annual Conference & Exposition

Authors

Jacob P. Moore, Virginia Tech; Christopher B. Williams, Virginia Tech; Chris North, Virginia Tech; Aditya Johri, Virginia Tech

Tagged Topics

NSF Grantees Poster Session

informal environments. He also examined the role of ICT in supporting distributed work among globally dispersed workers and in furthering social development in emerging economies. Page 23.998.1 c American Society for Engineering Education, 2013 PROMOTING CONCEPTUAL UNDERSTANDING IN ENGINEERING STATICS THROUGH THE USE OF ADAPTIVE CONCEPT MAPSAbstract:In this paper, the authors discuss their continuing work on a NSF TUES Phase 1 project in whichthey are exploring the feasibility and effectiveness of a scalable concept map as an organizationaltool for a digital textbook. This tool, termed the

Conference Session

NSF Grantees Poster Session

Collection

2023 ASEE Annual Conference & Exposition

Authors

Courtney S. Smith-Orr, University of North Carolina, Charlotte; Valentina Cecchi, University of North Carolina, Charlotte; Paras Mandal, University of Texas at El Paso; Sukumar Kamalasadan

Tagged Topics

NSF Grantees Poster Session

Paper ID #39416Board 348: NSF Grantees Poster Session: Power Engineering CurriculumUpdate: Preliminary Evaluation of Student Concept Maps on EnergyForecastingDr. Courtney S. Smith-Orr, University of North Carolina, Charlotte Courtney S. Smith, PhD is a Undergraduate Coordinator & Teaching Assistant Professor at UNC Char- lotte. Her research interests span the mentoring experiences of African American women in engineer- ing,minority recruitment and retention, and best practices forProf. Valentina Cecchi, University of North Carolina, Charlotte Valentina Cecchi is originally from Rome, Italy. She attended Drexel University in

Conference Session

NSF Grantees Poster Session

Collection

2023 ASEE Annual Conference & Exposition

Authors

Tripp Shealy, Virginia Tech; John S. Gero, University of North Carolina, Charlotte; Paulo Ignacio Jr.

Tagged Topics

NSF Grantees Poster Session

John Gero is Research Professor in Computer Science and Architecture at UNCC He was formerly Re- search Professor in Krasnow Institute for Advanced Study, and Research Professor in Computational Social Science at George Mason University and Professor of DesPaulo Ignacio Jr. ©American Society for Engineering Education, 2023 Measuring the “thinking” in systems thinking: Correlations between cognitive and neurocognitive measures of engineering studentsIntroduction and backgroundSystems thinking is a critical skill for engineering students to solve complex and ill-structureddesign problems [1]. Concept mapping is a tool for systems thinking [2]. It involves

Conference Session

NSF Grantees’ Poster Session

Collection

2015 ASEE Annual Conference & Exposition

Authors

Nolan Alexander LaSota, University of Pittsburgh; Robert S. Parker, University of Pittsburgh; Cheryl A Bodnar, University of Pittsburgh

Tagged Topics

NSF Grantees Poster Session

opportunities through a weekly workshop series. The professionaldevelopment opportunities included skills that are relevant to engineering or scientific careerssuch as scientific writing and presentation skills, as well as opportunities that provided studentswith the background and scope of the diverse systems medicine field. Students presented theirwork in a local undergraduate research poster session and provided a final presentation on theirresearch results. Select students also presented their research at national meetings.To determine the effectiveness of the REU program for preparing students for the complexity ofthe systems medicine field, students completed concept maps detailing their vision of thesystems medicine field at the start and end of

Conference Session

NSF Grantees Poster Session

Collection

2017 ASEE Annual Conference & Exposition

Authors

Elise Barrella P.E., James Madison University; Mary Katherine Watson, The Citadel; Olga Pierrakos, James Madison University

Tagged Topics

NSF Grantees Poster Session

, particularly for complex problem-solving like sustainable design. We willalso present progress on new or adapted assessment tools that focus on direct measures ofstudent domain knowledge in different contexts (e.g., automated scoring of concept maps) andcorrect application of knowledge (e.g., cross-disciplinary sustainable design rubrics).The first part of the project is updating a Sustainable Design Rubric (SD Rubric) for cross-disciplinary applications. Prior to the start of this project, members of the research teamdeveloped and tested a sustainable design rubric for evaluating capstone design projects,specifically for civil and environmental engineering.2 For purposes of this project, non-disciplinespecific (or adaptable) measurement instruments

Conference Session

NSF Grantees Poster Session

Collection

2021 ASEE Virtual Annual Conference Content Access

Authors

Elise Barrella P.E., DfX Consulting LLC; Mary Katherine Watson, The Citadel; Robin Dawn Anderson, James Madison University

Tagged Topics

NSF Grantees Poster Session

supports substantive validity. We found correlations betweencriteria from the economic category and each the environmental and social categories. Thisprovides early evidence of external validity, as we expected these correlations across categoriessince economic criteria specifically ask students to reflect on the economic impacts of addressingenvironmental and social criteria. Overall, the Rubric seems to help students grasp whatsustainable design “is” or “should look like” for different types of projects [5].Neuroeducation studyThe second study used an electroencephalograph (EEG) and self-report data to investigatestudents’ cognitive load and performance when completing concept mapping and listing tasksrelated to complex issues like food security

Conference Session

NSF Grantees Poster Session

Collection

2017 ASEE Annual Conference & Exposition

Authors

Julie P Martin, Clemson University; Shannon K Stefl, Clemson University; Amy Slaton, Drexel University (Eng. & Eng. Tech.)

Tagged Topics

Diversity, NSF Grantees Poster Session

. that occurred tothem during discussions. Participants would immediately adhere their sticky note to a posterboard reflecting the thread the idea most closely related to. This process continued throughout allof the sessions on the first day and resulted in a large collection of participant-produced stickynotes at the end of Day 1. On day 2 the participants were given a subset of the sticky notecollection and were asked to analyze the notes. The conference ended with participants workingtogether to create concept maps that outlined relationships between the ideas reflected on thesticky notes. Figure 3. Overview of the process of developing a

Conference Session

NSF Grantees Poster Session

Collection

2021 ASEE Virtual Annual Conference Content Access

Authors

Steven Hoffenson, Stevens Institute of Technology (School of Systems & Enterprises); Nicole P. Pitterson, Virginia Polytechnic Institute & State University

Tagged Topics

NSF Grantees Poster Session

including surveys, text analysis, and concept mapping [12–15]. The researchfields of “decision-based design” and “design for market systems” have been investigating waysto concurrently design for technical performance and market success [16, 17]. However, there is alimited body of literature discussing student conceptions of product design and the designprocess, and in particular whether and how market considerations are a part of those conceptions,which this project aims to measure and analyze in a quantitative manner.Research objectives and questionsTo bridge the gap between market-driven design and engineering education research, this projectexplores how students think about and internally organize design concepts before and afterexposing them

Conference Session

NSF Grantees Poster Session

Collection

2019 ASEE Annual Conference & Exposition

Authors

Elise Barrella P.E., Wake Forest University ; Mary Katherine Watson, The Citadel; Robin Anderson, James Madison University; Charles McDonald Cowan II, Wake Forest University; Justyn Daniel Girdner, James Madison University

Tagged Topics

NSF Grantees Poster Session

,including specific objectives for the work and results, and in recent publications [3, 4, 5].Neuroeducation StudyAfter a successful pilot project with an electroencephalogram (EEG) to measure cognitive loadduring a statics problem-solving session, we initiated a pilot study using EEG and self-reportdata to investigate engineering undergraduate students’ cognitive activities when completingdifferent tasks related to sustainability problem contexts. Following a brief demographic survey,systems thinking survey, and benchmarking tests with the EEG, each participant completed twolisting and two concept mapping tasks in one of four randomly assigned sequences. Each taskrelated to a sustainability issue: climate change, food systems, renewable energy, or

Conference Session

NSF Grantees: Design

Collection

2020 ASEE Virtual Annual Conference Content Access

Authors

Steven Hoffenson, Stevens Institute of Technology; Nicole P. Pitterson, Virginia Polytechnic Institute & State University; Jessica Rose Driscoll, Stevens Institute of Technology

Tagged Topics

NSF Grantees Poster Session

, organizing, and integrating new information.MethodologyAligned with these constructivism principles, the research questions are addressed throughseveral exercises that took place with 130 third-year undergraduate engineering students in acourse called Engineering Design VI, as it is the sixth in an eight-course Design Spine sequence.The assessment tools include concept mapping exercises, in-class market simulation workshops,open-ended written reflections, and surveys, as well as the students’ term project reports. Thesetools are summarized with their connections to one another, the research questions, and theconstructivism principles in Figure 1. Figure 1: Research activities (white boxes) mapped to the research questions (grey boxes) that they

Conference Session

NSF Grantees' Poster Session

Collection

2012 ASEE Annual Conference & Exposition

Authors

Stephen J. Krause, Arizona State University; Jacquelyn E. Kelly, Arizona State University; Dale R. Baker, Arizona State University

Tagged Topics

NSF Grantees Poster Session

length scales 2. Repairing misconceptions and filling in knowledge gaps 4. Lack of class activities in materials texts for students to engage in own learning 5. Lack of real-world contexts in texts for showing value of concepts and problemsThe second significant change was development and use of Concept Map Quizzes (CMQs). A CMQ(shown on the next page in Figure 4) is a concept map from which a set of terms or concepts or imageshas been removed from a level of boxes on a concept map and then placed in a "word bank" or"terminology bank." A student can then draw upon the "word bank" to put the words or terms into anappropriate box or bubble. The CMQs were used both as prior class Homework Preview Problems aswell as a team-based classroom

Conference Session

NSF Grantees’ Poster Session

Collection

2014 ASEE Annual Conference & Exposition

Authors

Charles E. Pierce, University of South Carolina; Nicole Berge, University of South Carolina

Tagged Topics

NSF Grantees Poster Session

Tagged Divisions

Division Experimentation & Lab-Oriented Studies

) are currently Page 24.422.6being developed. It is expected that these joint modules will provide continuity to students andenhance their learning experience. For example, a common context will be developed for activelearning modules in ECIV 303 and 350 as well as the associated lab courses (ECIV 303L and350L). EFFECTs will be implemented in all four courses in Fall 2014.Student construction of nanotechnology-based concept maps will be used to facilitate linking ofthe EFFECTs. Concept maps, along with end products from each EFFECT, will be assembled toproduce nanotechnology-themed electronic portfolios or blogs. The e-portfolio content

Conference Session

NSF Grantees: Entrepreneurship

Collection

2020 ASEE Virtual Annual Conference Content Access

Authors

Bahram Roughani, Loyola University Maryland

Tagged Topics

NSF Grantees Poster Session

project is measured by the quality of the prototypecreated, ability to adhere to a project timeline, quality of the written project report anddocumentations, the oral presentation, and the team project portfolio. Future plans includeleveraging concept map to assess the impact of the whole course as well as the “UserInnovation” module on students’ perception and attitudes about entrepreneurial mindset.Acknowledgement: Support for this work is provided by the National Science Foundation'sIUSE program under Award No. 1624882Introduction:Preparing STEM students for the knowledge economy requires combining technical andtheoretical knowledge with the 21st-century skills. These have typically been defined ascommunication, collaboration, critical

Conference Session

NSF Grantees: Learning Tools (Hands On)

Collection

2020 ASEE Virtual Annual Conference Content Access

Authors

Blake Herren, University of Oklahoma; Nyree Mason; Firas Akasheh, Tuskegee University; Gül E. Okudan Kremer, Iowa State University of Science and Technology; Zahed Siddique, University of Oklahoma; Yingtao Liu, University of Oklahoma

Tagged Topics

NSF Grantees Poster Session

understanding of these concepts after learning the developed M3E module. Thus, trainingstudents to establish such a mental model using solid mechanics concepts is a reasonable approach,which can even contribute to students’ engineering career development through their lives. Viaappropriate analysis, fundamental concepts in mechanics can be completely separate in students’mind before they have a firm understanding of their meaning, as shown in Figure 6. The M3Eapproach is expected to help students connect these abstract concepts and develop their mentalmodel to represent a network of such complex concepts. A well-developed concept map,externalization of the mental representation, will show the fundamental understanding of theseconcepts. Once students

Conference Session

NSF Grantees Poster Session

Collection

2018 ASEE Annual Conference & Exposition

Authors

Micah Lande, Arizona State University

Tagged Topics

NSF Grantees Poster Session

classroom looks like, and how it changesover time, and how students conceptualize Making through Making, designerly, and engineeringways of knowing-doing-acting comes from collection and qualitative analysis of student projectdata collected during a product-based learning course engineering design course. We aim totriangulate what students think they are learning, what they are being taught, and what studentsare demonstrating. Students are recruited from the range of courses in our academic unit’sproject-based design spine from freshmen to senior years, supplemented by additional coursesacross our university. For this instance of reporting on this research project, we focus on twomethods used thus far:Content Analysis: Student Concept Maps of the

Conference Session

NSF Grantees’ Poster Session

Collection

2014 ASEE Annual Conference & Exposition

Authors

Kathleen L. Kitto, Western Washington University; Debra Sue Jusak, Western Washington University

Tagged Topics

NSF Grantees Poster Session

Tagged Divisions

Division Experimentation & Lab-Oriented Studies

course completion rates in introductory MSE coursesare affected by a variety of programs and activities that are based upon best practices fromSTEM education research. A number of interventions and active techniques were used inthe classroom, at first, singularly and, as the project progressed, in various combinations.Additionally, a wide variety of faculty and student resources were created as part of thisproject. For example, test device MSE iPod applications were developed for iCollaborate:Concept Questions, Vocabulary, Basic Knowledge, Tune-Up, Material Properties,Composite Calculator, MSE Convert, and MSE Knowledge Tools and Review.Furthermore, a concept map based web site, which includes web applications of key iPodapplications is

Conference Session

NSF Grantees Poster Session

Collection

2018 ASEE Annual Conference & Exposition

Authors

Angela Minichiello P.E., Utah State University; Matthew Paul Jouffray

Tagged Topics

NSF Grantees Poster Session

sticky note data individually, we recreated the clusters we had previouslymade with sticky notes within the software. Once our data was input into the software, Cmapallowed us to graphically sort and categorize our data, display it in hierarchical form, and keep iteasily accessible yet safely stored within our university’s secure data repository. Last, once alldata was transcribed and the categories were complete within the software, we sequentiallylabeled each subcategories within each concept map so that we could “code” important elementsof the written narratives in order to trace them back to their original data source (e.g., the codeN-E 3.1 stands for Needs category, subcategory E, sub-subcategory 3, data excerpt 1).Once the data was

Conference Session

NSF Grantees Poster Session

Collection

2017 ASEE Annual Conference & Exposition

Authors

Dennis M Lee, Clemson University; Shannon K Stefl, Clemson University; Sandra Linder, Clemson University; Cindy M. Lee, Clemson University; Faiza M. Jamil, Clemson University; Karen A High, Clemson University

Tagged Topics

Diversity, NSF Grantees Poster Session

-identifying as lesbian, gay, bisexual, transgender or queer (LGBTQ+), veterans, low income/firstgeneration, or having disabilities in engineering. The authors of this paper used their participation in theWho’s Not At The Table? conference to shape the organization of the workshop outlined here; one teammember and author of this paper, Stefl, organized the Who’s Not At The Table conference and two otherteam members and authors, D. Lee and High, participated in the event. Additionally, High worked withStefl and Martin, to develop the strategy for the second day of the conference where research ideas (onsticky notes) were used to create concept maps that informed the research agenda.As organizers of the How Many Hats Do You Wear workshop, we were able

Conference Session

NSF Grantees Poster Session I

Collection

2016 ASEE Annual Conference & Exposition

Authors

Robert L. Nagel, James Madison University; Elise Barrella P.E., James Madison University; Eric C Pappas, James Madison University; Jesse Pappas, James Madison University

Tagged Topics

NSF Grantees Poster Session

often in conflict with their demonstrated behaviors. For example, cognitive dissonance may be recognized by an individual if he or she rates strongly in agreement that “an ideal professional engineer would be ethical in all business dealings,” yet that same individual rates highly in agreement that “when making contractual decisions, I always allow bribes to sway my decision making.” • Intentional Self-Development: The process by which individuals work toward aligning their ideal behaviors or values with their actual behaviors. Intentional self-development may refer to either fast or slow change processes. • Concept Maps: Concept maps (or cmaps) are graphical tools for organizing and presenting

Conference Session

NSF Grantees' Poster Session

Collection

2013 ASEE Annual Conference & Exposition

Authors

Kathleen L Kitto, Western Washington University; Debra S. Jusak, Western Washington University

Tagged Topics

NSF Grantees Poster Session

Learning Styles (ILS) data, a switch to inductiveteaching practices which include collaborative, active learning modules and concept/peerlearning opportunities, collaborative writing of research papers, low stakes quizzing, thedevelopment of targeted iPod applications that promote enhanced student understandingof known conceptual difficulties, MSE vocabulary terms, visual and conceptuallycontained presentations of material properties, material calculators and conversion tools,and the development of a web site based upon concept maps. The project includesformative and summative assessment elements.This paper focuses on previously unreported components of the iCollaborate project thatwere researched, analyzed or developed during the 2011-2012

Conference Session

NSF Grantees: Student Development

Collection

2020 ASEE Virtual Annual Conference Content Access

Authors

Carmen M. Lilley, University of Illinois at Chicago

Tagged Topics

Diversity, NSF Grantees Poster Session

comparative method was used to develop a codebook during the focused coding phase[10]. From the focused coding, constructs, i.e. categories, of the social identities of the students aswell as their factors that influenced their personal experiences where defined. Analytical memoswere also being concurrently maintained during the coding processes. Axial coding was done afterthe initially focused coding was completed for all of the themes discussed in the interviews. Fromthis analytical approach, a concept map of the factors that act as stressors in organizationalleadership experiences for undergraduate engineering students are proposed and the interactionsamong social identities and other factors are discussed.Results and Discussion The categories

Conference Session

NSF Grantees Poster Session

Collection

2021 ASEE Virtual Annual Conference Content Access

Authors

Scott Duplicate Streiner, Rowan University; Daniel D. Burkey, University of Connecticut; Michael F. Young, University of Connecticut; Richard Tyler Cimino, New Jersey Institute of Technology; Jennifer Pascal, University of Connecticut

Tagged Topics

NSF Grantees Poster Session

toquantitatively measure their ethical reasoning, both generally and within an engineering context.For general moral and ethical reasoning, students took the Defining Issues Test (DIT-2) [9]. Forengineering-specific ethical reasoning, students took the Engineering Ethics Research Instrument(EERI), designed by researchers at Purdue University. [10]In the Fall 2020 semester, students at participating institutions participated in the development ofan ethical reasoning concept map exercise, where they used the CMap software to design a conceptmap focused on their understanding of factors that contribute to ethical decision making. An expertconcept map was created via the research team via the Delphi Method [11]. A research paper onthe preliminary analysis of

Conference Session

NSF Grantees: Student Development

Collection

2020 ASEE Virtual Annual Conference Content Access

Authors

Micah Lande, South Dakota School of Mines and Technology

Tagged Topics

Diversity, NSF Grantees Poster Session

-inspired design process and design tools to identify engineeringneeds, produce a documented design solution, demonstrate ability to collect, analyze andinterpret data, through a project-based learning course structure. The researchers adopted thevisual analysis methods in semiotics and iconography to classify students’ engineering designprocess map visually, aiming to quantify the qualitative data (Leeuwen & Jewitt 2001). Throughmethods to analyze concept maps as tools for scientific learning, the researchers identified topicsas “nodes,” with directionality connecting through “links” and patterns more generallyconnecting within. The former might be readily identified as design process steps, the latter asindications for iteration. The

Conference Session

NSF Grantees’ Poster Session

Collection

2014 ASEE Annual Conference & Exposition

Authors

Kenneth Reid, Ohio Northern University; David Reeping, Ohio Northern University

Tagged Topics

NSF Grantees Poster Session

Tagged Divisions

Division Experimentation & Lab-Oriented Studies

syllabi that met the criteria. Each team member was assigned to review 14(half of the syllabi), thereby reviewing each syllabus twice. Team members listed each outcomefrom all of the syllabi and developed a mind-map (or concept map) by grouping similar outcomesusing post-it notes on a whiteboard. In the event of similar outcomes (for example, Programmingin C++ and Computer Programming), group consensus was reached to determine whether theoutcomes were identical. If judged to be identical, or for cases of absolutely identical outcomes, acount was maintained.The intent of this initial search was to develop a framework to guide formation of initial questionsfor and analysis of results for the upcoming Delphi study. The final scheme evolved from