Conference Session

Graduate Education Model, Industry and Practitioner Experience - Graduate Studies Division Technical Session 1

Collection

2017 ASEE Annual Conference & Exposition

Authors

Jaclyn K. Murray, University of Michigan; Shanna R. Daly, University of Michigan; Erika Mosyjowski, University of Michigan; Diane L. Peters, Kettering University

Tagged Topics

Diversity

Tagged Divisions

Graduate Studies

determine solutions based on what others haddone. Therefore, her creative work tends to lie in the Assimilator28 zone of the problem solvingcognitive style continuum. Michele relied on learning domain-relevant knowledge to guide hertoward a solution based on previous research in the area.ZachSituating the CaseZach graduated with a bachelor of science in mechanical engineering and began working as adesign engineer at a medical device company. In the following five years, he would designambulance medical equipment, join the new product development team, and become a seniordesign engineer. He spent half his time in front of a computer working with CAD and managingprototyping issues. The other half of his time was shared between testing and

Conference Session

ABET and Curriculum-Level Assessments

Collection

2011 ASEE Annual Conference & Exposition

Authors

Kevin D. Dahm, Rowan University

Tagged Divisions

Chemical Engineering

more subtle point raised by Shryock and Reed’s description is the strategy of “surveyevery class imaginable.” Dr. Gloria Rogers, ABET’s Managing Director of ProfessionalServices, calls attention to the fact that collecting large amounts of data from “every classimaginable” is not merely inefficient, but likely misleading and counter-productive.Program objectives are summative in nature; they concern not the capabilities of studentsin specific courses, but the capabilities of graduates. Thus, Dr. Rogers writes, “Why dowe collect data in lower level courses and average them with the data taken in upper levelcourses and pretend like we know what they mean? Are we really saying that all coursesare equal in how they contribute to cumulative

Conference Session

Graduate Student Support

Collection

2019 ASEE Annual Conference & Exposition

Authors

Hoda Ehsan, Purdue University-Main Campus, West Lafayette (College of Engineering); Matilde Luz Sanchez-Pena, Purdue University-Main Campus, West Lafayette (College of Engineering); Hossein EbrahimNejad, Purdue University-Main Campus, West Lafayette (College of Engineering); Hassan Ali Al Yagoub, Purdue University-Main Campus, West Lafayette (College of Engineering)

Tagged Topics

Diversity

Tagged Divisions

Graduate Studies

Paper ID #27188Capturing the Experiences of ESL Graduate Students in Engineering Educa-tionMs. Hoda Ehsan, Purdue University-Main Campus, West Lafayette (College of Engineering) Hoda is a Ph.D. student in the School of Engineering Education, Purdue. She received her B.S. in me- chanical engineering in Iran, and obtained her M.S. in Childhood Education and New York teaching certification from City College of New York (CUNY-CCNY). She is now a graduate research assistant on STEM+C project. Her research interests include designing informal setting for engineering learning, and promoting engineering thinking in differently

Conference Session

NSF Grantees Poster Session I

Collection

2016 ASEE Annual Conference & Exposition

Authors

Mary E. Besterfield-Sacre, University of Pittsburgh; Larry J. Shuman, University of Pittsburgh; Cheryl Matherly; Gisele Ragusa, University of Southern California; Lisa Benson, Clemson University

Tagged Topics

Diversity, NSF Grantees Poster Session

concern for people in all parts of the world, with a view of moral responsibility toimprove life conditions through engineering problem solving and to take such actions in diverseengineering settings. The second subscale is Global Engineering Efficacy. This refers to thebelief that one can make a difference through engineering problem solving and is in support ofone’s perceived ability to engage in personal involvement in local, national, internationalengineering issues and activities towards achieving greater global good using engineeringmethodologies and approach. Engineering Global-centrism is the third subscale. This refers to aperson’s value of what is good for the global community in engineering related efforts, and notjust one’s own

Conference Session

ERM: Conceptualizations of Engineering and Engineering Education

Collection

2022 ASEE Annual Conference & Exposition

Authors

Theresa Green, Utah State University; Angela Minichiello, Utah State University; Amy Wilson-Lopez, Utah State University - Engineering Education

previous publications by theauthors (e.g., [10]–[12]).This methods paper adds to the literature on emerging approaches to investigating engineeringworkplace practice [13] by providing new insights gained about the challenges and perceivedbenefits of using elements of the agile ethnographic approach. The challenges that weexperienced in doing this work included issues of organizational access to the engineeringcompanies; negotiating the time and location of data collection with each of the engineers;managing logistics when on-site; and maintaining the accessibility of the data review process forthe engineers. The benefits we perceived from conducting this work included the generation of arich, detailed dataset; the knowledge gained about the

Conference Session

Curricular Developments in Energy Education I

Collection

2011 ASEE Annual Conference & Exposition

Authors

Andrew L. Gerhart, Lawrence Technological University; Robert W. Fletcher, Lawrence Technological University

Tagged Divisions

Energy Conversion and Conservation

thecertificate, requirements for student admission, and details of the course content and projectwork. Examples of the experiential component required to earn the CEEM will be included. Inaddition, the success of the program will be explained via the employment record of studentsupon graduation from the CEEM program.1. IntroductionIf you were to ask a group of grade school children what are the major problems facing the Earthand its people, you will likely hear two top answers: energy resources and pollution (orenvironmental issues stemming from energy use). Worldwide concern continues to grow for ourdepleting supply of fossil fuels, the related increasing cost of fuels, and the reduction ofemissions (particularly greenhouse gases and carbon footprint

Conference Session

Ethics in different disciplines

Collection

2011 ASEE Annual Conference & Exposition

Authors

Marilyn A. Dyrud, Oregon Institute of Technology

Tagged Divisions

Engineering Ethics

methodology for fostering anawareness of ethical issues. This serves the pragmatic goal of meeting the ABET criterionregarding a knowledge of professional and ethical behavior. Hopefully, however, examiningthese cases will also impress upon students the need to be ever vigilant when working on projectsthat can adversely affect human lives or the environment. As the saying goes, “small mistakescan have huge consequences.”33References1. Lynch, W illiam T., and Ronald Kline. 2000. “Engineering Practice and Engineering Ethics.” Science, Technology, & Human Values 25 (2): 195-225.2. Davis, Michael. 1999. Ethics and the University. New York: Routledge.3. Jonassen, David H. 2011. Learning to Solve Problems: A Handbook for Designing Problem

Conference Session

Teaching Design Through Projects

Collection

2003 Annual Conference

Authors

George Wise; Philip Kosky; Robert Balmer

final solution (e.g., Pert charts). The fifth week is devoted to engineering ethicswherein real engineering case studies involving ethical issues are discussed. The students are thenassigned to permanent 3-person teams. During the remaining five weeks of the term, they use thematerial presented during the first half of the course to solve the problem of designing, building,and testing a mechatronics device that will win a competitive game (this is the “problem”). Theconditions and rules are clearly posed by the course instructors and are the same for all sections.A Q&A web site allows the students to ask questions about the contest and the questions andanswers are then shared with all the students (one faculty member is assigned the task of

Collection

ASEE Mid-Atlantic Section Spring Conference

Authors

Charlotte Gottilla, University of Delaware

Tagged Topics

Diversity

-relatedsupport and answer questions related to the project or EWB-UD at large, helping newcomersbecome confident in their roles and comfortable in the organization [5].ContinuityAn unavoidable issue in any university organization is that students graduate after four years,causing frequent leadership turnover and introducing continuity issues [7]. Frequent turnovermakes the effective handover of knowledge and authority critical to the ongoing success ofEWB-UD. When choosing new PMs, consideration is given to the graduation years of applicantsand current students in order to allow a sufficient onboarding period; generally, it is ideal for anew PM to have one year of experience, including travel to Malawi, before assuming fullresponsibility. Succession

Conference Session

First-Year Programs Division Technical Session 10: Best of First-Year Programs Division

Collection

2022 ASEE Annual Conference & Exposition

Authors

Connor Jenkins, The Ohio State University; Krista Kecskemety, The Ohio State University

engineering education research focuses on feedback and first-year experience.Krista M Kecskemety (Assistant Professor of Practice) Krista Kecskemety is an Associate Professor of Practice in the Department of Engineering Education at The Ohio State University and the Director of the Fundamentals of Engineering for Honors Program. Krista received her B.S. in Aerospace Engineering at The Ohio State University in 2006 and received her M.S. from Ohio State in 2007. In 2012, Krista completed her Ph.D. in Aerospace Engineering at Ohio State. Her engineering education research interests include investigating first-year engineering student experiences, faculty experiences, and the research to practice cycle within first-year

Conference Session

Recruiting, Retention & Advising

Collection

2004 Annual Conference

Authors

Kay C. Dee; Glen Livesay

study weresmall due to the size of the school, the results are important to educators interested in retainingfirst-year students – including, to the best of our knowledge, the first published link betweenILS-identified global learners and attrition from engineering.Introduction Student attrition is a concern of many engineering programs, with first-year students aspecial concern. First-year engineering students, while adjusting to college life, often complete acurriculum which includes minimal contact with engineering faculty and little exposure to thetypes of problem-solving used in engineering fields. For this reason, many engineering

Conference Session

NSF Grantees’ Poster Session

Collection

2015 ASEE Annual Conference & Exposition

Authors

Michael Alley, Pennsylvania State University, University Park; Christine Haas, Engineering Ambassadors Network; Joanna K. Garner, Old Dominion University; Karen A. Thole, Pennsylvania State University, University Park

Tagged Topics

NSF Grantees Poster Session

the director of marketing for Drexel’s College of Engineering and director of operations for Worcester Polytechnic Institute - Engineering. Now, as CEO of Christine Haas Consulting, LLC, Christine travels around the world teaching courses to scientists and engineers on presentations and technical writing. She has taught clients across gov- ernment, industry and higher education, including Texas Instruments, Brookhaven National Laboratory, European Southern Observatory (Chile), Simula Research Laboratory (Norway) and the University of Illinois-Urbana Champaign. Christine works closely with Penn State University faculty Michael Alley (The Craft of Scientific Presentations and The Craft of Scientific Writing) and

Conference Session

Student Learning and Research

Collection

2005 Annual Conference

Authors

Macy Reynolds

color your row something other than white. ___ Copy this grade sheet to an empty sheet and determine your grade if you have perfect scores through the end of the semester. Determine your new final percent. ___ Insert the spreadsheet into a memo to your faculty advisor that tells how you are doing in the course. ___ Size the spreadsheet to fit on the memo. Fig. 2. Example of an assignment with checkboxes.4. Allow students to work in groups for some assignments so that more verbal students can talk about the work as well as complete the assignment. Talking about the assignment will help establish vocabulary, pattern a method to do the work, and focus on more than one modality. For instructors

Conference Session

Problem- Project- and Case-Based Learning in Environmental Engineering

Collection

2014 ASEE Annual Conference & Exposition

Authors

Andrew Jason Hill, University of Southern Indiana; Zane W. Mitchell Jr., University of Southern Indiana

Tagged Divisions

Environmental Engineering

, S.P. Magleby, and C.D. Sorensen. (1997). “A review of literature on teaching engineering design through project oriented capstone courses”, Journal of Engineering Education, 86(1):17- 28. 5. Macias-Guarasa, J., R. San-Segundo, J.M. Montero, J. Ferreiros, and R. Cordoba. (2005). “Tools and Strategies for Improving PBL Laboratory Courses with High Student-to-Faculty Ratio”, Frontiers in Education Conference Proceedings, 2:F2C-7. 6. Johnson, P.A. (1999). “Problem-Based, Cooperative Learning in the Engineering Classroom”, Journal of Professional Issues in Engineering Education and Practice, V125(1):8-11. 7. Kelly, O.C., O.E. Finlayson. (2007). “Providing solutions through problem-based

Conference Session

Pedagogical Approaches for Software Engineering

Collection

2012 ASEE Annual Conference & Exposition

Authors

Kevin A. Gary, Arizona State University, Polytechnic; Yegeneswari Nagappan, Unicon, Inc.; Supreet Verma, Delasoft, Inc.; Russell J. Branaghan, Arizona State University

Tagged Divisions

Software Engineering Constituent Committee

map generated by a senior student at the beginning of asoftware project management class. The student was given a set of concepts and asked to arrangethem in a graph and label relationships. Relationship labels were not pre-specified, and capitalletters are used to indicate a stronger relationship than lowercase letters. New nodes could beintroduced if the student feels it enhances the representation. This network, despite havingdisconnected components is actually fairly strong structurally. It introduces new central nodes(Development Process and Process Components) that were not part of the scaffolding. However,an experienced software engineer may have some issues with some of the structures based on therelationships themselves. For example

Collection

1999 Annual Conference

Authors

Nanette Veilleux

arithmetic concepts, such as addition and Boolean logic. These questions test arithmeticunderstanding at a level that would correspond to Bloom’s analysis or perhaps synthesis level.However, as far as new concepts are concerned, tracing a simple program requires nothing morethan recalling how basic arithmetic is coded in a computer language.There are many debatable middle ground questions. For example, if the modular operator hasbeen covered sufficiently enough to have been memorized by the students, a slightly moredifficult question may be required to test whether the students understand its application. Onecan also explore the gray areas between comprehension and application level understanding,which often involve how much a student is patterning

Conference Session

Inclusive and Reflective Practices in Pre-College Engineering Education

Collection

2025 ASEE Annual Conference & Exposition

Authors

Sopheak Seng, Purdue University at West Lafayette (COE); William Samuel Walker

Tagged Divisions

Pre-College Engineering Education Division (PCEE)

refined over the years [11], [16], [17]. Jansson andSmith [10] investigated how examples of solutions to an engineering challenge influenced theway professional engineers generated possible solutions. They compared engineers who weregiven examples to control groups and found that the engineers generated solutions by copyingmore features from the examples compared to the control groups. Jansson and Smith [10]identified this phenomenon as design fixation. Design fixation hinders the ability to generatenovel ideas during the design process when engineers cannot ascribe new functions to familiaritems. Purcell and Gero [16] found that engineers can experience design fixation when theybecome overly focus on creating “different” or “creative” solutions

Conference Session

Best of DEED

Collection

2014 ASEE Annual Conference & Exposition

Authors

Eli M. Silk, University of Michigan; Shanna R. Daly, University of Michigan; Kathryn Jablokow, Pennsylvania State University; Seda Yilmaz, Iowa State University; Meisha Nicole Berg, Iowa State University

Tagged Divisions

Design in Engineering Education

. Jablokow’s teaching and research interests include problem solving, invention, and creativity in science and engineer- ing, as well as robotics and computational dynamics. In addition to her membership in ASEE, she is a Senior Member of IEEE and a Fellow of ASME. Dr. Jablokow is the architect of a unique 4-course mod- ule focused on creativity and problem solving leadership and is currently developing a new methodology for cognition-based design. She is one of three instructors for Penn State’s Massive Open Online Course (MOOC) on Creativity, Innovation, and Change, and she is the founding director of the Problem Solving Research Group, whose 50+ collaborating members include faculty and students from several universities

Conference Session

Student Division (STDT) Technical Session 1: Student Success and Mentoring

Collection

2023 ASEE Annual Conference & Exposition

Authors

Alexander V Struck Jannini, Purdue University Library TSS

Tagged Topics

Diversity

Tagged Divisions

Student Division (STDT)

Paper ID #37185Reflections on Mentorship – Being the Change You Want to See inEngineering EducationAlexander Vincent Struck Jannini, Purdue University Library TSS ©American Society for Engineering Education, 2023 Reflections on Mentorship – Being the Change You Want to See in Engineering EducationAbstractThe educational pathway of engineering is often fraught with obstacles and challenges. Whilestudents that participate in research labs get through with less difficulty, there can be instanceswhere students enter with both academic and personal issues. In this paper, I will specificallyhighlight one of my

Conference Session

Capstone Design I

Collection

2012 ASEE Annual Conference & Exposition

Authors

Gene Dixon, East Carolina University

Tagged Divisions

Design in Engineering Education

contact.Projects are vetted for selection5. Students are assigned project teams and their first assignmentis to begin crafting a problem statement for their project. Lectures are held once per week andthe problem statement development process10 is discussed for one full class period and referredto frequently throughout the two semester capstone design course sequence. Faculty conductedassessments have consistently indicated a weakness in the quality of student developed problemstatements. Issues of embedded solutions, poorly developed constraints and objectives that arenot quantifiable lead to weak measures, or indicators that design has met customer requirements.The assessments have indicated a need for more focus on project statement

Conference Session

Restructuring/Rethinking STEM

Collection

2013 ASEE Annual Conference & Exposition

Authors

Joe Tranquillo, Bucknell University

Tagged Divisions

Liberal Education/Engineering & Society

Paper ID #7610The T-shaped Engineer: Connecting the STEM to the TOPProf. Joe Tranquillo, Bucknell University Joe Tranquillo was the second faculty member in the new Biomedical Engineering Program at Bucknell University and helped build an accredited department with seven faculty and 60 undergraduate students. His teaching interests are in biomedical signals and systems, neural and cardiac electrophysiology, and medical device design. Nationally Tranquillo has published or presented over 50 peer reviewed or invited works in the field of engineering education. In 2012 he was a founding faculty member of the KEEN Winter

Conference Session

COED: Cybersecurity Education

Collection

2023 ASEE Annual Conference & Exposition

Authors

Fitratullah Khan, The University of Texas, Rio Grande Valley; Ala Qubbaj, The University of Texas, Rio Grande Valley; Laura Saenz; Liyu Zhang, The University of Texas, Rio Grande Valley

Tagged Divisions

Computers in Education Division (COED)

across the curriculum in new and existing courses. Most of thedeficiencies were identified in the areas of mathematical reasoning, enterprise network defense,computer network defense, information assurance, forensics, architecture, criminal law, andcryptography [5]. Even though SB2134 did not pass, UTRGV proceeded to align its BSCScurriculum with NICE-WFC to add value to its degree and to be ready for an SB2134 type oflegislation taking effect in future. Figure 1 shows the general flow of alignment from identifyingof areas of deficiencies to embedding the knowledge units in different courses. Fig. 1 Addressing Deficiencies in BS Cyber Security CurriculumB. Addressing Accreditation Concerns of BSCS The institution aspires

Conference Session

Emerging Technologies / Pedagogies

Collection

2008 Annual Conference & Exposition

Authors

Eugene Rutz, University of Cincinnati; Chris Collins, University of Cincinnati; Mani Mina, Iowa State University

Tagged Divisions

Continuing Professional Development

AC 2008-926: A GUIDED TOUR OF THE FUTURE OF EDUCATIONEugene Rutz, University of Cincinnati Eugene is an Academic Director in the College of Engineering at the University of Cincinnati. He manages the College's accelerated engineering degree programs as well as a pre-engineering program with local high schools. Eugene also helps faculty in the use of instructional technology. He is a self-described "hopeful skeptic" concerning learning in virtual worlds.Chris Collins, University of Cincinnati Chris Collins is an IT Analyst in the UCit Instructional & Research Computing department at the University of Cincinnati. Chris specializes in developing supportable, sustainable enterprise

Conference Session

Design in Engineering Education Potpourri

Collection

2009 Annual Conference & Exposition

Authors

Christine B. Masters, Pennsylvania State University; Samuel T Hunter, Pennsylvania State University; Gul Kremer, Pennsylvania State University

Tagged Divisions

Design in Engineering Education

(ideation). Designprocess knowledge, in general, is taught in first year design courses, and then practiced duringcapstone design. During second and third year courses, the engineering curriculum focuses onanalytical concepts and techniques ultimately intended to support design analysis ability.However, students frequently have difficulty in integrating their design process knowledge andanalysis abilities during capstone design projects.Most four year engineering programs include a first year course focused on the engineeringdesign process where students are exposed to the wide range of issues that must be consideredwith regard to the ‘real life’ activity of designing a product or a process. These courses typicallyculminate in a team report

Conference Session

Projects and Problems in First-Year Courses

Collection

2009 Annual Conference & Exposition

Authors

Senay Purzer, Purdue University

Tagged Divisions

First-Year Programs

cognitiveprocesses and hurt student learning. As an implication of this study, a list of recommendations ismade and an instrument is developed to help scaffold student team processes.Introduction & Literature ReviewToday, more than half of the engineering faculty require their students to participate in groupprojects (National Science Board, 2008) making pedagogies of engagement such as project-based, problem-based, and team-based learning common practices in engineering classrooms(Smith, Sheppard, Johnson, & Johnson, 2005). When students work in teams they developdiverse knowledge and skills such as the ability to function in teams, learning how to design inteams, and learning new technical content. Consequently, the study of teamwork in the

Collection

1997 Annual Conference

Authors

P.J. Fisher; N.J. Quick; S.J. Steiner

Engineering at the University ofBirmingham is a large engineering school which operates six undergraduate degreeprogrammes and seven postgraduate taught courses. The innovation described in thispaper concerns only the three undergraduate programmes operated by the ManufacturingDivision of the School. These are a BEng and BCom 4-year double honours programmein Manufacturing Engineering and Commerce, a 4-year BEng & Com joint honoursprogramme in Manufacturing Engineering and Business Studies and a single honoursManufacturing Engineering programme, which leads to a BEng in 3 years or an MEng in4 years. The double honours and joint honours programmes are run in conjunction withthe Commerce Faculty, which makes a considerable input to the teaching and

Conference Session

NSF Grantees Poster Session

Collection

2024 ASEE Annual Conference & Exposition

Authors

Deana Lucas, Purdue University, West Lafayette ; Rebecca Martinez, Purdue Polytechnic Graduate Programs

Tagged Topics

NSF Grantees Poster Session

discussions and for Rebecca to apply heranthropological perspective to address societal issues, aligning with our respective passions andskills. 2. Strengths of our RolesAs graduate students, we find ourselves a part of a more significant project. We are working on across-disciplinary research team that involves many stakeholders and five faculty members whoguide the project. We work alongside these people in various meetings and throughout our days,whether in official meeting time or casual conversations. Below, we depict our roles and thestrengths we bring to a cross-disciplinary research team as graduate students.2.1 Our Backgrounds Within any collaborative research endeavor, the amalgamation of diverse perspectivesand skill sets enriches

Conference Session

ConstDiv Technical Session 3 - Social & Leadership

Collection

2019 ASEE Annual Conference & Exposition

Authors

Andrea Nana Ofori-Boadu, North Carolina A&T State University; Victor Ofori-Boadu, Penuel Consult Inc.; Iyshea Borders-Taylor; Lewis Waller; Paul Akangah, North Carolina A&T State University

Tagged Topics

Diversity

Tagged Divisions

Construction Engineering

-Organizational Psychology Dissertation, Seattle Pacific University, Seattle, Washington, USA, 2015.[13] P. J. Burke, and J. E. Stets, Identity theory. New York, New York: Oxford University Press, Inc., 2009.[14] J. P. Gee, “Identity as an analytic lens for research in education.,” in Review of research in education, vol.25, W. G. Secada, Ed. Washington, D.C: American Educational Research Association , 2000, pp. 99 – 125. [Online]. Available http://www.jstor.org/stable/10.2307/1167322 12[15] D. T. Hall, “Careers and socialization,” Journal of Management, vol 13, issue 2, pp. 301 – 322., 1987.[16] A. Reid, M. Abrandt Dahlgren, P. Petocz, and L. O. Dahlgren, From expert student to novice professional. Springer: Dordrecht, The Netherlands, 2011

Conference Session

The Philosophy of Engineering and Technological Literacy

Collection

2017 ASEE Annual Conference & Exposition

Authors

Gary P. Halada, Stony Brook University; Peter H. Khost, Stony Brook University

Tagged Divisions

Technological and Engineering Literacy/Philosophy of Engineering

of designersFailure of Failure of Societal, economic, cultural The ASCE report on thethe floodwalls and and political issues which failure of the hurricanehurricane generators to caused a failure to upgrade protection system (availableprotection power water the protection system and online); news reports andsystem in pumps have a proper response video documentation of theNew during and after the disaster disaster and its impactsOrleansfollowingKatrinaTable 2: Examples of disasters studied in class and expansion of the narrativeNote that it is especially valuable to provide insight from individuals

Conference Session

Design in the ECE Curriculum

Collection

2008 Annual Conference & Exposition

Authors

James Friauf, Milwaukee School of Engineering; Stephen Williams, Milwaukee School of Engineering; Steven Reyer, Milwaukee School of Engineering; Owe Petersen, Milwaukee School of Engineering

Tagged Divisions

Electrical and Computer

processdevelops, and that a narrow focus on course level activities results in missing the bigger pictureof what the characteristics are of the graduates. Are they as well prepared for the intended careerpaths, defined by the program objectives, as the program’s faculty believe they are prepared?The ABET assessment process is a top-down process whose central concern is the career pathsof the graduates of the program. Everything, such as both the program outcomes and thecurriculum details are for the purpose of supporting the career paths as defined by the programobjectives.A shift occurred in the process of how we address meeting the program outcomes. The shift wasto focus directly on meeting a rubric of achievement defined in terms of the program