findings that are scalable to the industry at large. He is a Leadership in Energy and Environmental Design (LEED) Accredited Professional (AP) in the Building Design and Construction (BD+C), Interior Design and Construction (ID+C) and Operations and Maintenance (O+M) specialties. Additionally, he holds an accreditation with the Construction Specifications Institute (CSI), as a Construction Documents Technologist (CDT). ©American Society for Engineering Education, 2024 Redefining Assessment: Implementing an XR Framework for Accreditation in Construction EducationAbstractMany higher education institutions use different teaching methods to provide constructioneducation
collaboration was first implemented in fall 2003 with 6 preservice teachers assessing thefirst-year Introduction to Engineering course. The goal of the program is to benefit bothengineering students through improvements of their classes and education students through ahands-on opportunity to learn about analytic assessment of students in science and math classes.In this paper, the structure of this collaboration is examined and lessons learned from the firstsemester of its implementation are discussed.MOTIVATIONMost engineering educators are not adequately trained to rigorously assess student learning.Most preservice teachers (a preservice teacher is a student learning how to be a K-12 teacher),meanwhile, do not have the opportunity to apply outside of
, and the scoresare illustrated in figure 4. The effect sizes were computed using the variance of scores for each year. Inthis case, a large positive effect size indicates that relative to the baseline year, the year being assessedhad a larger spread about its mean than the baseline year. This analysis gives insight into clarity of thequestions on the assessment, especially sorted by learning areas. If a particular concept was not wellunderstood by most students, class performance is inconsistent and the class score will have a largevariance. This indicates that the material was not relayed effectively in that year, whether through themodule or other supporting forms of instruction. It is interesting to note that in 2006 the individualstudent
thinkers, learn in large leaps). learn in small incremental steps)Traditional engineering instruction favors intuitive, verbal, deductive, reflective, and sequentiallearners, even though most engineering students tend to fall in the opposite categories. Toimprove overall student learning and meet industry expectations, it is important to developeducational materials that address the needs of students outside of the favored categories.Another key motivation is that companies are also focusing more on recruiting new graduateswho have the experience to make a quick contribution to corporate goals. Competency in a rangeof skills related to product development is expected from engineering and technology graduates.In 1997, the Society
student is expected to report a finalanswer with the propagated uncertainty. Problems are solved using hand calculations and thenwith the aid of a spreadsheet. Using software, students can access routines to evaluatethermodynamic properties which are tedious if done by hand. The approach is based on thetraditional differential method for uncertainty propagation, yet numerical differentiation in usedin the spreadsheet program. Examples show that when uncertainties are considered, there can berelatively large uncertainties in final results. By knowing a result’s uncertainty, students canreport final answers to an appropriate number of digits. A student survey was conducted togauge the effect of the exercises on student learning and attitudes
Session 2480 Transfer of Knowledge and Skills Assessments in Engineering and Technological Education Saleh M. Sbenaty Middle Tennessee State UniversityI. IntroductionIn today’s fast changing world, companies spend large amounts of money on staff training anddevelopment. To reduce costs and training time, employers are increasingly interested inimproving the way employees apply their acquired knowledge and skills to new settings orsituations. This is defined as the Transfer of Knowledge and Skills. The current paper describesan assessment method that
programming and understanding of the relevant concepts and theconnections among them, and finally enhancing their competence to address the final semesterproject. Additionally, formative assessments were conducted in quizzes and tests, where a latertest included a problem from a previous test, but in an expanded format, so as to assess theknowledge and competence acquired in the meantime.Table 2 – Typical timeline of assessment (A: Assigned, D: Due, F: Feedback) A D F A D F A D F Project Week Week Week Week Week Week Week Week Week 3 5 6 6 8 9 10 15 16
Paper ID #37701Measuring Systems Thinking Using Stealth AssessmentIng. Andrea Ramirez-Salgado, University of Florida Andrea is a doctoral student at the University of Florida specializing in Educational Technology within the Curriculum and Instruction program. She has a master’s degree in Education and ICT and a bachelor’s degree in Software Systems Engineering. Andrea has been teaching undergraduate and graduate courses for the past thirteen years covering topics such as algorithms, process engineering, instructional design, and applications of technology in education. Her research interests include understanding the
test phases. A. Previous Assessment SystemWhereas the students gain experience working on small Four years ago, the capstone course sequence included fourproject designs during their co-op semesters, the capstone main assessment activities: engineering notebooks, formalcourse contains a large scale project where the students are reports, design presentations, and professionalism. Thedivided into subgroups that work together to complete the engineering notebooks were reviewed and graded for eachentire project. The projects typically contain 10-20 students individual student once every week. Feedback was given tobroken into subgroups of 3-4 students. An example
1 Session 2023 An Assessment of the Attitude Toward Agile in Professional Organizations Derek T. Gwin and Ozgur Aktunc Department of Engineering St. Mary’s University AbstractThe term agile is widely used to describe an iterative and incremental approach to developingproducts, where small units of value are delivered frequently to customers and feedback ismonitored to shape future delivery cycles. Agile practices emerged in the late-twentieth century as
Paper ID #26578Assessing Methods for Developing an Engineering Identity in the ClassroomDr. Meagan R. Kendall, University of Texas, El Paso An Assistant Professor at The University of Texas at El Paso, Dr. Meagan R. Kendall is helping develop a new Engineering Leadership Program to enable students to bridge the gap between traditional engineer- ing education and what they will really experience in industry. With a background in both engineering education and design thinking, her research focuses on how Latina/Latino students develop an identity as an engineer, methods for enhancing student motivation, and methods for
all first-time graduate student instructors. Thistraining consists of two parts: a 7-hour orientation and an ongoing professional developmentduring the term. The orientation begins with a session on inclusive teaching to align with theCoE strategic plan to improve diversity, equity, and inclusion (DEI). It also contains a variety ofpedagogical workshops and an opportunity to practice delivering a lesson to a small group oftheir peers. The ongoing professional development allows students to choose from workshops,active-learning practice or a midterm student feedback consultation, along with reflectiveexercises. The structure of this training approach is in-between short programs (i.e., one-dayevents) and long programs (i.e., 20+ hours) carried
, departments can provide ample concrete evidence todocument student performance.Introduction: Capstone Design and AssessmentCommunication assignments in capstone design courses traditionally range from a singlecomprehensive final project report (often with extensive appendices) at one end of the spectrumto a series of small documents that include proposals, progress reports, and final reports at theother end. Even in courses that include the full spectrum of written and oral documents, however,assignment design and assessment may not take full advantage of the broad range of informationrepresented by those texts. By explicitly designing a portfolio of writing and speakingassignments to capture and assess student performance across the design process
, University of California, San Diego Van Den Einde is a Teaching Professor in Structural Engineering at UC San Diego. She incorporates education innovations into courses (Peer Instruction, Project-based learning), prepares next generation faculty, advises student organizations, hears cases of academic misconduct, is responsible for ABET, and is committed to fostering a supportive environment for diverse students. Her research focuses on engagement strategies for large classrooms and developing K-16 curriculum in earthquake engineering and spatial visualization. c American Society for Engineering Education, 2018 Sketching, Assessment, and Persistence in Spatial Visualization
maintaining its applicability for longitudinal assessment. The TEE did not changesignificantly in content or format over these years either. The biggest change during this timeperiod was the aggregation of course outcomes in 2015 to be less topical and more general innature. Figure 2, though, shows marked deviation between TEE averages and semester courseaverages (minus the TEE, 20% of the overall grade) after 2012. Figure 2 Comparison of Grade Averages Earned Throughout the Semester versus on the TEE in EV350, 2011-2017 The lower TEE averages after 2012 seen in Figure 2 were largely mathematically driven bysharp increases in the D and F letter grades earned. Our thoughts were that the change occurringin the year 2013 may be due to a shift in
toengage undergraduate students in research with a goal of enhancing the student learning experienceand contributing to further improving student learning outcomes, especially for electrical andcomputer engineering students. Under a small-scale umbrella program called High-AltitudeBallooning (HAB), these projects have been financially supported in part by external sponsors,mostly NASA or its Space Grant Consortia, and administered in the form of extracurricularactivities. Recent assessments about our program outcomes and student learning outcomes showedthat our program has been fairly successful in achieving its goals and objectives [1][2].Since fall 2015 and in the 2016-2017 academic year, we have been running two projectsconcurrently with the
a small number of tests) can be used by a variety ofinstitutions given that each institution has a different set of priorities and educational missions.However, before students’ self-assessments can be used as proxies for tests and other directassessments, it is important to establish their validity.Several large-scale studies in this area have concluded with mixed results. Ewell et al7, Pike 14and Tsang 17 provided some degree of empirical support for student self reports as valid proxiesfor tests. However, the work of Astin 2 and Dumont and Troelstrup 6 has reported lowcorrelations between self-reports and test scores. LeBold et al 11 utilized Purdue’s Mathematicsand Science Inventory to demonstrate the validity of student self
programming experience made it impossible for them tocontribute significantly during the latter stages of the assignments. On the other hand, the over-whelming consensus, even among the ME students, was that the early assignments containednegligible ME components, resulting in the ME students feeling rather useless for most of thecourse. Most students from each discipline advocated a more equitable distribution of the as-signment workload across the three disciplines.Term QuizzesTerm quizzes were administered in each of the four disciplines involved in the robotics course,and each discipline’s quiz contained some questions that were designed to help assess the suc-cess of cross-functional instruction in the course. Each discipline’s instructor
,therefore, a mixture of traditional and non-traditional assessment tools should be used toeffectively evaluate student progress toward educational learning outcomes. The implementationof the course also presents challenges. There are at least three, and often four, instructorsinvolved in the course at any time and often different instructors are assigned to the course eachterm. Because a large and diverse number of instructors are involved in the process, theassessment plan must be one that is easy to follow, easy to apply, applied uniformly, and appliedefficiently. When developing the assessment plan addressed in the next section, all instructors wereinvolved in the process from the beginning. It was necessary to develop a commonunderstanding of
major challenge for faculty is how to develop a “culture of evidence” in the classroom thatsupports student-centered formative learning and aligns with program and accreditation goals.Another challenge is the development of assessment tools that lighten, rather than add to, facultyworkload. In this paper, we analyze a systems approach for gathering evidence centered on thedevelopment of group artifacts. Specifically, online project management (PM) and knowledgemanagement (KM) resources are purposefully developed by students at the intersection ofworking, learning, and assessment. The KM and PM archives are assessed using a multi-methodapproach, with three goals in mind: 1) ease of implementation, 2) real-time documentation ofimprovements, and 3
sounds weird, having more homework forces the student to learn some of the concepts firsthand.”ReflectionAfter reviewing the information provided above, students who participated in PHY 350 foundthe course to be interesting although difficult. Based on students’ responses to course evaluationsand their comments, it is crucial that another element of assessment is incorporated to assiststudents with learning the more difficult material. The additional assessment may come in theform of small homework assignments or short reflections following each lecture. Regardless, thiscourse in biophysics allowed students to make the necessary connections among their undergradcurricula through the implementation of a semester-long project accompanied
programs provides intellectual challenges, problem solving opportunities, and avenuesto showcase innate creativity of the students in a setting that addresses broader dimensions oflearning and discovery [6-8]. Recent emphasis on sensitizing students to realities of globalizationhas resulted in a significant increase in international exchange programs [9]. Evaluation and Page 15.245.3outcome assessment of these programs indicate that project and research experiences in anunfamiliar setting not only advance academic outcomes but afford lasting influences thatcontribute to the attainment of significant life-skills outcomes [10]. Some of the same
with a copy of Bloom’s taxonomy.Moreover, considering the fact that the most meaningful assessment is provided when the sameobjective is compared among two different groups14, that is for our purpose two differentteaching styles, the same pre and post quizzes were utilized by a control group, a class of 48students who just had lecture, and an experimental group, a class of 32 students who received amini-orientation lecture and participated in a small three-person interactive hands-on learningsession.3. Results 3.1. Identifying Misconceptions – Bernoulli’s PrincipleA summary of the misconceptions identified by experienced professors on our panel is providedin Table 1. As shown in Table 1 and shown previously15, one of the common
prototypes and near-daily team interactions [9]. This gives us muchgreater visibility into how teams operate during the project, not only at the very end. Scrumapproach to project management is gaining popularity in engineering programs outside ofsoftware engineering and a recent paper even provides guidance on its implementation [7] andwe have offered a workshop on this topic [13].2.1 Development and improvementsFrom the very beginning these courses were meant to provide a wealth of data not only forimproving the courses themselves but also to provide program level data. Given that the coursesare nominally sophomore level, assessment data is largely going to be developmental, unlike thedata from capstone courses that are summative in nature and
AC 2009-191: BEYOND ANECDOTES: HOW TO ASSESS WHAT GOES ON INYOUR CLASSESKathy Schmidt, University of Texas, Austin KATHY J. SCHMIDT is the Director of the Faculty Innovation Center for the Cockrell School of Engineering at The University of Texas at Austin. The FIC’s mission is to provide faculty with effective instructional tools and strategies. In this position, she promotes the School's commitment to finding ways to enrich teaching and learning. She works in all aspects of education including design and development, faculty training, learner support, and evaluation.Mia Markey, University of Texas, Austin MIA K. MARKEY is an Associate Professor in The University of Texas Department of
wasutilized to understand the perspectives of engineering students toward the acquisition of gradesand views of learning. The context of the study effectuated in a small, private (four-year) institutionin Texas. The sample selection consisted of 45 undergraduate students enrolled in an introductorymechanical engineering course, which were classified from freshman to sophomores. The primarymethod of data collection was a self-developed survey instrument that was administered to thecohort of students.A preliminary study was conducted to better understand student perspective on learning,memorization, and grades. For the authors, this preceding study was critical in conceptualizing thealternative assessment scheme which aims to reduce grade anxiety and
experiences for scientists and engineers. c American Society for Engineering Education, 2020Evaluating Peer Coaching in an EngineeringCommunication Lab: A Quantitative Assessment ofStudents’ Revision ProcessesAbstract Communication is a crucial skillset for engineers, yet graduates [1]–[3] and theiremployers [4]–[8] continue to report their lack of preparation for effective communication uponcompletion of their undergraduate or graduate programs. Thus, technical communicationtraining merits deeper investigation and creative solutions. At the 2017 ASEE Meeting, weintroduced the MIT School of Engineering Communication Lab, a discipline-specific technicalcommunication service that is akin to a writing center, but
were moreprepared for advanced courses when compared to students who were taught by the conventionallearning and assessment approach.The approach has never been used in any operations research (OR) course before at Penn StateBehrend. In Fall 2017, the approach was implemented in a second course in OR (StochasticModels in OR). This study implements a variation of Bloom’s learning for mastery approach atthis large U.S. public University. The instructor controls the teaching pace and not all theassignments in the course are mastery based. An important component of mastery learning andassessment approach is periodic and brief formative assessments to promote learning andinstruction1. In this study, small online quizzes are used as formative tests
at El Paso (UTEP). She formerly served as the Director of the Engineering Programs Office at UTEP for eleven years where she worked closely with engineering faculty in designing and implementing instructional strategies to improve classroom learning. Ms. Villa holds a Bachelor of Science degree in Mathematics and a Master of Science degree in Computer Science from The University of Texas at El Paso. She will complete her Master of Arts in Education in May 2006. Page 11.255.1© American Society for Engineering Education, 2006 Assessment Results of Multi-Intelligence Methods Used
. Ultimately, students must create a processvalidation for laboratory scale ethanol production based on the previous module’s ethanollaboratory manual. Pre- and post-tests have been created for both of these modules that includethree types of questions: terminology, problems and skills from the unit, and a near-transferquestion. Results of ethanol module's pre- and post-tests indicate a statistically significantgrowth in knowledge.Project Introduction and ObjectivesEast Carolina University (ECU) is a large regional university that serves eastern rural NorthCarolina and the southeast region of the United States. The industries and businesses locatedamong the small towns of eastern North Carolina have a need for a broadly skilled generalengineer. The