Conference Session

LEAD Tech Session #2: Assessing and Evaluating Engineering Leadership Development.

Collection

2022 ASEE Annual Conference & Exposition

Authors

Olivier de Weck, Massachusetts Institute of Technology; Reza Rahaman, Massachusetts Institute of Technology; Joel Schindall, Massachusetts Institute of Technology

(TDN), and Generalized Multi-Commodity Network Flow (GMCNF) theory. Prof. de Weck has authored or co-authored four books, about 400 scientific articles and won thirteen best paper awards since 2004. His book “Engineering Systems: Meeting Human Needs in a Complex Technological World” was the 2012 bestseller at the MIT Press. In 2010 he received the Capers and Marion McDonald Award for Excellence in Mentoring and Advising and in 2017 an MIT Teaching with Digital Technology Award. He is a Fellow of INCOSE, Fellow of AIAA, and a Senior Member of IEEE. He served as Editor-in-Chief of the journal Systems Engineering, and more recently as Senior Vice President for Technology Planning at Airbus. Since 2019 he is the Faculty Co

Conference Session

NSF Grantees Poster Session

Collection

2022 ASEE Annual Conference & Exposition

Authors

Arianne Collopy, University of Colorado Denver; Heather Johnson; Katherine Goodman, University of Colorado Denver; Tom Altman; Maryam Darbeheshti, University of Colorado Denver; Kristin Wood, University of Colorado Denver; David Mays

who continue in their major year over year.4. Intervention: Faculty Learning Community and Project TimelineThe FLC is a cohort of approximately twenty faculty that draws from each department in thecollege (bioengineering, civil engineering, computer science, electrical engineering, andmechanical engineering) and includes faculty in multiple positions (assistant, associate, and fullprofessors) and tracks (clinical teaching faculty, research faculty, and tenure-track/tenuredfaculty) The cohort meets once per month during the school year, totaling eight sessions peryear, with an additional retreat planned for each summer. Before each workshop session,participants are encouraged to study and reflect on a text from the Equity Toolkit, and

Conference Session

DEED Technical Session 7 Design Mental Frameworks

Collection

2022 ASEE Annual Conference & Exposition

Authors

Hillary Merzdorf, Purdue University at West Lafayette (COE); Donna Jaison, Texas A&M University; Morgan Weaver, Georgia Institute of Technology; Kerrie Douglas, Purdue University at West Lafayette (COE); Julie Linsey, Georgia Institute of Technology; Tracy Hammond, Texas A&M University

, especially where practicing sketchingskills can be beneficial.We intend to further define object assembly as a spatial ability by exploring the skills necessary toperform test exercises. In addition to mental rotation and mental imagery, the exercises could usemore advanced spatial skills such as perception of 3-dimensional space, awareness of hidden linesand shapes, and understanding of interactions between shape sides in order to assemble complexsolids. We also plan to continue making changes to the sketch grading rubric language. Precisionwill be more sensitively graded to capture cases when students only have one open or overdrawncorner, or when there are multiple ways to draw a corner. Additional clarification to the rubric,while making it

Conference Session

Software Engineering Division Technical Session 2

Collection

2022 ASEE Annual Conference & Exposition

Authors

Yalda Afshar, University of Calgary; Mohammad Moshirpour, University of Calgary; Emily Marasco, University of Calgary; Jalal Kawash, University of Calgary; Laleh Behjat, University of Calgary; Mahmood Moussavi, University of Calgary

Paper ID #37046An Integrated Software Engineering Curriculum ThroughProject-Based Learning (PBL)Yalda AfsharMohammad MoshirpourEmily Ann Marasco (Program Evaluation and Planning Specialist)Jalal KawashLaleh Behjat (Professor) Dr. Laleh Behjat is a professor at the Department of Electrical and Software Engineering at the University of Calgary, Canada and the Natural Sciences and Engineering Research Council of Canada Chair for Women in Science and Engineering - Prairies. Her research focuses on developing mathematical techniques and software tools for automating the design of digital integrated circuits and education

Conference Session

Mechanical Engineering: Student Growth

Collection

2022 ASEE Annual Conference & Exposition

Authors

Daniel Jensen, United States Air Force Academy; Luke Jensen; William Allison; Adam Goodworth; Douglas Fontes

chemistry class as“science/math” foundation and then adds the engineering-specific courses.Engineering classes in the Westmont program include those often found in other MechanicalEngineering programs including sub-areas of energy, mechanics, electronics and control,materials and design. There are 55 credit hours of engineering specific courses. Initial feedbackfrom our external engineering advisory board is that the engineering-specific content does a greatjob of covering the needed areas for a Mechanical Engineering program. A curricular plan isincluded in the Appendix 1.Fig. 1. 4D Design Innovation (DI) Process and MindsetsSpecifics and Curricular Integration to Enhance Noted VariablesOf specific note is the manner in which the engineering

Conference Session

DEED Technical Session 3 Capstone Design

Collection

2022 ASEE Annual Conference & Exposition

Authors

Wilhelm Friess, University of Maine; Justin Lapp, University of Maine; Andrew Goupee

projectfunding has grown from 12.5% of the projects in 2016-17, to a peak of 33% in 2018-19, withCOVID slowing further growth over the past two years.A second factor affecting cost are unforeseen and reorders due to either engineering or partselection mistakes. These can easily double the cost of an individual project. It is clear that inscenarios where all teams are supervised by a single or by multiple instructors jointly, theindividual attention a team can receive is diluted, which in turn triggers increased unforeseen costs. An element of the evolution of the teaching modes (made possible by lowerworkloads) has been the development of a much more detailed order and change-order approvalprocess linked to a higher level of planning support and

Conference Session

LEAD Tech Session #2: Assessing and Evaluating Engineering Leadership Development.

Collection

2022 ASEE Annual Conference & Exposition

Authors

Bruce DeRuntz, Southern Illinois University Carbondale; Harvey Henson, Southern Illinois University Carbondale; Tom Withee

caused the disappearance of interpersonal networks featuring coworkers and academicties, as well as reductions in students’ overall number of connections made possible continuedreduction of peer academic relationships.Faced with leading a university through a pandemic for their first time, university leaders lackedinformation, experience, resources, and time; human safety was paramount and they did the bestthat they could. In hindsight, prudence would dictate a proactive response to plan and implementstudent online social programming to promote a continued sense of belonging andconnectedness. This approach draws upon the Situational Awareness Model [19]. Situationalawareness is knowing the environment and its implications for people in the

Conference Session

ERM: Design!

Collection

2022 ASEE Annual Conference & Exposition

Authors

Corey Schimpf, University at Buffalo, The State University of New York; Titiksha Singh, The State University of New York, College at Buffalo

framework of Paul Cilliers to define complex systems assystems with many elements, dynamic and dense interconnections, nonlinear and shortrange interactions,feedback loops, open to environmental inputs, operating far from equilibrium, possessing a unique historyand trajectory, and where elements have limited “awareness” of other elements or lack a global view.This work adapted an approach used in policy planning and evaluation research called ParticipatorySystems Mapping (PSM). Within policy evaluation, PSM is used to bring together a group of stakeholdersto identify a policy target (e.g., reducing city pollution) and then collectively map out a full view of thecomplex system(s) impacting this target and the relationships or connections between

Conference Session

Works in Progress: Chemical Engineering Education

Collection

2022 ASEE Annual Conference & Exposition

Authors

Sarah Wilson, University of Kentucky; Tracy Carter, Northeastern University; Amy Karlsson; Janie Brennan, Washington University in St. Louis; Joanne Beckwith, University of Michigan; Samira Azarin; Chris Barr, University of Michigan

responsegroups will be determined using a Mann-Whitney U test. Analysis of the ranked learningoutcomes will utilize a risk-adjusted mean [11]. Through using a risk-adjusted mean, thestandard deviation will be used to adjust the mean rank score. This allows outcomes to beweighted not only by their mean score, but also the consensus in the ranking.Future planGoing forward, the author group is looking to solicit feedback on the proposed surveys as well asto receive feedback on survey distribution plans. This feedback will be predominantly gainedduring the ASEE 2022 National Conference, although the authors would be interested in hearingfrom others via email. In addition to soliciting feedback, recruitment for the completion offaculty surveys and

Conference Session

ERM: Student Professional Development: Professional Skills and Moving Beyond the Classroom

Collection

2022 ASEE Annual Conference & Exposition

Authors

Paul Leidig, Purdue University at West Lafayette (COE); William Oakes, Purdue University at West Lafayette (COE); Eric Holloway, Purdue University at West Lafayette (COE)

o o o o Implementation o o o o Monitoring and Evaluation o o o oQ12 Approximately how often did you engage in structured reflections as part of your undergraduateexperience with EWB-USA? Reflection can involve intentionally considering an aspect of something,connecting it to a broader theme/topic, and/or planning how to act in the future based on thisexperience and learning. This can include individual writings, group discussions, or combinationsthereof. o Weekly or more often o Once or a few times per month o

Conference Session

Electrical and Computer Engineering Laboratory and SoC Developments

Collection

2022 ASEE Annual Conference & Exposition

Authors

Matthew Spencer, Harvey Mudd College

they were notreceiving more attention from their instructor.3.4 Effects on Instructor Effort and ExperienceThe instructor’s time tracking records indicate that preparation for the competency-based coursewas time consuming, and that the most of the instructor’s effort was dedicated to makingflipped-classroom videos. Creating a lecture for the lecture-based course required six hours onaverage, divided between four hours of reading, research and organization and two hours ofdrafting notes and day plans. Converting a lecture from the lecture-based format to aflipped-classroom video for the competency-based format required an additional 6-7 hours. Itmay be possible to save some time if creating a competency-based course from scratch bycombining

Conference Session

ERM: Instruction and Engagement

Collection

2022 ASEE Annual Conference & Exposition

Authors

Shamima Mithun, Indiana University - Purdue University Indianapolis

/discussionsessions, (4) in-class demonstrations, (5) opportunities for peer feedback, (6) opportunities forsharing instructor feedback, (7) large group discussions, and (8) opportunities for artifactrevision based on feedback. Alongside these eight factors, we sought to design each course with particular objectivesfor student learning in mind. For novice students enrolled in the introductory level course, weemphasized students’ development and engagement in interpersonal skill sets such as sharingconstructive feedback, delegating tasks, team management and planning, conflict resolution, andcollaborative design [24], [25]. These competencies have recently become essential to success incomputing industries and are hard-sought after by engineering

Conference Session

Graduate Studies Division Technical Session 2

Collection

2022 ASEE Annual Conference & Exposition

Authors

Mirit Shamir; Stacy Hutchinson, Kansas State University; Gaea Hock; Ryan Hansen, Kansas State University; Jonathan Aguilar, Kansas State University; Nathan Hendricks, Kansas State University; Prathap Parameswaran, Kansas State University; Matthew Sanderson; Rebecca Cors; Melanie Derby, Kansas State University

contributed contributed crucial detrimental standards) adequately) significantly) component to group) to success) Participation in developing ideas and planning product/project Contributions to outline and lit review of the final product Contributions to the results, and discussion of the final product Willingness to discuss the ideas of others Writing and editing the final product Total ScoreFinal Course ProductsAs part of the NRT capstone, all teams selected a research paper (conference or journal paper).One team

Conference Session

Minorities in Engineering Division Poster Session

Collection

2022 ASEE Annual Conference & Exposition

Authors

Sylvia Mendez, University of Colorado at Colorado Springs; Jennifer Tygret; Jasmine White; Valerie Conley, University of Colorado at Colorado Springs; Comas Haynes, Georgia Tech Research Institute; Rosario Gerhardt, Georgia Institute of Technology; Kinnis Gosha

for the mentoring matches. Onboardingincluded setting clear expectations for the roles and responsibilities of both parties and co-developing a mentoring plan that required articulation of the mentee’s career goals and theplanned mode and frequency of communication. These requirements led the participants tounderstand the nature of their relationship early on, which promoted a deep connection from thestart. How the mentors demonstrated care and commitment prompted mentees to do the samewith their students as the mentees experienced the benefit personally and sought to replicate it.Thus, higher education institutions and mentoring program designers must implementonboarding, check-in, and reflective experiences with mentoring program

Conference Session

Electrical and Computer Engineering Division Poster Session

Collection

2022 ASEE Annual Conference & Exposition

Authors

Qudsia Tahmina, The Ohio State University at Marion

advisors also play a critical role in helping ease some of the stress students have. This is because the advisors are a gateway into the courses and hence, they can provide some guidance to students as to which course is more demanding in terms of time and effort. This will allow students to plan their coursework especially if there are other underlying issues that they are experiencing.Future WorkMore work across a wider sample is needed to understand the degree to which the teachingmodalities affect student performance. Similar studies will help in proposing strategies to addressanxiety and stress among students and faculty due to global pandemics or similar situations.Because this study was conducted at a small regional

Conference Session

ERM: Student Professional Development: Professional Skills and Moving Beyond the Classroom

Collection

2022 ASEE Annual Conference & Exposition

Authors

Andrew Olewnik, University at Buffalo, The State University of New York; Bahar Memarian, University of Toronto

student objectives and characteristics such as learningstyles [16]. Such bold realization, however, requires appropriate training and understanding ofhow assessments and hence teaching and learning change depending on the conceptualframework taken for all individuals involved (e.g., administrators, students).Research StructureStep 1 – Practice: Complementing the pedagogical/philosophical perspectives are the structure(e.g., research question, participants, and their way of participation) that shape the research. Theresearch structure can be considered as the detailed plan of steps taken throughout the research,with the overarching goal of answering a research goal. To study the research question,participants such as students are needed to be

Conference Session

LEES 3: Assessing/Addressing Mental Health

Collection

2022 ASEE Annual Conference & Exposition

Authors

Kacey Beddoes, San Jose State University; Andrew Danowitz, California Polytechnic State University, San Luis Obispo

was mitigated by another lead saying I was only being so cautious because of my anxiety, downplaying the legitimacy of the concern. I couldn’t even argue for myself much because it would support the insane/anxiety argument. This became a big deal because part of my job relies on having project leads trust my word when I tell them to change something to be safe as possible, add backup plans, etc. Launching rockets is risky and we’ve seen how bad things can get when safety is overlooked and people can get physically injured- the last thing we need is a project lead not willing to listen to a voice of reason. In conclusion: It’s not just industries that will fear they can’t trust your word if you’re not

Conference Session

ECE Division Technical Session 4: Student-centered Learning and Teaching Methodologies

Collection

2022 ASEE Annual Conference & Exposition

Authors

Yuchen Huang, Portland State University; Branimir Pejcinovic, Portland State University

effective. We also think that it is generally applicable and can bereplicated elsewhere. We have also found that implementing SCTM during Covid-19 restrictionswas relatively straightforward and students still benefited from this approach.We plan to conduct student post-course surveys to all of our courses in the future. We willcontinuously monitor how these items develop over time and use them to keep improve andrefining our teaching methods.References[1] J. Michael, “Where’s the evidence that active learning works?”, Journal of Advances in Physiology Education, vol. 30, pp. 159-167, 2006.[2] S. Freeman, S.L. Eddy, M. McDonough, M.K. Smith, N. Okoroafor, H. Jordt, M. Wenderoth, “Active learning increases student performance in

Conference Session

Mechanical Engineering: Fluids, Heat Transfer

Collection

2022 ASEE Annual Conference & Exposition

Authors

Jack Elliott, Utah State University; Angela Minichiello, Utah State University; Kevin Roberts

downloading Word versions of the learning pages and requesting topush their changes/additions to a public (currently private for security) Github repository.Finally, we plan to develop a LearnPIV.org based curricula that will be accessible within the mI-PIV application and published onTeachEngineering.org. These curricula will guide users throughseveral LearnPIV.org experiments as well as assess their achievement of the desired learningoutcomes. For example, one curriculum could guide an undergraduate learner through thecombined effects of particle displacement and region size to the extent of the learner minimizingregion size (to maximize resolution) while retaining valid correlations. These efforts will furtherdeploy LearnPIV.org to engage users

Conference Session

CIT Division Technical Session #3

Collection

2022 ASEE Annual Conference & Exposition

Authors

Margaret Ellis; Godmar Back, Virginia Polytechnic Institute and State University; Walter Lee, Virginia Polytechnic Institute and State University; Kirk Cameron, Virginia Polytechnic Institute and State University; Crystal Pee

. Many of the conversations are not professor-driven, ratherprofessors listen and step in to encourage or guide as needed. On a larger scale, our projectaims to influence the perception of and communication about computer systems research to abroad audience by making our repository, analysis, and educational materials availablethrough the project website (www.csgenome.org).Students have timely access to peers and faculty across a broad range of communicationmodes such as Discord chats and channels, emails, git issues, and weekly individual updatesin a personal google doc to which a faculty member responds weekly. Students spend timebrainstorming, planning, designing, coding, problem-solving, and communicating across avariety of sub-projects such

Conference Session

Faculty Development Division Technical Session 1

Collection

2022 ASEE Annual Conference & Exposition

Authors

Paul Nissenson, California State Polytechnic University, Pomona; Faye Wachs, California State Polytechnic University, Pomona; Juliana Fuqua; Cecilia Nguyen, California State Polytechnic University, Pomona; Deanna Miranda Barrios, California State University, Fullerton; Natalia Perez, California State Polytechnic University, Pomona

Engineering Department at Cal Poly Pomona started a video tutorial library onYouTube named CPPMechEngTutorials that has grown to over 600 videos across 16 courses(https://www.youtube.com/channel/UCZScjkZuVuvwa-JVA3mHO3w). The video library was acollaborative effort that involved over half of the department’s full-time faculty who eithercreated videos, allowed their lectures to be recorded, or contributed ideas and feedback duringthe planning of videos. The videos have accumulated over 11 million views and the YouTubechannel has over 100,000 subscribers as of May 1, 2022, making the video library one of CalPoly Pomona’s largest outreach efforts. Since the YouTube platform provides limited options forthe organization of videos, links to the videos are

Conference Session

ERM: Teamwork makes the dream work!

Collection

2022 ASEE Annual Conference & Exposition

Authors

Aparajita Jaiswal, Purdue University at West Lafayette (PPI); Kaushali Patel, Purdue University at West Lafayette (COE); Devang Patel, Purdue University at West Lafayette (COE); Alejandra Magana, Purdue University at West Lafayette (COE)

was divided into four clear milestones interdependence task or goal. and deliverables. Students created a Gantt chart to plan and monitor the work based on those milestones. Students defined the scope of the project in the first milestone. The prototype was completed in five iterative sprints. Individual and The group is Students are expected to work together as a team group accountable for throughout all four milestones and deliverables of accountability achieving its goals. the project. However

Conference Session

Community Engagement Division Technical Session 3- Multi- and Inter-disciplinary, Collaboration, and Engagement in Practice

Collection

2022 ASEE Annual Conference & Exposition

Authors

Malle Schilling, Virginia Polytechnic Institute and State University; Jacob Grohs, Virginia Polytechnic Institute and State University

summer summit before the first year as we originally planned. And I think that would have helped start to build the partnerships a little bit better, because I mean I know a whole group, a whole bunch of people worked really hard to go out to individual schools to recruit people to participate. (University Affiliate 5)Another participant suggested that, for reasons presented above, some partners seemed lessengaged and perhaps did not understand the expectations and goals set for them: They seem less engaged than in a perfect world, and I think that is because their lives are very full of lots of other things, or maybe in some cases they didn't choose it. I'm not really sure. (University Affiliate 8

Conference Session

ERM: Student Professional Development: Professional Skills and Moving Beyond the Classroom

Collection

2022 ASEE Annual Conference & Exposition

Authors

Caitlin Wylie, University of Virginia; Natalie Evans, University of Virginia; Jamie Jirout, University of Virginia; Jessica Scoville, University of Virginia; Elizabeth Opila, University of Virginia

beespecially effective in achieving these goals, so further research to test these ideas is needed. We plan to invite all students who were interviewed to participate in a second interviewafter they have spent at least one semester in a research lab. This will allow us to ask whethertheir curiosity has changed as they have spent more time in the lab and become more familiarwith the research. It may also be important to expand the study and interview graduate studentsgiven that they influence undergraduate research. Grad students would be able to reflect on howtheir curiosity in their research focus has changed over time and how it may have led them topursue a higher degree. Grad students also serve a dual role as a student to the PI and a

Conference Session

ERM: Exploring Educational Technology in Engineering

Collection

2022 ASEE Annual Conference & Exposition

Authors

Kelsey Rodgers, Embry-Riddle Aeronautical University - Daytona Beach; Matthew Verleger, Embry-Riddle Aeronautical University - Daytona Beach; Farshid Marbouti, San Jose State University; Angela Thompson, University of Louisville; Nicholas Hawkins, University of Louisville

: structure and early stages of Graphical, Financial planning before decisions on final design are made. AGREE: Financial 2 models are portrayals visual visual models are like MATLAB Program: of thoughts, objects mathematical flowcharts and charts used to Physical, Mathematical and frameworks, computer represet ideas. which are focal in models matheatical models use math Researcher: science, innovation, concepts to explain situations Computational, building or computer models use computer Graphical potentially

Conference Session

CIT Division Technical Session #8

Collection

2022 ASEE Annual Conference & Exposition

Authors

Mercy Jaiyeola; Sarah Lee, Mississippi State University; Allen Parrish

Technology. He earned a masters in Computer EngineeringTechnology and a PhD in computational science from the University of Southern Mississippi.Allen S. ParrishAllen S. Parrish is Executive Director of the Alabama Transportation Institute and Professor ofComputer Science at The University of Alabama. His research interests are in the fields of AI,Connected and Autonomous Vehicles, Data Science, Digital Transportation, and MachineLearning. He holds a BS in Computer Science from University of Tennessee, Martin, and hereceived a master’s degree and PhD in computer science from The Ohio State University.Michael TaquinoMichael Taquino serves as Deputy Executive Director at the National Strategic Planning &Analysis Research Center (NSPARC) at

Conference Session

Educational Research and Methods (ERM) Division Poster Session

Collection

2022 ASEE Annual Conference & Exposition

Authors

Shamita V, Nanyang Technological University; Ibrahim H. Yeter, Nanyang Technological University; Eileen Fong, Nanyang Technological University

all students that they can beengineers, regardless of their gender, race, or any other demographic feature (Lachapelle etal., 2014). Currently, the teaching and learning of engineering seem to follow a fixed narrativethat does not allow room for creativity and different perspectives, making it disadvantageousto students from different backgrounds. Engineering is a subject that requires a lot of supportfrom family, friends, and the community, an aspect usually overlooked or completelyneglected in curriculum planning (e.g., Van den Bogaard et al., 2021). As students come fromdiverse backgrounds, they will each have different experiences or resources. Naturally,students who receive less motivation from their families and may not have as

Conference Session

Utilizing Technology to Train Chemical Engineering Students

Collection

2022 ASEE Annual Conference & Exposition

Authors

Mark Burns, University of Michigan; Valerie Johnson, University of Michigan; Kaylee Smith, University of Michigan

andstaff, plans are to make MiQuizMaker a free website that anyone can use.Results and DiscussionThe above-described methods were used to generate a suite of quizzes, and these quizzes wereused as the sole assessment process in the fluid mechanics course. Homework and exams wereeliminated and replaced with approximately 90 short quizzes (a single calculation question or 5-10 T-F, MC, or FITB questions) that could each be completed in under an hour. In addition,Canvas allowed the instructor to set the number of attempts and whether the answer was visibleafter the attempt for each quiz. Thus, some of the quizzes were structured as homework sets(unlimited attempts, see answer after each attempt), some as quizzes/class-problems (3 attempts,see answer

Conference Session

Experimentation and Laboratory-Oriented Studies Division Technical Session 3: Best of ELOS

Collection

2022 ASEE Annual Conference & Exposition

Authors

Thomas Shepard, University of St. Thomas; Charles Mossey; Jacob Swanson, Minnesota State University, Mankato; Colin Huntington, University of St. Thomas; Mary Murphy

. We have asmaller supply of left over spray paints than latex paints and plan to supplement with morepurchased paints in the future. This technique is quite forgiving in that the paint dries quickly soa student can paint over anything they find displeasing. One common problem involved capsbecoming clogged. To address this in the future we will have extra caps on hand as well as asmall pin/needle and brake cleaner to try to clear clogs.Materials used: leftover spray paints, male-female cap adapter, fat caps, skinny caps, extrastandard caps, hardboard panels, brake cleaner, small pin/needleAcrylic Pour Painting & Spin ArtAcyrlic pour painting involves pouring acrylic paints of different colors onto a canvas/board.There are many methods for

Conference Session

ERM: ERM Medley Session!

Collection

2022 ASEE Annual Conference & Exposition

Authors

Kelsey Watts, Clemson University; Gary Lichtenstein, Arizona State University; Karin Jensen, University of Illinois at Urbana - Champaign; Evan Ko, University of Illinois at Urbana - Champaign; Rebecca Bates, Minnesota State University, Mankato; Lisa Benson, Clemson University

not coded).The authors looked at the proportion of comments related to the conceptualization of the study,design, method, analysis, interpretations and conclusions, and presentation (quality ofexpression). Two-thirds of comments overall were related to the Planning & Execution of thestudy, and one-the third to the Presentation. Twenty percent of weaknesses were attributed toConceptualization, 11% to Design, 12% to Procedures, 7% to Measurement, 22% to Analyses &Results, 16% to Interpretations/Conclusions, 9% to Editing/Writing, and 3% to “General.” Aswith other studies of peer review, inter-class correlations of publication recommendations werelow (x̄r=.20). That authors found minimal consensus across reviewers does not