June 26, 2011
June 26, 2011
June 29, 2011
Educational Research and Methods
22.454.1 - 22.454.8
Assessing the Impact of Service on Technical and Professional Learning OutcomesAbstractSuccessful educational interventions positively impact learning outcomes. In engineering, asource of content to measure the impact of various educational interventions on learningengineering are the ABET criteria. These criteria list professional and technical learningoutcomes that accredited engineering programs aim to teach their graduates.Pierrakos, Borrego, and Lo (2007, 2008) used the ABET criteria and additional learningoutcomes identified by the National Academy of Engineering’s Center for the Advancement ofScholarship on Engineering Education (NAE CASEE) (Bjorklund & Fortenberry, 2005) toconstruct a 50-item instrument capable of measuring student technical and professional learningoutcomes. Items on the National Engineering Students’ Learning Outcomes Survey (NESLOS)were written to assess knowledge and skills pertaining to, but not limited to: (1) problem-solving,(2) writing and communication skills, (3) understanding and applying knowledge, (4) teamwork,(5) confidence gains, (6) organization and management skills, and (7) interest and engagement ofproject(s).A modified-NESLOS was developed for the purpose of analyzing the impact of engineeringservice opportunities. Modifications were made to reduce the length of the survey, to validate theinstrument, and to provide students with an opportunity to compare the impact of their serviceexperience with the impact of their other engineering coursework.The modified-NESLOS consists of a 15-item instrument developed and used to investigatestudents’ perceptions of the impact of their service experience compared to traditionalcoursework on learning technical (6 items) and professional skills (9 items). Service was chosenas a focus of interest because the field has seen an influx of opportunities over the last decade tomeet student interest and demand. The increase of engineering service-learning courses andextra-curricular service opportunities suggests that faculty and students perceive theseopportunities as valuable learning opportunities.Factor analysis was conducted to ensure validity of the instrument. The results from 261undergraduate engineering students surveyed across the country suggest that a service experiencerelative to traditional coursework has a substantial impact on their learning. Students identifiedthat 34% of what they learned about technical skills and 45% of what they learned aboutprofessional skills was learned through their service activity. While traditional courseworklearning was identified to have a larger impact for both domains, the relative time spent workingin a service environment compared to traditional coursework suggests service to be an importantexperience in this cohort of students’ engineering education. The impact was identified to beeven more important for females who identified significantly higher perceptions of service as asource of learning compared to their male classmates. Scores were consistent across academicyears.ReferencesBjorklund, S., & Fortenberry, N. L. (2005). Final report: Measuring student and faculty engagement in engineering education. Center for the Advancement of Scholarship on Engineering Education (CASEE): National Academy of Engineering.Pierrakos, O., Borrego, M., & Lo, J. (2007). Assessing learning outcomes of senior mechanical engineers in a capstone design experience. Paper presented at the American Society for Engineering Education Annual Conference & Exposition, Honolulu, HI.Pierrakos, O., Borrego, M., & Lo, J. (2008). Preliminary findings from a quantitative study: What are students learning during cooperative education experiences? Paper presented at the American Society for Engineering Education Annual Conference & Exposition.
Carberry, A. R., & Swan, C. W. (2011, June), Developing an Instrument to Measure the Impact of Service on Technical and Professional Learning Outcomes Paper presented at 2011 ASEE Annual Conference & Exposition, Vancouver, BC. https://peer.asee.org/17735
ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2011 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015