The Development and Application of a Comprehensive Questionnaire Used to Evaluate the Effect of Engineering Ethics Courses

Jiaojiao Fu

Download Paper | Permalink

Conference: 2023 ASEE Annual Conference & Exposition
Location: Baltimore , Maryland
Publication Date: June 25, 2023
Start Date: June 25, 2023
End Date: June 28, 2023
Conference Session: Engineering Ethics Division (ETHICS) Technical Session_Monday June 26, 3:15 - 4:45
Tagged Division: Engineering Ethics Division (ETHICS)
Page Count: 16
DOI: 10.18260/1-2--44083
Permanent URL: https://peer.asee.org/44083
Download Count: 153

Paper Authors

biography

Jiaojiao Fu Peking University orcid.org/0000-0002-7951-2281

visit author page

Jiaojiao Fu is a postdoctor at the Graduate School of Education, Peking University, Beijing, China. She received B.A. from China Agricultural University, M.Ed. and Ph.D. from Beihang University, China. From April 2017 to October 2017, she studied in the College of Engineering at the Ohio State University as a visiting scholar. Her academic and research interests include engineering ethics education, ethics of artificial intelligence, lifelong education.

visit author page

Download Paper | Permalink

Abstract

Different countries, colleges and universities, and even majors provide students with different kinds of engineering ethics courses. Practical course evaluation is conducive to presenting students' learning effects and subsequent course improvement. In the existing research and practice, the evaluation of engineering ethics education focusing on students' learning output has produced many positive results. On this basis, from the perspective of the sustainable development of the curriculum and benefiting more students, this study proposes that it is necessary to understand the evaluation of engineering ethics education from a broader meaning -- not only to evaluate the course of engineering ethics itself but also to evaluate the learning effect of students. By referring to the concepts, tools, and methods of engineering ethics curriculum evaluation, this study attempts to develop a comprehensive questionnaire survey.

The design of this comprehensive questionnaire is based on the goals of engineering ethics education. The topic presents logical progression according to each goal and content composition of engineering ethics education, from understanding to knowledge mastery to knowledge application. The questionnaire not only includes the evaluation of students' learning achievements but also covers the assessment of the implementation of the whole curriculum and curriculum elements, which reflects the characteristics of the whole curriculum and comprehensiveness. The reliability and validity of the comprehensive questionnaire are improved by referring to the engineering ethics course evaluation questionnaire in existing studies, soliciting experts' opinions many times, conducting multi-type pre-test, in-depth discussion feedback, and scoring twice.

The comprehensive questionnaire consists of three parts. The first part is about evaluating the course and students' learning experience, which includes not only the cognition and evaluation of the overall situation of the course but also students' recognition of the course and engineering ethics, self-evaluation, and feeling of course learning. This section is based on nearly 20 multiple-choice questions. The second part of the questionnaire mainly evaluates students' mastery of engineering ethics curriculum knowledge, ethical codes, and principles. Four multiple-choice questions (more than one answer) are selected by referring to the existing questionnaires, exam questions, and essential knowledge points in classic textbooks and taking into account the questionnaire's representativeness, difficulty, and length. The topic involves four aspects: engineers' aim (related to ethical principles, norms, obligation, utilitarianism, etc.), engineering ethics responsibility, the basic principles of dealing with the ethical problems of engineering, and the ethical rules of professional engineering associations. The third part contains two cases and four questions related to the cases. This paper selects two classic cases to design four essay questions from role conflict, identifying ethical dilemmas and contradictions, balancing interests, analyzing possible consequences from multiple perspectives, and proposing solutions to ethical dilemmas. In addition, detailed and quantifiable scoring criteria have been designed for the questionnaire.

The completed comprehensive questionnaire developed was used in an engineering university to test 511 students taking five different forms of engineering ethics courses. The effects and differences of various engineering ethics courses are obtained through the analysis of the questionnaire results. The application of the questionnaire survey has explained the effect of questionnaire design to a large extent but also reflected some limitations. Finally, combined with the questionnaire survey and interviews, the paper also suggests the possibility of further improvement of the comprehensive questionnaire.

Citation
Format

Fu, J. (2023, June), The Development and Application of a Comprehensive Questionnaire Used to Evaluate the Effect of Engineering Ethics Courses Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--44083

TY - CPAPER
AB - Different countries, colleges and universities, and even majors provide students with different kinds of engineering ethics courses. Practical course evaluation is conducive to presenting students&#39; learning effects and subsequent course improvement. In the existing research and practice, the evaluation of engineering ethics education focusing on students&#39; learning output has produced many positive results. On this basis, from the perspective of the sustainable development of the curriculum and benefiting more students, this study proposes that it is necessary to understand the evaluation of engineering ethics education from a broader meaning -- not only to evaluate the course of engineering ethics itself but also to evaluate the learning effect of students. By referring to the concepts, tools, and methods of engineering ethics curriculum evaluation, this study attempts to develop a comprehensive questionnaire survey.

The design of this comprehensive questionnaire is based on the goals of engineering ethics education. The topic presents logical progression according to each goal and content composition of engineering ethics education, from understanding to knowledge mastery to knowledge application. The questionnaire not only includes the evaluation of students&#39; learning achievements but also covers the assessment of the implementation of the whole curriculum and curriculum elements, which reflects the characteristics of the whole curriculum and comprehensiveness. The reliability and validity of the comprehensive questionnaire are improved by referring to the engineering ethics course evaluation questionnaire in existing studies, soliciting experts&#39; opinions many times, conducting multi-type pre-test, in-depth discussion feedback, and scoring twice.

The comprehensive questionnaire consists of three parts. The first part is about evaluating the course and students&#39; learning experience, which includes not only the cognition and evaluation of the overall situation of the course but also students&#39; recognition of the course and engineering ethics, self-evaluation, and feeling of course learning. This section is based on nearly 20 multiple-choice questions. The second part of the questionnaire mainly evaluates students&#39; mastery of engineering ethics curriculum knowledge, ethical codes, and principles. Four multiple-choice questions (more than one answer) are selected by referring to the existing questionnaires, exam questions, and essential knowledge points in classic textbooks and taking into account the questionnaire&#39;s representativeness, difficulty, and length. The topic involves four aspects: engineers&#39; aim (related to ethical principles, norms, obligation, utilitarianism, etc.), engineering ethics responsibility, the basic principles of dealing with the ethical problems of engineering, and the ethical rules of professional engineering associations. The third part contains two cases and four questions related to the cases. This paper selects two classic cases to design four essay questions from role conflict, identifying ethical dilemmas and contradictions, balancing interests, analyzing possible consequences from multiple perspectives, and proposing solutions to ethical dilemmas. In addition, detailed and quantifiable scoring criteria have been designed for the questionnaire.

The completed comprehensive questionnaire developed was used in an engineering university to test 511 students taking five different forms of engineering ethics courses. The effects and differences of various engineering ethics courses are obtained through the analysis of the questionnaire results. The application of the questionnaire survey has explained the effect of questionnaire design to a large extent but also reflected some limitations. Finally, combined with the questionnaire survey and interviews, the paper also suggests the possibility of further improvement of the comprehensive questionnaire.

AU - Jiaojiao Fu
CY - Baltimore , Maryland
DA - 2023/06/25
PB - ASEE Conferences
TI - The Development and Application of a Comprehensive Questionnaire Used to Evaluate the Effect of Engineering Ethics Courses
UR - https://peer.asee.org/44083
DO - 10.18260/1-2--44083
ER -