Asee peer logo

Assessment of Ethics and Social Justice Aspects in Data Science and Artificial Intelligence

Download Paper |

Conference

2022 ASEE Annual Conference & Exposition

Location

Minneapolis, MN

Publication Date

August 23, 2022

Start Date

June 26, 2022

End Date

June 29, 2022

Conference Session

Engineering Ethics Division: Computing, Technology, and AI

Page Count

22

DOI

10.18260/1-2--41550

Permanent URL

https://strategy.asee.org/41550

Download Count

697

Request a correction

Paper Authors

author page

Franz Kurfess California Polytechnic State University, San Luis Obispo

author page

Katya Vasilaky California Polytechnic State University, San Luis Obispo

biography

Tina Cheuk California Polytechnic State University, San Luis Obispo

visit author page

Assistant Professor, Cal Poly, San Luis Obispo

visit author page

author page

Ryan Jenkins

author page

Grace Nolan

author page

Amir Hajrasouliha

author page

Elise St John

Download Paper |

Abstract

Abstract This work aims to develop a set of materials and tools, both quantitative and qualitative, for two purposes: First, for the assessment of ethical and social justice (ESJ) considerations in research projects, and second, as a pedagogical toolkit that allows users to improve their understanding of these aspects of data ethics. Below we describe three existing assessment methodologies for evaluating ESJ in data science research projects: a scoring rubric, a questionnaire, and a canvas sheet (i.e., a user-friendly template and tool that captures data), and we propose one additional method, a predictive machine learning model. This document describes an evaluation of the feedback from 124 students in two different classes who used the questionnaire and canvas sheet to assess their team projects. This data set is also being used to test a proof of concept for the machine learning model. Our emphasis at this stage is to improve the instruments, with a quantitative analysis of the numerical and scale-based responses, and a qualitative evaluation of the text-based suggestions from participants. The primary insights from this first round of evaluations indicate that students showed no strong preference between the questionnaire and the canvas sheet, with slight advantages on “Perspective” and “Further Research” for the canvas sheet, and a similar advantage for “Group Discussion” for the questionnaire.

Kurfess, F., & Vasilaky, K., & Cheuk, T., & Jenkins, R., & Nolan, G., & Hajrasouliha, A., & St John, E. (2022, August), Assessment of Ethics and Social Justice Aspects in Data Science and Artificial Intelligence Paper presented at 2022 ASEE Annual Conference & Exposition, Minneapolis, MN. 10.18260/1-2--41550

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2022 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015