Asee peer logo

A YOLO-Based Semi-Automated Labeling Approach to Improve Fault Detection Efficiency in Railroad Videos

Download Paper |

Conference

2025 ASEE North Central Section (NCS) Annual Conference

Location

Marshall University, Huntington, West Virginia

Publication Date

March 28, 2025

Start Date

March 28, 2025

End Date

March 29, 2025

Page Count

9

DOI

10.18260/1-2--54646

Permanent URL

https://peer.asee.org/54646

Download Count

7

Paper Authors

biography

Dylan Lester Marshall University

visit author page

Dylan Lester is a third-year Electrical and Computer Engineering student and research assistant at Marshall University, with a research focus on machine learning.

visit author page

biography

Pingping Zhu Marshall University

visit author page

Prof. Pingping Zhu is an assistant professor in the Department of Computer Sciences and Electrical Engineering at Marshall University.

visit author page

biography

Husnu Saner Narman Marshall University

visit author page

Dr. Husnu S. Narman is an Associate Professor in the Department of Computer Sciences and Electrical Engineering at Marshall University. Previously a post-doctoral fellow at Clemson University, his research interests include distributed computing, cyber-physical systems, machine learning applications, social networks, and advanced learning technologies. He has secured around $3.5 million in funding as PI or Co-PI and has over 60 peer-reviewed publications. Dr. Narman has received several awards, including the Weisberg Service Award, Academy of Distinguished Teachers Award, and Marshall University Distinguished Artists and Scholars Junior Category Award.

visit author page

biography

Ammar Alzarrad Marshall University

visit author page

Dr. Alzarrad is an Assistant Professor in the Department of Civil Engineering at Marshall University. He graduated with dual bachelor’s degrees in Civil Engineering and Business Administration from the University of South Alabama. He received his M.Sc. and Ph.D. in Civil Engineering from The University of Alabama. Before assuming his current position, he was an Assistant Professor in the Department of Civil Engineering and Construction at Bradley University. Prior to joining academia, Dr. Alzarrad was a Virtual Design and Construction (VDC) manager at an engineering design firm in Chicago, where he managed multi-million projects (i.e., Wrigley Field restoration and expansion project). Dr. Alzarrad is a PMP©, CPEM©, and the Director of The Engineering Management Graduate Program at Marshall University.

visit author page

Download Paper |

Abstract

Manual labeling for large-scale image and video datasets is often time-intensive, error-prone, and costly, posing a significant barrier to efficient machine-learning workflows in fault detection from railroad videos. This study introduces a semi-automated labeling method that utilizes a pre-trained YOLO model to streamline the labeling process and enhance fault detection accuracy in railroad videos. By initiating the process with a small set of manually labeled data, our approach iteratively trains the YOLO model, using each cycle’s output to improve model accuracy and progressively reduce the need for human intervention.

To facilitate easy correction of model predictions, we developed a system to export YOLO’s detection data as an editable text file, enabling rapid adjustments when detections require refinement. This approach decreases labeling time from an average of 2–4 minutes per image to 30 seconds–2 minutes, effectively minimizing labor costs and labeling errors. Unlike costly AI-based labeling solutions on paid platforms, our method provides a cost-effective alternative for researchers and practitioners handling large datasets in fault detection and other detection-based machine learning applications.

Lester, D., & Zhu, P., & Narman, H. S., & Alzarrad, A. (2025, March), A YOLO-Based Semi-Automated Labeling Approach to Improve Fault Detection Efficiency in Railroad Videos Paper presented at 2025 ASEE North Central Section (NCS) Annual Conference, Marshall University, Huntington, West Virginia. 10.18260/1-2--54646

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2025 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015