Asee peer logo

Geometric Calibration of a Thermal Imaging Camera System for Advanced Driver Assistance

Download Paper |

Conference

2023 ASEE North Central Section Conference

Location

Morgantown, West Virginia

Publication Date

March 24, 2023

Start Date

March 24, 2023

End Date

March 25, 2023

Page Count

9

DOI

10.18260/1-2--44924

Permanent URL

https://peer.asee.org/44924

Download Count

70

Request a correction

Paper Authors

biography

Osama Salim Mr School of engineering , Eastern Michigan University

visit author page

Osama Salim , School of Engineering , Eastern Michigan University

As an international student , I came to the US , leaving my family behind to be able to acquire better education for myself. My main goal is to make a name for myself in the industry and provide research that will be beneficial for the world. I have been fortunate enough to have wonderful experiences along the way. The vast varieties of culture that I have encountered here has had an effect on me as well. My long term goal includes working with an environmental friendly corporation on the upcoming generation of autonomous vehicles.

visit author page

biography

Qin Hu Eastern Michigan University Orcid 16x16 orcid.org/0000-0003-0223-8285

visit author page

Qin Hu received her B.S. and M.S. degrees in Electrical Engineering from the University of Electronic Science and Technology of China, Chengdu, China, and the Ph.D. degree in Electrical Engineering from Old Dominion University, Norfolk, VA. She is current

visit author page

biography

David T DeLisle The Ohio State University

visit author page

As a descendant from migrated Hispanics and being the first in my family to pursue a doctorate, I am dedicated towards academic achievement. I’m striving to make something of myself and produce research to better the world. In addition to my technical studies, I enjoy learning about culture, history, humanities, and numerous trade skills. My long term goals are to achieve a Ph.D. in the field of Electrical Engineering. Further, I aim to work with a renown university or automotive manufacturer to create the next generation of electric and autonomous vehicles.

visit author page

author page

Timothy Bonk

author page

Hermann Stef Fokou Chendjou

author page

suleyman abdirahman

Download Paper |

Abstract

Traffic accidents claim the lives of millions of people each year. In addition to preventing these accidents, technology in autonomous vehicles has the potential to spark a technological renaissance. Thermal imaging camera is well known for its capability of providing information about pedestrians and animals in low visibility situations, while RGB cameras are disabled with insufficient visible light. Fusing a thermal imaging camera into a sensor system for an autonomous vehicle will help avoid running over pedestrians and animals on the road under extreme weather and environmental conditions, such as total darkness, rain, fog, and dust.

Ensuring that a low-cost but effective sensor is used to be able to detect warm-body obstacles in the path of the vehicle. This engineering solution will provide proper device initialization and utilization in autonomous vehicle (AV) applications. The project’s objective is to work and develop a Light Detection and Ranging (LiDAR) and a FLIR thermal imaging system to measure the distance of live bodies on the road. The geometric intrinsic and extrinsic calibration of thermal imaging cameras is challenging since the regular black-white checkerboard method used for RGB cameras is not visible by the thermal camera.

A new geometric calibration method of a thermal imaging camera will be discussed, tested and validated in this study. Physical prototypes of thermoelectric cooled and heated pads will be utilized to better calibrate the FLIR/LiDAR sensor system. Calibration algorithms will be developed in Python. The depth measurement of a pedestrian by the thermal camera and the LiDAR will be conducted. Challenges and design constraints will also be discussed.

Salim, O., & Hu, Q., & DeLisle, D. T., & Bonk, T., & Fokou Chendjou, H. S., & abdirahman, S. (2023, March), Geometric Calibration of a Thermal Imaging Camera System for Advanced Driver Assistance Paper presented at 2023 ASEE North Central Section Conference, Morgantown, West Virginia. 10.18260/1-2--44924

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2023 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015