Temperature-based Collision Detection in Extreme Low Light Condition with Bio-inspired LGMD Neural Network

Zhang, Yicheng, Hu, Cheng, Liu, Mei , Luan, Hao, Lei, Fang, Cuayahuitl, Heriberto and Yue, Shigang (2022) Temperature-based Collision Detection in Extreme Low Light Condition with Bio-inspired LGMD Neural Network. In: 2021 2nd International Symposium on Automation, Information and Computing (ISAIC 2021), 03/12/21-06/12/21, Beijing.

Full content URL: https://doi.org/10.1088/1742-6596/2224/1/012004

Documents
Temperature-based Collision Detection in Extreme Low Light Condition with Bio-inspired LGMD Neural Network
Published Open Access manuscript
[img]
[Download]
[img]
Preview
PDF
Zhang_2022_J._Phys.__Conf._Ser._2224_012004.pdf - Whole Document
Available under License Creative Commons Attribution.

1MB
Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive

Abstract

It is an enormous challenge for intelligent vehicles to avoid collision accidents at night because of the extremely poor light conditions. Thermal cameras can capture temperature map at night, even with no light sources and are ideal for collision detection in darkness. However, how to extract collision cues efficiently and effectively from the captured temperature map with limited computing resources is still a key issue to be solved. Recently, a bio-inspired neural network LGMD has been proposed for collision detection successfully, but for daytime and visible light. Whether it can be used for temperature-based collision detection or not remains unknown. In this study, we proposed an improved LGMD-based visual neural network for temperature-based collision detection at extreme light conditions. We show in this study that the insect inspired visual neural network can pick up the expanding temperature differences of approaching objects as long as the temperature difference against its background can be captured by a thermal sensor. Our results demonstrated that the proposed LGMD neural network can detect collisions swiftly based on the thermal modality in darkness; therefore, it can be a critical collision detection algorithm for autonomous vehicles driving at night to avoid fatal collisions with humans, animals, or other vehicles.

Keywords:Collision detection, Lobula giant movement detector (LGMD), thermal infrared image
Subjects:G Mathematical and Computer Sciences > G730 Neural Computing
Divisions:College of Science > School of Computer Science
ID Code:49117
Deposited On:03 May 2022 15:37

Repository Staff Only: item control page