FPGA-based CNN for Real-time UAV Tracking and Detection

Hobden, Peter, Srivastava, Saket and Nurellari, Edmond (2022) FPGA-based CNN for Real-time UAV Tracking and Detection. Frontiers in Space Technologies, 3 . p. 878010. ISSN 2673-5075

Full content URL: https://doi.org/10.3389/frspt.2022.878010

FPGA-based CNN for Real-time UAV Tracking and Detection
Published Open Access manuscript
frspt-03-878010.pdf - Whole Document
Available under License Creative Commons Attribution 4.0 International.

Item Type:Article
Item Status:Live Archive


Neural Networks (NNs) are now being extensively utilised in various Artificial Intelligence platforms specifically in the area of image classification and real-time object tracking. We propose a novel design to address the problem of real time Unmanned Aerial Vehicle (UAV) monitoring and detection using a Zynq Ultrascale FPGA-based Convolutional Neural Network
(CNN) implementation. The biggest challenge while implementing real-time algorithms on FPGAs is the limited DSP hardware resources available on FPGA platforms. Our proposed design overcomes the challenge of autonomous real time UAV detection and tracking on a Xilinx's Zynq Ultrascale XCZU9EG System on a Chip (SoC) platform. Our proposed design explores and provides a solution for overcoming the challenge of limited floating-point resources, whilst maintaining real-time performance. The solution consists of two modules: the UAV tracking and the neural network based UAV detection module. The tracking module uses our novel background-differencing algorithm whilst the UAV detection is based on a modified CNN algorithm, designed to give the maximum Field-Programmable Gate Array (FPGA) performance. These two modules are designed to complement each other and are enabled simultaneously to provide an enhanced real-time UAV detection for any given video input. The proposed system has been tested on detecting real-life flying UAVs, achieving an accuracy of 82\%, running at the full frame rate of the input camera for both tracking and Neural Network (NN) detection, achieving similar performance than an equivalent Deep Learning Processor Unit (DPU) Ultrascale FPGA based HD video and tracking implementation, but with lower resource utilisation as shown by our results.

Keywords:Unmanned aircraft system, Unmanned aerial vehicles (UAV), Xilinx FPGA, Optical systems, CNN, Field programmable gate arrays (FPGA), FPGA, monitoring, detection, Drone
Subjects:G Mathematical and Computer Sciences > G760 Machine Learning
G Mathematical and Computer Sciences > G400 Computer Science
H Engineering > H690 Electronic and Electrical Engineering not elsewhere classified
H Engineering > H600 Electronic and Electrical Engineering
H Engineering > H610 Electronic Engineering
Divisions:College of Science > School of Engineering
Related URLs:
ID Code:49993
Deposited On:01 Jul 2022 14:30

Repository Staff Only: item control page