FPGA-Based Real-Time Road Object Detection System Using mmWave Radar

Abstract

This letter presents the development of a real-time object detection system using frequency modulated continuous wave millimeter-wave (mmWave) radar signals and the python productivity for zynq ultrascale + mpsocs (PYNQ-ZU) field-programmable gate array (FPGA) board, which is widely used in advanced driving assistance system and robotic applications. A hardware FPGA platform serves as a valid embedded architecture for the purpose of validating object detection and recognition applications. We used our experiment's point cloud images to apply different machine learning models to detect these objects. Using a top-view (TV) filter to convert 3-D point cloud images into 2-D representations made object detection more accurate. Following the use of filtration techniques, we extracted features from the filtered 2-D image using the visual geometry group (VGG) 16 model. We then assessed four machine learning models for object detection and found that the support vector machine (SVM) model and logistic regression (LR) had better results, obtaining an accuracy of 97%. Our proposed work uses mmWave radar, TV filter, VGG 16 Model, and LR to highly increase object detection accuracy over existing methods.