Backpropagation Algorithm and its Hardware Implementations: A Review

Abstract

Abstract Nowadays, artificial intelligence is gearing up at faster pace. Hardware integration with Artificial Neural Networks (ANN) have paved the way to different applications in areas like control engineering, robotics and navigation. There has been extensive research in the field of machine learning to use the system in advanced applications. The combination of hardware and software modules help to build systems in a robust manner. This paper focuses mainly on back propagation algorithm and its different hardware implementation using FPGA, ASIC, Memristor and Microcontroller. Implementation of back propagation algorithm on Field programmable gate arrays is analysed in detail. FPGAs parallel processing feature makes it unique for neural networks. The parallel processing models implement back propagation algorithms for calculating errors in the hidden layers of neural networks. This review helps the researchers to understand the implementation of various hardware with back propagation algorithm also the comparative analysis on the parameters helps to identify the suitable hardware based on their requirements.