Please use this identifier to cite or link to this item: http://bura.brunel.ac.uk/handle/2438/13465
Title: The Parallelization of Back Propagation Neural Network in MapReduce and Spark
Authors: Liu, Y
Xu, L
Li, M
Keywords: Neural network;MapReduce;Hadoop;HaLoop;Spark;Ensemble technique
Issue Date: 2016
Publisher: Springer Verlag
Citation: International Journal of Parallel Programming, pp. 1 - 20, (2016)
Abstract: Artificial neural network is proved to be an effective algorithm for dealing with recognition, regression and classification tasks. At present a number of neural network implementations have been developed, for example Hamming network, Grossberg network, Hopfield network and so on. Among these implementations, back propagation neural network (BPNN) has become the most popular one due to its sensational function approximation and generalization abilities. However, in the current big data researches, BPNN, as a both data intensive and computational intensive algorithm, its efficiency has been significantly impacted. Therefore, this paper presents a parallel BPNN algorithm based on data separation in three distributed computing environments including Hadoop, HaLoop and Spark. Moreover to improve the algorithm performance in terms of accuracy, ensemble techniques have been employed. The algorithm is firstly evaluated in a small-scale cluster. And then it is further evaluated in a commercial cloud computing environment. The experimental results indicate that the proposed algorithm can improve the efficiency of BPNN with guaranteeing its accuracy.
URI: http://bura.brunel.ac.uk/handle/2438/13465
DOI: http://dx.doi.org/10.1007/s10766-016-0401-1
ISSN: 0885-7458
Appears in Collections:Dept of Electronic and Electrical Engineering Research Papers

Files in This Item:
File Description SizeFormat 
Fulltext.docx3.22 MBUnknownView/Open


Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.