Please use this identifier to cite or link to this item:
http://bura.brunel.ac.uk/handle/2438/13465
Title: | The Parallelization of Back Propagation Neural Network in MapReduce and Spark |
Authors: | Liu, Y Xu, L Li, M |
Keywords: | Neural network;MapReduce;Hadoop;HaLoop;Spark;Ensemble technique |
Issue Date: | 2016 |
Publisher: | Springer Verlag |
Citation: | International Journal of Parallel Programming, pp. 1 - 20, (2016) |
Abstract: | Artificial neural network is proved to be an effective algorithm for dealing with recognition, regression and classification tasks. At present a number of neural network implementations have been developed, for example Hamming network, Grossberg network, Hopfield network and so on. Among these implementations, back propagation neural network (BPNN) has become the most popular one due to its sensational function approximation and generalization abilities. However, in the current big data researches, BPNN, as a both data intensive and computational intensive algorithm, its efficiency has been significantly impacted. Therefore, this paper presents a parallel BPNN algorithm based on data separation in three distributed computing environments including Hadoop, HaLoop and Spark. Moreover to improve the algorithm performance in terms of accuracy, ensemble techniques have been employed. The algorithm is firstly evaluated in a small-scale cluster. And then it is further evaluated in a commercial cloud computing environment. The experimental results indicate that the proposed algorithm can improve the efficiency of BPNN with guaranteeing its accuracy. |
URI: | http://bura.brunel.ac.uk/handle/2438/13465 |
DOI: | http://dx.doi.org/10.1007/s10766-016-0401-1 |
ISSN: | 0885-7458 |
Appears in Collections: | Dept of Electronic and Electrical Engineering Research Papers |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Fulltext.docx | 3.22 MB | Unknown | View/Open |
Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.