Please use this identifier to cite or link to this item: http://bura.brunel.ac.uk/handle/2438/15546
Title: Optimizing Hadoop Performance for Big Data Analytics in Smart Grid
Authors: Khan, M
Huang, Z
Li, M
Taylor, GA
Ashton, PM
Khan, M
Keywords: configuration parameters;detrended fluctuation analysis;gene expression programming;Hadoop frameworks;open source implementation;phasor measurement unit (PMUs);rapid deployments;MapReduce;smart grid applications
Issue Date: 2017
Publisher: Hindawi Ltd
Citation: Mathematical Problems in Engineering, vol. 2017, Article ID 2198262, 11 pages, 2017
Abstract: The rapid deployment of Phasor Measurement Units (PMUs) in power systems globally is leading to Big Data challenges. New high performance computing techniques are now required to process an ever increasing volume of data fromPMUs. To that extent the Hadoop framework, an open source implementation of theMapReduce computing model, is gaining momentum for Big Data analytics in smart grid applications. However, Hadoop has over 190 configuration parameters, which can have a significant impact on the performance of theHadoop framework.This paper presents an Enhanced Parallel Detrended Fluctuation Analysis (EPDFA) algorithm for scalable analytics on massive volumes of PMU data. The novel EPDFA algorithm builds on an enhanced Hadoop platform whose configuration parameters are optimized by Gene Expression Programming. Experimental results show that the EPDFA is 29 times faster than the sequential DFA in processing PMU data and 1.87 times faster than a parallel DFA, which utilizes the default Hadoop configuration settings.
URI: https://bura.brunel.ac.uk/handle/2438/15546
DOI: https://doi.org/10.1155/2017/2198262
ISSN: 1024-123X
Appears in Collections:Dept of Electronic and Computer Engineering Research Papers

Files in This Item:
File Description SizeFormat 
FullText.pdf632.6 kBAdobe PDFView/Open


Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.