Please use this identifier to cite or link to this item: http://bura.brunel.ac.uk/handle/2438/13466
Title: gSched: A resource aware Hadoop scheduler for heterogeneous cloud computing environments
Authors: Caruana, G
Li, M
Qi, M
Khan, M
Rana, O
Keywords: MapReduce;Task Scheduling;Resource Awareness;Cloud Computing;Cost Effective Computing
Issue Date: 2016
Publisher: Wiley
Citation: Concurrency Computation, (2016)
Abstract: MapReduce has become a major programming model for data-intensive applications in cloud computing environments. Hadoop, an open source implementation of MapReduce, has been adopted by an increasingly wide user community. However, Hadoop suffers from task scheduling performance degradation in heterogeneous contexts because of its homogeneous design focus. This paper presents gSched, a resource-aware Hadoop scheduler that takes into account both the heterogeneity of computing resources and provisioning charges in task allocation in cloud computing environments. gSched is initially evaluated in an experimental Hadoop cluster and demonstrates enhanced performance compared with the default Hadoop scheduler. Further evaluations are conducted on the Amazon EC2 cloud that demonstrates the effectiveness of gSched in task allocation in heterogeneous cloud computing environments.
URI: http://bura.brunel.ac.uk/handle/2438/13466
DOI: http://dx.doi.org/10.1002/cpe.3841
ISSN: 1532-0626
1532-0634
Appears in Collections:Dept of Electronic and Computer Engineering Research Papers

Files in This Item:
File Description SizeFormat 
Fulltext.docx695.97 kBUnknownView/Open


Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.