Please use this identifier to cite or link to this item:
http://bura.brunel.ac.uk/handle/2438/13466
Title: | gSched: A resource aware Hadoop scheduler for heterogeneous cloud computing environments |
Authors: | Caruana, G Li, M Qi, M Khan, M Rana, O |
Keywords: | MapReduce;Task Scheduling;Resource Awareness;Cloud Computing;Cost Effective Computing |
Issue Date: | 2016 |
Publisher: | Wiley |
Citation: | Concurrency Computation, (2016) |
Abstract: | MapReduce has become a major programming model for data-intensive applications in cloud computing environments. Hadoop, an open source implementation of MapReduce, has been adopted by an increasingly wide user community. However, Hadoop suffers from task scheduling performance degradation in heterogeneous contexts because of its homogeneous design focus. This paper presents gSched, a resource-aware Hadoop scheduler that takes into account both the heterogeneity of computing resources and provisioning charges in task allocation in cloud computing environments. gSched is initially evaluated in an experimental Hadoop cluster and demonstrates enhanced performance compared with the default Hadoop scheduler. Further evaluations are conducted on the Amazon EC2 cloud that demonstrates the effectiveness of gSched in task allocation in heterogeneous cloud computing environments. |
URI: | http://bura.brunel.ac.uk/handle/2438/13466 |
DOI: | http://dx.doi.org/10.1002/cpe.3841 |
ISSN: | 1532-0626 1532-0634 |
Appears in Collections: | Dept of Electronic and Electrical Engineering Research Papers |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Fulltext.docx | 695.97 kB | Unknown | View/Open |
Items in BURA are protected by copyright, with all rights reserved, unless otherwise indicated.