Towards a scalable and energy-efficient resource manager for coupling cluster computing with distributed embedded computing
Guardado en:
| Publicado en: | Cluster Computing vol. 20, no. 4 (Dec 2017), p. 3707 |
|---|---|
| Autor principal: | |
| Otros Autores: | , , |
| Publicado: |
Springer Nature B.V.
|
| Materias: | |
| Acceso en línea: | Citation/Abstract Full Text Full Text - PDF |
| Etiquetas: |
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 2918220521 | ||
| 003 | UK-CbPIL | ||
| 022 | |a 1386-7857 | ||
| 022 | |a 1573-7543 | ||
| 024 | 7 | |a 10.1007/s10586-017-0936-y |2 doi | |
| 035 | |a 2918220521 | ||
| 045 | 2 | |b d20171201 |b d20171231 | |
| 100 | 1 | |a Zhang, Heng |u Chinese Academy of Sciences, Institute of Software, Beijing, China (GRID:grid.9227.e) (ISNI:0000000119573309); University of Chinese Academy of Sciences, Beijing, China (GRID:grid.410726.6) (ISNI:0000 0004 1797 8419) | |
| 245 | 1 | |a Towards a scalable and energy-efficient resource manager for coupling cluster computing with distributed embedded computing | |
| 260 | |b Springer Nature B.V. |c Dec 2017 | ||
| 513 | |a Journal Article | ||
| 520 | 3 | |a Microservers (MSs, ARM-based mobile devices) with built-in sensors and network connectivity have become increasingly pervasive and their computational capabilities continue to be improved. Many works present that the heterogeneous clusters, consist of the low-power MSs and high-performance nodes (x86-based servers), can provide competitive performance and energy efficiency. However, they make simple modifications in existing distributed computing systems for adaptation, which have been proven not to fully exploit the various heterogeneous resources. In this paper, we argue that these heterogeneous clusters also call for flexible and efficient computational resource sharing and scheduling. We then present Aries, a platform to support abstracting, sharing and scheduling the cluster resources, scaling from embedded devices to high performance servers, between multiple distributed computing frameworks (Hadoop, Spark, etc.). In Aries, we propose a two-layer scheduling mechanism to enhance the resource utilization of these heterogeneous clusters. Specifically, the resource abstraction layer in Aries is constructed for overall coordination of resources, which provide computation and energy management. A hybrid resource abstraction approach is designed to manage HS and MS resources in fine and coarse granularity separately in this layer to support efficient resource offer based on “resource slot”. And the task schedule layer supports various sophisticated schedulers of existing distributed frameworks and decides how many resources to offer computing frameworks. Furthermore, Aries adopts a novel strategy to support smart switch in three system models for energy-saving effectiveness. We evaluate Aries by a variety of typical data center workloads and datasets, and the result shows that Aries can achieve more efficient utilization of resources when sharing the heterogeneous cluster among diverse frameworks. | |
| 653 | |a Energy management | ||
| 653 | |a Machine learning | ||
| 653 | |a Big Data | ||
| 653 | |a Computer centers | ||
| 653 | |a Servers | ||
| 653 | |a Electronic devices | ||
| 653 | |a Employment | ||
| 653 | |a Resource scheduling | ||
| 653 | |a Data processing | ||
| 653 | |a Energy efficiency | ||
| 653 | |a Embedded systems | ||
| 653 | |a Algorithms | ||
| 653 | |a Clusters | ||
| 653 | |a Resource utilization | ||
| 653 | |a Energy consumption | ||
| 653 | |a Internet of Things | ||
| 653 | |a Distributed processing | ||
| 653 | |a Computer networks | ||
| 700 | 1 | |a Hao, Chunliang |u Chinese Academy of Sciences, Institute of Software, Beijing, China (GRID:grid.9227.e) (ISNI:0000000119573309); University of Chinese Academy of Sciences, Beijing, China (GRID:grid.410726.6) (ISNI:0000 0004 1797 8419) | |
| 700 | 1 | |a Wu, Yanjun |u Chinese Academy of Sciences, Institute of Software, Beijing, China (GRID:grid.9227.e) (ISNI:0000000119573309) | |
| 700 | 1 | |a Li, Mingshu |u Chinese Academy of Sciences, Institute of Software, Beijing, China (GRID:grid.9227.e) (ISNI:0000000119573309) | |
| 773 | 0 | |t Cluster Computing |g vol. 20, no. 4 (Dec 2017), p. 3707 | |
| 786 | 0 | |d ProQuest |t Advanced Technologies & Aerospace Database | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/2918220521/abstract/embedded/ZKJTFFSVAI7CB62C?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text |u https://www.proquest.com/docview/2918220521/fulltext/embedded/ZKJTFFSVAI7CB62C?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text - PDF |u https://www.proquest.com/docview/2918220521/fulltextPDF/embedded/ZKJTFFSVAI7CB62C?source=fedsrch |