A Reinforcement Learning-based Approach to in-Pool Memory Allocation for Distributed Heterogeneous Memory Pools
Saved in:
| Published in: | The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Conference Proceedings (2024), p. 1477-1481 |
|---|---|
| Main Author: | |
| Other Authors: | , , , , , |
| Published: |
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
|
| Subjects: | |
| Online Access: | Citation/Abstract |
| Tags: |
No Tags, Be the first to tag this record!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 3246361044 | ||
| 003 | UK-CbPIL | ||
| 024 | 7 | |a 10.1109/MCTE62870.2024.11118263 |2 doi | |
| 035 | |a 3246361044 | ||
| 045 | 2 | |b d20240101 |b d20241231 | |
| 084 | |a 228229 |2 nlm | ||
| 100 | 1 | |a Guo, Qi |u Electric Power Research Institute, China Southern Power Grid,State Key Laboratory of HVDC,China | |
| 245 | 1 | |a A Reinforcement Learning-based Approach to in-Pool Memory Allocation for Distributed Heterogeneous Memory Pools | |
| 260 | |b The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |c 2024 | ||
| 513 | |a Conference Proceedings | ||
| 520 | 3 | |a Conference Title: 2024 7th International Conference on Mechatronics and Computer Technology Engineering (MCTE)Conference Start Date: 2024 Aug. 23Conference End Date: 2024 Aug. 25Conference Location: Guangzhou, ChinaThe conventional memory allocation method in distributed heterogeneous memory pool mainly uses the Spark Shuffle skew tuning execution algorithm to calculate the allocation parameters, which is vulnerable to changes in temporary storage task nodes, resulting in excessive memory overflow in the pool. Therefore, a memory allocation method in distributed heterogeneous memory pool using reinforcement learning is proposed. That is, the memory allocation manager in the distributed heterogeneous memory pool is designed by using reinforcement learning, and the memory transmission optimization mechanism in the distributed heterogeneous memory pool is generated, thus realizing the memory allocation in the heterogeneous memory pool. The experimental results show that after using the memory allocation method in the distributed heterogeneous memory pool reinforcement learning pool designed in this paper, the memory overflow in the pool under different types of memory pools is low, which proves that the designed memory allocation method has good allocation effect, high efficiency, and certain application value, and has made certain contributions to improving the quality of distributed heterogeneous storage. | |
| 653 | |a Overflow | ||
| 653 | |a Distributed memory | ||
| 653 | |a Memory management | ||
| 653 | |a Economic | ||
| 700 | 1 | |a Guo, Haiping |u Electric Power Research Institute, China Southern Power Grid,State Key Laboratory of HVDC,China | |
| 700 | 1 | |a Guo, Tianyu |u Electric Power Research Institute, China Southern Power Grid,State Key Laboratory of HVDC,China | |
| 700 | 1 | |a Lu, Yuanhong |u Electric Power Research Institute, China Southern Power Grid,State Key Laboratory of HVDC,China | |
| 700 | 1 | |a Zhang, Jie |u Electric Power Research Institute, China Southern Power Grid,State Key Laboratory of HVDC,China | |
| 700 | 1 | |a Huang, Libin |u Electric Power Research Institute, China Southern Power Grid,State Key Laboratory of HVDC,China | |
| 700 | 1 | |a Hu, Binjiang |u Electric Power Research Institute, China Southern Power Grid,State Key Laboratory of HVDC,China | |
| 773 | 0 | |t The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Conference Proceedings |g (2024), p. 1477-1481 | |
| 786 | 0 | |d ProQuest |t Science Database | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/3246361044/abstract/embedded/7BTGNMKEMPT1V9Z2?source=fedsrch |