Omslagsbillede

Lyapunov-Based Deep Deterministic Policy Gradient for Energy-Efficient Task Offloading in UAV-Assisted MEC

Guardado en:
Udgivet i:Drones vol. 9, no. 9 (2025), p. 653-683
Hovedforfatter: Liu, Jianhua
Andre forfattere: Zhang, Xudong, Zhou, Haitao, Xia, Lei, Li, Huiru, Wang, Xiaofan
Udgivet:
MDPI AG
Fag:
Control theory
Robust control
Internet of Things
Optimization
Edge computing
Resource allocation
Mobile computing
Unmanned aerial vehicles
Systems stability
Queuing theory
Energy consumption
Mathematical programming
Cloud computing
Network latency
Computation offloading
Algorithms
Quality of service
Linear programming
Paradigms
Resource management
Online adgang:Citation/Abstract
Full Text + Graphics
Full Text - PDF
Tags: Tilføj Tag
Ingen Tags, Vær først til at tagge denne postø!
Resumen:The demand for low-latency computing from the Internet of Things (IoT) and emerging applications challenges traditional cloud computing. Mobile Edge Computing (MEC) offers a solution by deploying resources at the network edge, yet terrestrial deployments face limitations. Unmanned Aerial Vehicles (UAVs), leveraging their high mobility and flexibility, provide dynamic computation offloading for User Equipments (UEs), especially in areas with poor infrastructure or network congestion. However, UAV-assisted MEC confronts significant challenges, including time-varying wireless channels and the inherent energy constraints of UAVs. We put forward the Lyapunov-based Deep Deterministic Policy Gradient (LyDDPG), a novel computation offloading algorithm. This algorithm innovatively integrates Lyapunov optimization with the Deep Deterministic Policy Gradient (DDPG) method. Lyapunov optimization transforms the long-term, stochastic energy minimization problem into a series of tractable, per-timeslot deterministic subproblems. Subsequently, DDPG is utilized to solve these subproblems by learning a model-free policy through environmental interaction. This policy maps system states to optimal continuous offloading and resource allocation decisions, aiming to minimize the Lyapunov-derived “drift-plus-penalty” term. The simulation outcomes indicate that, compared to several baseline and leading algorithms, the proposed LyDDPG algorithm reduces the total system energy consumption by at least 16% while simultaneously maintaining low task latency and ensuring system stability.
ISSN:2504-446X
DOI:10.3390/drones9090653
Fuente:Advanced Technologies & Aerospace Database