Task Offloading in MEC-Aided Satellite-Terrestrial Networks: A Reinforcement Learning Approach

摘要

Network-enabled robots have become important to support future machine-assisted and unmanned applications. To provide high-quality services for wide-area robots, hybrid satellite-terrestrial networks are a key technology. Via hybrid networks, computation-intensive and latency-sensitive tasks of robots can be offloaded to mobile edge computing (MEC) servers. However, due to the mobility of mobile robots and unreliable wireless network environments, excessive local computations and frequent service migrations may significantly increase the service delay. To address this issue, this paper aims to minimize the average task completion time for MEC-based offloading for satellite-terrestrial-network-enabled robots. Different from conventional mobility-aware schemes, the proposed scheme is to make the offloading decision by jointly considering the mobility control of robots. A joint optimization problem of task offloading and velocity control is formulated. Using Lyapunov optimization, the original optimization is decomposed into a velocity control subproblem and a task offloading subproblem. Then, based on the Markov decision process (MDP), a dual-agent reinforcement learning (RL) algorithm is proposed. Simulation results show that the proposed scheme can effectively reduce the service delay.