Reinforcing the Edge: Autonomous Energy Management for Mobile Device Clouds

Balasubramanian, Venkatraman
Zaman, Faisal
Aloqaily, Moayad
Alrabaee, Saed
Gorlatova, Maria
Reisslein, Martin
Journal Title
Journal ISSN
Volume Title
Institute of Electrical and Electronics Engineers Inc.
The collaboration among mobile devices to form an edge cloud for sharing computation and data can drastically reduce the tasks that need to be transmitted to the cloud. Moreover, reinforcement learning (RL) research has recently begun to intersect with edge computing to reduce the amount of data (and tasks) that needs to be transmitted over the network. For battery-powered Internet of Things (IoT) devices, the energy consumption in collaborating edge devices emerges as an important problem. To address this problem, we propose an RL-based Droplet framework for autonomous energy management. Droplet learns the power-related statistics of the devices and forms a reliable group of resources for providing a computation environment on-the-fly. We compare the energy reductions achieved by two different state-of-the-art RL algorithms. Further, we model a reward strategy for edge devices that participate in the mobile device cloud service. The proposed strategy effectively achieves a 10% gain in the rewards earned compared to state-of-the-art strategies. © 2019 IEEE.
This conference paper is not available at CUD collection. The version of scholarly record of this conference paper is published in IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) (2019), available online at:
Device Clouds, Internet of Things, Mobile Edge Computing, Reinforcement Learning
Balasubramanian, V., Zaman, F., Aloqaily, M., Alrabaee, S., Gorlatova, M., & Reisslein, M. (2019). Reinforcing the edge: Autonomous energy management for mobile device clouds. Paper presented at the INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019, 44-49.