Balasubramanian, VenkatramanZaman, FaisalAloqaily, MoayadAlrabaee, SaedGorlatova, MariaReisslein, Martin2021-11-182021-11-18© 20192019Balasubramanian, V., Zaman, F., Aloqaily, M., Alrabaee, S., Gorlatova, M., & Reisslein, M. (2019). Reinforcing the edge: Autonomous energy management for mobile device clouds. Paper presented at the INFOCOM 2019 - IEEE Conference on Computer Communications Workshops, INFOCOM WKSHPS 2019, 44-49. https://doi.org/10.1109/INFCOMW.2019.8845263978-172811878-9http://hdl.handle.net/20.500.12519/467This conference paper is not available at CUD collection. The version of scholarly record of this conference paper is published in IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) (2019), available online at: https://doi.org/10.1109/INFCOMW.2019.8845263The collaboration among mobile devices to form an edge cloud for sharing computation and data can drastically reduce the tasks that need to be transmitted to the cloud. Moreover, reinforcement learning (RL) research has recently begun to intersect with edge computing to reduce the amount of data (and tasks) that needs to be transmitted over the network. For battery-powered Internet of Things (IoT) devices, the energy consumption in collaborating edge devices emerges as an important problem. To address this problem, we propose an RL-based Droplet framework for autonomous energy management. Droplet learns the power-related statistics of the devices and forms a reliable group of resources for providing a computation environment on-the-fly. We compare the energy reductions achieved by two different state-of-the-art RL algorithms. Further, we model a reward strategy for edge devices that participate in the mobile device cloud service. The proposed strategy effectively achieves a 10% gain in the rewards earned compared to state-of-the-art strategies. © 2019 IEEE.enPermission to reuse abstract has been secured from Institute of Electrical and Electronics Engineers Inc.Device CloudsInternet of ThingsMobile Edge ComputingReinforcement LearningReinforcing the Edge: Autonomous Energy Management for Mobile Device CloudsConference PaperCopyright : © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.