An Efficient and Load Balanced Task Offloading in Vehicular Internet of things

Document Type : Original Article

Authors

1 Department of Computer Engineering, Yasouj University, Yasouj, Iran.

2 Department of Midwifery, School of Medicine, Yasouj University of Medical Sciences, Yasouj, Iran.

3 Department of Electrical Engineering, Faculty of Technology and Engineering, Adiban Institute of Higher Education, Garmsar, Iran.

Abstract

In Vehicular Internet of Things (VIoTs) a vehicle with shortage of computation resource can offload its task to other vehicles or edge server with surplus resources. However, the dynamic environment of VIoT causes an insurmountable situation, in which the task offloading requirements cannot be guaranteed. Therefore, in this paper we proposed a method named Vehicular Internet of Things Task Offloading (VIoT-TO) that divides the network to a cellular structure and by applying a reinforcement learning approach, learn how and where to find a near and idle task server in the area of network. In our method, computation resources from both edge servers and peer vehicles were utilized to perform a task. The reward parameter in learning algorithm was tuned to fairly distribute the load between different task servers. Furthermore, the setting of reward parameters leads to preference for short distance task server over the long haul. By doing this, the task offloading delay can be manageable and consequently the tasks can be performed in appropriate time. To solve the applied reinforcement learning approach, a Q-learning algorithm was utilized and parameters of Markov decision process were determined. Finally, we evaluated our method and compared it against rival methods. The evaluation revealed the superiority of proposed method in term of task offloading delay, load balancing index, and task completion ratio.

Keywords


Du, Z., Wu, C., Yoshinaga, T., Yau, K.-L. A., Ji, Y., & Li, J. (2020). Federated learning for vehicular Internet of Things: Recent advances and open issues. IEEE Computer Graphics and Applications. doi:10.1109/OJCS.2020.2992630
Ahmed, M., Raza, S., Mirza, M. A., Aziz, A., Khan, M. A., Khan, W. U., … Han, Z. (2022a). A survey on vehicular task offloading: Classification, issues, and challenges. Journal of King Saud University - Computer and Information Sciences. doi:10.1016/j.jksuci.2022.05.016
Uhlemann, E. (2016). Connected-vehicles applications are emerging [connected vehicles]. IEEE vehicular technology magazine, 11(1), 25–96. doi:10.1109/mvt.2015.2508322
Singh, P. K., Nandi, S. K., & Nandi, S. (2019). A tutorial survey on vehicular communication state of the art, and future research directions. Vehicular Communications. 18. doi:10.1016/j.vehcom.2019.100164
Boukerche, A., & Soto, V. (2020). Computation Offloading and Retrieval for Vehicular Edge Computing: Algorithms, Models, and Classification. ACM Comput. Surv, 53(4). doi:10.1145/3392064
Ravaei, B., Rahimizadeh, K., & Dehghani, A. (2021). Intelligent and hierarchical message delivery mechanism in vehicular delay tolerant networks. Telecommunication Systems. 78, 65–83. doi:10.1007/s11235-021-00801-1
Ahmed, M., Raza, S., Mirza, M. A., Aziz, A., Khan, M. A., Khan, W. U., … Han, Z. (2022b). A survey on vehicular task offloading: Classification, issues, and challenges. Journal of King Saud University - Computer and Information Sciences. doi:10.1016/j.jksuci.2022.05.016
Sun, Y., Zhou, S., & Niu, Z. (2021). Distributed task replication for vehicular edge computing: Performance analysis and learning-based algorithm. IEEE transactions on wireless communications, 20(2), 1138–1151. doi:10.1109/twc.2020.3030889
Alghamdi, I., Anagnostopoulos, C., & Pezaros, D. P. (2021). Data quality-aware task offloading in Mobile Edge Computing: An Optimal Stopping Theory approach. Future Generation Computer Systems. 117, 462–479. doi:10.1016/j.future.2020.12.017
Dai, P., Hu, K., Wu, X., Xing, H., & Yu, Z. (2021). Asynchronous deep reinforcement learning for data-driven task offloading in MEC-empowered vehicular networks. IEEE INFOCOM 2021 - IEEE Conference on Computer Communications. Vancouver, BC, Canada. doi:10.1109/infocom42981.2021.9488886
Sun, Y., Guo, X., Song, J., Zhou, S., Jiang, Z., Liu, X., & Niu, Z. (2019). Adaptive learning-based task offloading for vehicular edge computing systems. IEEE transactions on vehicular technology, 68(4), 3061–3074. doi:10.1109/tvt.2019.2895593
Sutton, R. S., & Barto, A. G. (2012). An Reinforcement Learning: Introduction. Mit Press.
Zhou, S., Sun, Y., Jiang, Z., & Niu, Z. (2019). Exploiting moving intelligence: Delay-optimized computation offloading in vehicular fog networks. IEEE communications magazine, 57(5), 49–55. doi:10.1109/mcom.2019.1800230