Best Papers
 Reinforcement Learning-Based Scheduler with Dynamic Precedence in Deterministic Networks 


Vol. 48,  No. 4, pp. 413-422, Apr.  2023
10.7840/kics.2023.48.4.413


PDF Full-Text
  Abstract

Smart industry, metaverse, digital-twin, and military applications require deterministic data delivery in large scale networks. This paper proposes reinforcement learning-based scheduling that assigns dynamically different precedences to the flows, in addition to the flow's class or priority, and determines the scheduling algorithm according to the flow's precedence. In the proposed reinforcement learning-based scheduling algorithm with two precedence queues, the reinforcement learning agent takes two actions that assigns the precedence of flows according to a specified criterion and selects a scheduling algorithm. Depending on the purpose of the network, any factor with high importance could be a criterion for determining the precedence. In this study, the deadline required by the flow is designated as the major factor for precedence decision. By utilizing DDQN (Double Deep Q-Network), a deep learning-based reinforcement learning model, the precedence and the scheduling algorithm are determined by observing the state of the network and selecting an action at each decision period with a fixed length. In the network simulator developed for the study, it was confirmed that the DDQN agent showed better performance than various heuristic algorithms.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Related Articles
  Cite this article

[IEEE Style]

JihyeRyu, GyudongPark, JuhyeokKwon, JinooJoung, "Reinforcement Learning-Based Scheduler with Dynamic Precedence in Deterministic Networks," The Journal of Korean Institute of Communications and Information Sciences, vol. 48, no. 4, pp. 413-422, 2023. DOI: 10.7840/kics.2023.48.4.413.

[ACM Style]

JihyeRyu, GyudongPark, JuhyeokKwon, and JinooJoung. 2023. Reinforcement Learning-Based Scheduler with Dynamic Precedence in Deterministic Networks. The Journal of Korean Institute of Communications and Information Sciences, 48, 4, (2023), 413-422. DOI: 10.7840/kics.2023.48.4.413.

[KICS Style]

JihyeRyu, GyudongPark, JuhyeokKwon, JinooJoung, "Reinforcement Learning-Based Scheduler with Dynamic Precedence in Deterministic Networks," The Journal of Korean Institute of Communications and Information Sciences, vol. 48, no. 4, pp. 413-422, 4. 2023. (https://doi.org/10.7840/kics.2023.48.4.413)
Vol. 48, No. 4 Index