Design and Implementation of a Simulator for the Application of Cooperative Multi-Agent Systems in Naval Battle Environments 


Vol. 49,  No. 1, pp. 165-176, Jan.  2024
10.7840/kics.2024.49.1.165


PDF
  Abstract

With the recent changes in the technology and industrial system of the 4th Industrial Revolution, research on innovative future unmanned systems continues to increase in the marine defense industry sector. There is a great interest in multi-agent cluster control systems in unmanned systems. In the case of multi-agent cluster control systems, there are usually many complex and dynamic problems, so reinforcement learning algorithms are effective to solve these problems. However, there is a deficiency in simulators for verifying multi-agent algorithms in a realistic naval battle environment. Therefore, this study proposes a simulator based on cooperative scenarios of Unmanned Surface Vehicles (USVs) utilizing the MA-POCA (Multi-Agent Posthumous Credit Assignment) reinforcement learning algorithm. Implemented simulator is utilized to compare the learning performance of various multi-agent algorithms through combat tests with simulated adversaries, specifically rule based USVs.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Related Articles
  Cite this article

[IEEE Style]

K. Kim, S. Moon, W. Jin, H. Lee, "Design and Implementation of a Simulator for the Application of Cooperative Multi-Agent Systems in Naval Battle Environments," The Journal of Korean Institute of Communications and Information Sciences, vol. 49, no. 1, pp. 165-176, 2024. DOI: 10.7840/kics.2024.49.1.165.

[ACM Style]

Kyungbeom Kim, Sujeong Moon, Woobeen Jin, and Hyukjoon Lee. 2024. Design and Implementation of a Simulator for the Application of Cooperative Multi-Agent Systems in Naval Battle Environments. The Journal of Korean Institute of Communications and Information Sciences, 49, 1, (2024), 165-176. DOI: 10.7840/kics.2024.49.1.165.

[KICS Style]

Kyungbeom Kim, Sujeong Moon, Woobeen Jin, Hyukjoon Lee, "Design and Implementation of a Simulator for the Application of Cooperative Multi-Agent Systems in Naval Battle Environments," The Journal of Korean Institute of Communications and Information Sciences, vol. 49, no. 1, pp. 165-176, 1. 2024. (https://doi.org/10.7840/kics.2024.49.1.165)
Vol. 49, No. 1 Index