一种密集无人机网络下行发射功率控制算法研究
DOI:
CSTR:
作者:
作者单位:

公安部第一研究所,北京,100048

作者简介:

通讯作者:

中图分类号:

TN929.5

基金项目:

北京市教委项目(2018Z004-005-KWY)资助


Downlink Transmit Power Control in Dense UAV Network Based on Mean Field Game and Deep Reinforcement Learning
Author:
Affiliation:

The First Research Institute of the Ministry of Public Security, Beijing, 100048

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为解决密集无人机网络的下行功率控制问题,降低无人机的相互干扰、提高系统能量效率,提出了一种密集无人机网络下行发射功率控制算法。首先,将无人机网络的功率控制问题建模为高维系统状态下的平均场博弈论模型,降低无人机间的相互干扰;其次,将平均场博弈论模型转化为马尔可夫决策过程,以得到无人机密集部署下的均衡解;另外,提出了一种基于深度强化学习的平均场博弈论算法,通过使用深度神经网络获取系统的最优功率控制策略,从而最大化系统能量效率。最后,通过仿真分析将所提方法与其他三种算法进行对比分析。实验结果表明,所提方法能够使无人机与环境进行有效交互,有效降低无人机的相互干扰,增强系统网络通信性能;同时,与其他三种方法相比,所提方法的收敛速度更快、能量效率更高,具有良好的收敛性与可靠性。

    Abstract:

    To solve the problem of downlink power control of dense UAV networks, reduce the mutual interference of UAVs and improve the energy efficiency of the system, a downlink transmit power control algorithm for dense UAV networks is proposed. First, convert the power control problem of the UAV network into a mean field game theory model in a high-dimensional system state to reduce the mutual interference between UAVs.Second, convert the mean field game theory model into a Markov decision process, in order to obtain the equilibrium solution under the dense deployment of UAVs.In addition, a mean field game theory algorithm based on deep reinforcement learning is proposed, which obtains the optimal power control strategy of the system by using a deep neural network to maximize the energy efficiency of the system.Finally, the proposed method is compared with the other three algorithms through simulation analysis. The experimental results show that the proposed method can effectively interact between drones and the environment, effectively reduce the mutual interference of drones, and enhance the system network communication performance; at the same time, compared with the other three methods, the proposed method has a faster convergence Faster, more energy efficient, with good convergence and reliability.

    参考文献
    相似文献
    引证文献
引用本文

王庆,黄勇,常晶.一种密集无人机网络下行发射功率控制算法研究[J].电子测量技术,2021,44(13):59-67

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-09-05
  • 出版日期:
文章二维码