基于数字孪生与强化学习的低空通信路径优化

    Joint optimization of low-altitude communication path based on digital twin and reinforcement learning

    • 无人机在城市低空飞行时,受地面基站天线配置限制及现有低空统计信道模型难以精确刻画复杂多径的影响,常面临通信盲区,需开展面向低空的专用覆盖规划与参数寻优;此外,区别于地面基站工参调优,低空场景还需联合优化空中飞行轨迹。为此,本文提出一种基于交替优化的空地协同通信联合框架:先利用射线追踪与地理信息构建高保真数字孪生环境,提取场景信道冲激响应;再将原问题拆解为两个强耦合子问题——网络侧以信赖域贝叶斯优化搜索基站天线参数与发射功率,无人机侧将三维轨迹决策建模为MDP(马尔可夫决策过程)并用PPO(近端策略优化)求解。TDMA(时分多址)机制下的仿真显示,该框架重构了低空覆盖分布,相较单一轨迹优化平均SINR( 信号与干扰加噪声比)提升约5 dB,明显抑制同频干扰与建筑遮挡。研究改善了低空空域通信连续性,为智慧空地网络部署提供可扩展优化思路。

       

      Abstract: During urban low-altitude UAV flights, communication outages frequently occur because conventional ground BS antenna layouts are suboptimal and existing statistical low-altitude channel models fail to accurately characterize complex multipath propagation. This calls for dedicated low-altitude coverage planning and parameter optimization, where—unlike ground BS engineering-parameter tuning—the aerial trajectory must also be optimized. We propose an alternating-optimization-based joint air–ground communication framework. A high-fidelity digital-twin environment is first built by coupling ray tracing with geographic data to extract scenario-specific channel impulse responses. The joint problem is then decomposed into two coupled subproblems: on the network side, a trust-region Bayesian optimization searches high-dimensional BS antenna parameters and transmit power; on the UAV side, 3D trajectory decision-making is cast as an MDP and solved by PPO. Under a TDMA access scheme, the framework reconstructs the low-altitude coverage distribution: versus trajectory-only optimization, average SINR gains ~5 dB, with noticeable suppression of co-channel interference and building shadowing. The approach improves communication continuity in low-altitude airspace and offers a scalable strategy for smart air–ground network deployment.

       

    /

    返回文章
    返回