基于多阶段交叉信息融合的多光谱行人检测
DOI:
CSTR:
作者:
作者单位:

1.河北工业大学电子信息工程学院 天津 300401; 2.河北工业大学电子与通信工程国家级实验教学示范中心 天津 300401

作者简介:

通讯作者:

中图分类号:

TP391.41

基金项目:

国家自然科学基金(51977059)、河北省自然科学基金(E2020202042)项目资助


Multi-spectral pedestrian detection based on multistage cross information fusion
Author:
Affiliation:

1.School of Electronics Information Engineering, Hebei University of Technology,Tianjin 300401, China; 2.Electronics and Communication Engineering National Experimental Teaching Demonstration Center, Hebei University of Technology,Tianjin 300401, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对多光谱行人检测中双模态特征融合不充分、特征融合质量低的问题,提出一种基于多阶段交叉信息融合的多光谱行人检测算法。算法首先通过双流骨干网络分别对可见光图像和红外图像进行特征提取;设计交叉信息融合模块并多阶段嵌入双流骨干网络中引导双模态特征融合,实现双模态特征信息的充分融合;引入条件卷积对融合后的特征信息进行动态处理,改善融合信息的质量,最终提升算法的检测性能。实验结果表明,算法的漏检率仅为1041%,较原算法降低了10%,显著提升了算法的检测性能。

    Abstract:

    To solve the problems of insufficient bimodal feature fusion and low quality of feature fusion in multispectral pedestrian detection, a multispectral pedestrian detection algorithm based on multistage cross information fusion is proposed. Firstly, the algorithm extracts the features of visible and infrared images through the dual stream backbone network; The cross information fusion module is designed and embedded in the dual stream backbone network in multiple stages to guide the bimodal feature fusion, so as to achieve full fusion of bimodal feature information; Conditional convolution is introduced to dynamically process the fused feature information to improve the quality of the fused information and ultimately improve the detection performance of the algorithm. Experimental results show that the missing rate of the algorithm is only 1041%, which is 10% lower than the original algorithm, and the detection performance of the algorithm is significantly improved.

    参考文献
    相似文献
    引证文献
引用本文

孙昆,武一,牛雅睿,卢昊,赵普.基于多阶段交叉信息融合的多光谱行人检测[J].电子测量技术,2023,46(15):118-125

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-01-08
  • 出版日期:
文章二维码