[1]赵文清,康怿瑾,赵振兵,等.改进YOLOv5s的遥感图像目标检测[J].智能系统学报,2023,18(1):86-95.[doi:10.11992/tis.202203013]
ZHAO Wenqing,KANG Yijin,ZHAO Zhenbing,et al.A remote sensing image object detection algorithm with improved YOLOv5s[J].CAAI Transactions on Intelligent Systems,2023,18(1):86-95.[doi:10.11992/tis.202203013]
点击复制
ZHAO Wenqing,KANG Yijin,ZHAO Zhenbing,et al.A remote sensing image object detection algorithm with improved YOLOv5s[J].CAAI Transactions on Intelligent Systems,2023,18(1):86-95.[doi:10.11992/tis.202203013]
改进YOLOv5s的遥感图像目标检测
《智能系统学报》[ISSN 1673-4785/CN 23-1538/TP] 卷:
18
期数:
2023年第1期
页码:
86-95
栏目:
学术论文—智能系统
出版日期:
2023-01-05
- Title:
- A remote sensing image object detection algorithm with improved YOLOv5s
- Keywords:
- remote sensing images; objects of interest; object detection; feature extraction; efficient channel attention structure; multiscale feature fusion; contextual information; Swin Transformer; coordinate attention mechanism
- 分类号:
- TP751;TP391
- 摘要:
- 针对遥感图像中感兴趣目标特征不明显、背景信息复杂、小目标居多导致的目标检测精度较低的问题，本文提出了一种改进YOLOv5s的遥感图像目标检测算法（Swin-YOLOv5s）。首先，在骨干特征提取网络的卷积块中加入轻量级通道注意力结构，抑制无关信息的干扰；其次，在多尺度特征融合的基础上进行跨尺度连接和上下文信息加权操作来加强待检测目标的特征提取，将融合后的特征图组成新的特征金字塔；最后，在特征融合的过程中引入Swin Transformer网络结构和坐标注意力机制，进一步增强小目标的语义信息和全局感知能力。将本文提出的算法在DOTA数据集和RSOD数据集上进行消融实验,结果表明,本文提出的算法能够明显提高遥感图像目标检测的平均准确率。
- Abstract:
- Aiming at the low average target detection accuracy in remote sensing images caused by obscure features in the objects of interest, complex background information, and multiple small targets, we propose a new remote sensing image object detection algorithm with improved YOLOv5s (Swin-YOLOv5s). First, an efficient channel attention structure is added to the convolutional block of the backbone feature extraction network to suppress the interference of irrelevant information; second, cross-scale connection and contextual information weighting operations are performed to enhance detection target feature extraction on the basis of multiscale feature fusion, and the fused feature maps are composed into a new feature pyramid; finally, the Swin Transformer structure and coordinate attention mechanism are used to further enhance the semantic information and global perception ability of small targets. The result of a feature fusion elimination experiment performed on the DOTA and RSOD datasets shows that the proposed algorithm can significantly improve the average accuracy of object detection in remote sensing images.
- 参考文献/References:
-
[1] GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus: IEEE, 2014: 580?587.
[2] GIRSHICK R. Fast R-CNN[C]//2015 IEEE International Conference on Computer Vision. Santiago: IEEE, 2015: 1440?1448.
[3] REN Shaoqing, HE Kaiming, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE transactions on pattern analysis and machine intelligence, 2017, 39(6): 1137–1149.
[4] REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: unified, real-time object detection[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 779?788.
[5] REDMON J, FARHADI A. YOLO9000: better, faster, stronger[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017: 6517?6525.
[6] FARHADI A, REDMON J. YOLOv3: an incremental improvement[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 1804?2767.
[7] BOCHKOVSKIY A, WANG C Y, LIAO H M, et al. YOLOv4: optimal speed and accuracy of object detection[C]//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2020: 2?7.
[8] LIN T Y, DOLLáR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]//2017 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017: 936?944.
[9] LIU Shu, QI Lu, QIN Haifang, et al. Path aggregation network for instance segmentation[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 8759?8768.
[10] 林娜, 冯丽蓉, 张小青. 基于优化Faster-RCNN的遥感影像飞机检测[J]. 遥感技术与应用, 2021, 36(2): 275–284
LIN Na, FENG Lirong, ZHANG Xiaoqing. Aircraft detection in remote sensing image based on optimized faster-RCNN[J]. Remote sensing technology and application, 2021, 36(2): 275–284
[11] 姚艳清, 程塨, 谢星星, 等. 多分辨率特征融合的光学遥感图像目标检测[J]. 遥感学报, 2021, 25(5): 1124–1137
YAO Yanqing, CHENG Gong, XIE Xingxing, et al. Optical remote sensing image object detection based on multi-resolution feature fusion[J]. National remote sensing bulletin, 2021, 25(5): 1124–1137
[12] 张晓雅, 李承政, 徐静杉, 等. 级联结构的遥感目标检测算法[J]. 计算机辅助设计与图形学学报, 2021, 33(10): 1524–1531
ZHANG Xiaoya, LI Chengzheng, XU Jingshan, et al. Cascaded object detection algorithm in remote sensing imagery[J]. Journal of computer-aided design & computer graphics, 2021, 33(10): 1524–1531
[13] 李婕, 周顺, 朱鑫潮, 等. 结合多通道注意力的遥感图像飞机目标检测[J]. 计算机工程与应用, 2022, 58(1): 209–217
LI Jie, ZHOU Shun, ZHU Xinchao, et al. Remote sensing image aircraft target detection combined with multiple channel attention[J]. Computer engineering and applications, 2022, 58(1): 209–217
[14] ZHANG Zixiao, LU Xiaoqiang, CAO Guojin, et al. ViT-YOLO: transformer-based YOLO for object detection[C]//2021 IEEE/CVF International Conference on Computer Vision Workshops. Montreal: IEEE, 2021: 2799?2808.
[15] TAN Mingxing, PANG Ruoming, LE Q V. EfficientDet: scalable and efficient object detection[EB/OL]. (2019?11?20) [2022?02?12].https://arxiv.org/abs/1911.09070.
[16] ZHU Xingkui, LYU Shuchang, WANG Xu, et al. TPH-YOLOv5: improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios[C]//2021 IEEE/CVF International Conference on Computer Vision Workshops. Montreal: IEEE, 2021: 2778?2788.
[17] WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[M]//Computer Vision - ECCV 2018. Cham: Springer International Publishing, 2018: 3?19.
[18] XU Xiangkai, FENG Zhejun, CAO Changqing, et al. An improved swin transformer-based model for remote sensing object detection and instance segmentation[J]. Remote sensing, 2021, 13(23): 4779.
[19] LIU Ze, LIN Yutong, CAO Yue, et al. Swin transformer: hierarchical vision transformer using shifted windows[C]//2021 IEEE/CVF International Conference on Computer Vision. Montrea: IEEE, 2021: 9992?10002.
[20] WANG Qilong, WU Banggu, ZHU Pengfei, et al. ECA-net: efficient channel attention for deep convolutional neural networks[C]//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle: IEEE, 2020: 11531?11539.
[21] HU Jie, SHEN Li, SUN Gang. Squeeze-and-excitation networks[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 7132?7141.
[22] HOU Qibin, ZHOU Daquan, FENG Jiashi. Coordinate attention for efficient mobile network design[C]//2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Nashville: IEEE, 2021: 13708?13717.
[23] LIU Wei, ANGUELOV D, ERHAN D, et al. SSD: Single Shot MultiBox Detector[C]//European Conference on Computer Vision. Cham: Springer, 2016: 21?37.
[24] LIN T Y, GOYAL P, GIRSHICK R, et al. Focal loss for dense object detection[C]//2017 IEEE International Conference on Computer Vision. Venice: IEEE, 2017: 2999?3007.
[25] WANG Peijin, SUN Xian, DIAO Wenhui, et al. FMSSD: feature-merged single-shot detection for multiscale objects in large-scale remote sensing imagery[J]. IEEE transactions on geoscience and remote sensing, 2020, 58(5): 3377–3390.
- 相似文献/References:
-
[1]刘富,于鹏,刘坤.采用独立分量分析Zernike矩的遥感图像飞机目标识别[J].智能系统学报,2011,6(1):51.
LIU Fu,YU Peng,LIU Kun.Research concerning aircraft recognition of remote sensing images based on ICA Zernike invariant moments[J].CAAI Transactions on Intelligent Systems,2011,6():51.
[2]龙海侠,吴淑雷,吕雁.基于多样性变异的QPSO算法的遥感图像分类[J].智能系统学报,2015,10(6):938.[doi:10.11992/tis.201507045]
LONG Haixia,WU Shulei,LYU Yan.Classification of multispectral remote sensing image based on QPSO and diversity-mutation[J].CAAI Transactions on Intelligent Systems,2015,10():938.[doi:10.11992/tis.201507045]
[3]吴诗婳,吴一全,周建江.直线截距直方图城区遥感图像多阈值分割[J].智能系统学报,2018,13(2):227.[doi:10.11992/tis.201609012]
WU Shihua,WU Yiquan,ZHOU Jianjiang.Multi-level thresholding for remote sensing image of urban area based on line intercept histogram[J].CAAI Transactions on Intelligent Systems,2018,13():227.[doi:10.11992/tis.201609012]
[4]李亚飞,董红斌.基于卷积神经网络的遥感图像分类研究[J].智能系统学报,2018,13(4):550.[doi:10.11992/tis.201706078]
LI Yafei,DONG Hongbin.Classification of remote-sensing image based on convolutional neural network[J].CAAI Transactions on Intelligent Systems,2018,13():550.[doi:10.11992/tis.201706078]
[5]王昌安,田金文.生成对抗网络辅助学习的舰船目标精细识别[J].智能系统学报,2020,15(2):296.[doi:10.11992/tis.201901004]
WANG Changan,TIAN Jinwen.Fine-grained inshore ship recognition assisted by deep-learning generative adversarial networks[J].CAAI Transactions on Intelligent Systems,2020,15():296.[doi:10.11992/tis.201901004]
[6]王晓林,苏松志,刘晓颖,等.一种基于级联神经网络的飞机检测方法[J].智能系统学报,2020,15(4):697.[doi:10.11992/tis.201908028]
WANG Xiaolin,SU Songzhi,LIU Xiaoying,et al.Cascade convolutional neural networks for airplane detection[J].CAAI Transactions on Intelligent Systems,2020,15():697.[doi:10.11992/tis.201908028]
[7]刘庆鑫,李霓,贾鹤鸣,等.改进䲟鱼优化算法和熵测度的图像多阈值分割[J].智能系统学报,2024,19(2):381.[doi:10.11992/tis.202205018]
LIU Qingxin,LI Ni,JIA Heming,et al.An improved remora optimization algorithm for multilevel thresholding image segmentation using an entropy measure[J].CAAI Transactions on Intelligent Systems,2024,19():381.[doi:10.11992/tis.202205018]
[8]邵凯,王明政,王光宇.基于Transformer的多尺度遥感语义分割网络[J].智能系统学报,2024,19(4):920.[doi:10.11992/tis.202304026]
SHAO Kai,WANG Mingzheng,WANG Guangyu.Transformer-based multiscale remote sensing semantic segmentation network[J].CAAI Transactions on Intelligent Systems,2024,19():920.[doi:10.11992/tis.202304026]
[9]梁礼明,冯耀,龙鹏威,等.基于MobileViT和多尺度特征聚合的遥感图像目标检测[J].智能系统学报,2024,19(5):1168.[doi:10.11992/tis.202310022]
LIANG Liming,FENG Yao,LONG Pengwei,et al.Remote sensing image object detection based on MobileViT and multiscale feature aggregation[J].CAAI Transactions on Intelligent Systems,2024,19():1168.[doi:10.11992/tis.202310022]
[10]曲海成,李瑞柯,王蒙,等.基于特征重用和膨胀卷积的遥感图像舰船检测[J].智能系统学报,2024,19(5):1298.[doi:10.11992/tis.202304002]
QU Haicheng,LI Ruike,WANG Meng,et al.Ship detection in remote sensing images via feature reuse and dilated convolution[J].CAAI Transactions on Intelligent Systems,2024,19():1298.[doi:10.11992/tis.202304002]
备注/Memo
收稿日期:2022-03-08。
基金项目:河北省自然科学基金项目(F2021502013);中央高校基本科研业务费面上项目(2020MS153,2021PT018);国家自然科学基金项目(61773160,61871182).
作者简介:赵文清,教授,博士,主要研究方向为人工智能与图像处理。获河北省科技进步二等奖、三等奖各1项。发表学术论文50余篇;康怿瑾,硕士研究生,主要研究方向为深度学习与目标检测;赵振兵,教授,博士,主要研究方向为电力视觉。主持国家自然科学基金等纵向课题10项。获省科技进步一等奖1项(第三完成人)。以第一完成人获得国家专利授权16项;以第一作者出版专著2部、发表学术论文50余篇
通讯作者:赵文清.E-mail:jbzwq@126.com
更新日期/Last Update:
1900-01-01