A Circular Target Stability Detection Method Based on Deep Learning Image Super-resolution

doi:10.3969/j.issn.1004-132X.2021.23.010

China Mechanical Engineering ›› 2021, Vol. 32 ›› Issue (23): 2861-2867.DOI: 10.3969/j.issn.1004-132X.2021.23.010

Previous Articles Next Articles

A Circular Target Stability Detection Method Based on Deep Learning Image Super-resolution

CUI Haihua1;XU Zhenlong1; YANG Yapeng2;MENG Yayun1;WANG Baojun1

1.College of Mechanical & Electrical Engineering，Nanjing University of Aeronautics and Astronautics，Nanjing，211106
2.Manufacturing Engineering Department，AVIC Xi'an Aircraft Industry Group Company Ltd.，Xi'an，710089

Online:2021-12-10 Published:2021-12-23

一种基于深度学习图像超分的环形靶标稳定检测方法

崔海华1;徐振龙1;杨亚鹏2;孟亚云1;王宝俊1

1.南京航空航天大学机电学院，南京，211106
2.中航西安飞机工业集团股份有限公司制造工程部，西安，710089

通讯作者: 徐振龙（通信作者），男，1993年生，硕士研究生。研究方向为深度学习、目标检测。E-mail：xzhlng@nuaa.edu.cn。
作者简介:崔海华，男，1979年生，副教授。研究方向为视觉三维测量与检测技术。发表论文20余篇。E-mail：cuihh@nuaa.edu.cn。
基金资助:
国家重点研发计划（2019YFB2006100，2019YFB1707501）；
江苏省自然科学基金（BK20191280）；
南京航空航天大学研究生创新基地（实验室）开放基金（kfjj20200519）

Abstract

Abstract: In order to improve the recognition rate and location accuracy of circular targets under the conditions of long-distance and large deflection angle， a circular target stability detection method was proposed based on deep learning image super-resolution. The multi-angle and multi-distance image sets were constructed through a hybrid data set of real images and synthetic images， the pixel loss and perceptual loss were used to improve the loss function of image super-resolution model， so the super-resolution reconstruction of images might be realized and the image details of target contours might be enriched. By using the pretrained super-resolution model， the images were reconstructed. Finally， traditional detection algorithm was used to recognize and locate the circular targets. The experimental results show that the circular target recognition rate is increased by 40%， and the target location accuracy is increased by 8.47%.

Key words: circular target, super-resolution, deep learning, object recognition

摘要： 为提高远距离、大倾角条件下环形靶标的识别率与定位精度，提出了一种基于深度学习图像超分的环形靶标稳定检测方法。通过真实图像与合成图像的混合数据集来构建多角度、多距离的图像空间集合，采用像素损失与感知损失来改进图像超分辨率模型的损失函数，从而实现图像的高分辨率重建，丰富靶标轮廓的图像细节，利用已训练好的图像超分模型重建图像，最后使用传统的检测算法识别与定位环形靶标。实验结果表明，环形靶标识别率可提高40%，靶标定位精度可提高8.47%。

关键词: 环形靶标, 超分辨率, 深度学习, 目标识别

CLC Number:

TP391.41

CUI Haihua, XU Zhenlong, YANG Yapeng, MENG Yayun, WANG Baojun. A Circular Target Stability Detection Method Based on Deep Learning Image Super-resolution[J]. China Mechanical Engineering, 2021, 32(23): 2861-2867.

崔海华, 徐振龙, 杨亚鹏, 孟亚云, 王宝俊. 一种基于深度学习图像超分的环形靶标稳定检测方法[J]. 中国机械工程, 2021, 32(23): 2861-2867.

References

［1］JIANG Tao， CHENG Xiaosheng， CUI Haihua. A Calibration Strategy for Vision-guided Robot Assembly System of Large Cabin［J］. Measurement， 2020， 163：107991.
［2］温卓漫，王延杰，邸男，等，空间站机械臂位姿测量中合作靶标的快速识别［J］. 航空学报， 2015， 36（4）：1330-1338.
WEN Zhuoman， WANG Yanjie， DI Nan， et al. Fast Recognition of Cooperative Target Used for Position and Orientation Measurement of Space Stations Robot Arm［J］. Acta Aeronautica et Astronautica Sinica， 2015， 36（4）：1330-1338.
［3］张小迪，崔海华，程筱胜，等. 一种基于同心圆的环形编码标志设计与检测［J］. 机械制造与自动化2020， 49（2）：133-136.
ZHANG Xiaodi， CUI Haihua， CHENG Xiaosheng， et al. Design and Detection of Circular Coded Marker Based on Concentric Circles［J］. Machine Building and Automation， 2020， 49（2）：133-136.
［4］OLSON E. AprilTag：a Robust and Flexible Visual Fiducial System［C］∥IEEE International Conference on Robotics and Automation. Shanghai， 2011：3400-3407.
［5］GARRIDO S， MUNOZ R， MADRID F J， et al. Automatic Generation and Detection of Highly Reliable Fiducial Markers under Occlusion［J］. Pattern Recognition， 2014， 47（6）：2280-2292.
［6］王颖，张瑞. 管道内表面圆结构光视觉三维测量系统［J］. 红外与激光工程， 2014， 43（3）：891-896.
WANG Ying， ZHANG Rui. In-pipe Surface Circular Structured Light 3D Vision Inspection System［J］. Infrared and Laser Engineering， 2014， 43（3）：891-896.
［7］周申江，余厚云. 近景摄影测量中编码标志点解码方法研究［J］. 机械制造与自动化， 2019， 48（3）：182-184.
ZHOU Shenjiang， YU Houyun. Research on Decode Algorithm of Coded Targets in Close-range Photogrammetry［J］. Machine Building and Automation， 2019， 48（3）：182-184.
［8］苏衡，周杰，张志浩. 超分辨率图像重建方法综述［J］. 自动化学报， 2013， 39（8）：1202-1213.
SU Heng， ZHOU Jie， ZHANG Zhihao. Survey of Super-resolution Image Reconstruction Methods［J］. Acta Automatica Sinica， 2013， 39（8）：1202-1213.
［9］ZHANG Zhizhuo， WAN Lili， XU Wanru， et al. Estimating a 2D Pose from a Tiny Person Image with Super-resolution Reconstruction［J］. Computers and Electrical Engineering， 2021， 93（2）：107192.
［10］杨夏宁，王帮海，李佐龙. 分层特征融合网络航拍图像超分辨率重建［J/OL］. 计算机工程与应用.［2021-10-25］. http：∥kns. cnki. net/kcms/detail/11. 2127. TP. 20210527. 1559. 013. html.
YANG Xianing， WANG Banghai， LI Zuolong. Super-resolution Reconstruction of Aerial Images Based on Hierarchical Feature Fusion Network［J/OL］. Computer Engineering and Applications.［2021-10-25］. http：∥kns. cnki. net/kcms/detail/11. 2127. TP. 20210527. 1559. 013. html.
［11］CHAO D， CHEN C L， HE K， et al. Learning a Deep Convolutional Network for Image Super-resolution［C］∥ European Conference on Conputer Vision. Zurich， 2014：184-199.
［12］LIM B， SON S， KIM H， et al. Enhanced Deep Residual Networks for Single Image Super-resolution［C］∥ IEEE Conference on Computer Vision and Pattern Recognition Workshops（CVPRW）. Honolulu， 2017：1132-1140.
［13］SHI W Z， JOSE C， FERENC H， et al. Real-time Single Image and Video Super-resolution Using an Efficient Sub-pixel Convolutional Neural Network［C］∥ IEEE Conference on Computer Vision and Pattern Recognition（CVPR）. Las Vegas， 2016：1874-1883.
［14］CHAO D， CHEN C L， TANG X O. Accelerating the Super-resolution Convolutional Neural Network［C］∥ European Conference on Computer Vision. Amsterdam， 2016：391-407.
［15］LAI W S， HUANG J B， AHUJA N， et al. Deep Laplacian Pyramid Networks for Fast and Accurate Super-resolution［C］∥ IEEE Conference on Computer Vision and Pattern Recognition（CVPR）. Honolulu， 2017：5835-5843.
［16］WANG Z H， CHEN J， HOI S C H. Deep Learning for Image Super-resolution：a Survey［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence， 2019， 43（10）：3365-3387.

[1]	WANG Hao, LUO Haodong, SHI Yazhong, WANG Liwen, ZHANG Wei, WANG Zhong. A Topology Optimization Method Based on End-to-end Deep Learning Framework TOPO-U-Net [J]. China Mechanical Engineering, 2026, 37(1): 174-183.
[2]	Zulong YAN, Qilong PANG, Jianlong XIONG. Prediction of Three-dimensional Machined Surface Topography of KDP Crystals Based on Deep Learning [J]. China Mechanical Engineering, 2025, 36(10): 2329-2334.
[3]	ZHAO Yunjie, HE Yansong, ZHANG Zhifei, XU Zhongming. 3D Beamforming Map Compression Method Based on Generative Model [J]. China Mechanical Engineering, 2025, 36(07): 1520-1529.
[4]	ZENG Hao, CAO Huajun, DONG Jianxiong. Tool Wear Prediction Method Based on ISABO-IBiLSTM Model [J]. China Mechanical Engineering, 2024, 35(11): 1995-2006.
[5]	LI Yue1, 2, XIE Heng1, ZHOU Gongbo1, 2, ZHOU Ping1, 2, LI Menggang1, 2. Soft Sensor Modeling and Uncertainty Analysis Approach of Tool Wear Based on Semi-supervised Bayesian Transformer [J]. China Mechanical Engineering, 2024, 35(11): 2015-2025.
[6]	NIE Xin, TAN Tian, SHEN Danfeng. Research on Stamping Springback of Automobile Beam Parts Based on Deep Learning [J]. China Mechanical Engineering, 2023, 34(07): 838-846.
[7]	TANG Donglin, YANG Zhou, CHENG Heng, LIU Mingxuan, ZHOU Li, DING Chao. Metal Defect Image Recognition Method Based on Shallow CNN Fusion Transformer [J]. China Mechanical Engineering, 2022, 33(19): 2298-2305，2316.
[8]	YU Hao, HUANG Huagui, ZHENG Jiali, ZHAO Tielin, ZHOU Xinliang. Non-contact On-line Inspection Method for Surface Defects of Cross-rolling Piercing Plugs for Seamless Steel Tubes [J]. China Mechanical Engineering, 2022, 33(14): 1717-1724.
[9]	YANG Guangyou, LIU Lang, XI Chenbo. Bearing Fault Diagnosis Based on SA-ACGAN Data Generation Model [J]. China Mechanical Engineering, 2022, 33(13): 1613-1621.
[10]	AI Qingbo, ZHANG Jie, CHENG Hui, LYU Youlong, ZUO Liling, HU Lan. Analysis for Roll-bending Forming Quality of Spaceflight Thin-walled Cylindrical Workpieces Based on PointCPP-LSF Method#br# [J]. China Mechanical Engineering, 2022, 33(08): 977-985.
[11]	ZHANG Shengwen, ZHOU Xi, LI Bincheng, CHENG Dejun, CHEN Wendi. Information Extraction Method of Part Machining Features Based on Image Deep Learning [J]. China Mechanical Engineering, 2022, 33(03): 348-355.
[12]	YAN Jieqiong, ZHOU Laishui, HU Shaoqian, WEN Siyang. Feature-preserving Denoising Method for Aero-engine Profile Point Cloud [J]. China Mechanical Engineering, 2021, 32(23): 2850-2860，2889.
[13]	TONG Jinyu, LUO Jin, ZHENG Jinde. Rolling Bearing Fault Diagnosis Method Based on Enhanced Deep Auto-encoder Network [J]. China Mechanical Engineering, 2021, 32(21): 2617-2624.
[14]	YIN Chen, ZHOU Shichao, HE Jianliang, SUN Yuxin, WANG Yulin. Tool Wear Online Recognition Method Based on Multi-source Synchronous Signals and Deep Learning [J]. China Mechanical Engineering, 2021, 32(20): 2482-2491.
[15]	YU Haoshuai, TANG Baoping, ZHANG Kai, TAN Qian, WEI Jing. Fault Diagnosis Method of Wind Turbine Gearboxes Mixed with Attention Prototype Networks under Small Samples [J]. China Mechanical Engineering, 2021, 32(20): 2475-2481.

A Circular Target Stability Detection Method Based on Deep Learning Image Super-resolution

一种基于深度学习图像超分的环形靶标稳定检测方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics