Calibration Parameter Optimization and Accuracy Evaluation of Complex Visual Measurement Systems

doi:10.3969/j.issn.1004-132X.2023.14.011

Abstract

Abstract: There were many calibration errors in complex visual measurement systems， and the coupling between errors directly affected the accuracy of system measurement， so the accuracy improvelment of system calibration parameters was the key to ensure the system measurement accuracy. Thus， a calibration parameter optimization method was proposed based on multi-dimensional angular point error compensation. Firstly， a multi-dimensional angular point error function was defined， and the corresponding optimization model whose parameters were solved by LM algorithm was established. Then， the effects of the parameter optimization method on the system calibration optimization were evaluated by the optimization rate of the system calibration errors. Experimental results show that the optimization rate of the system calibration errors may reach 48%， the system measurement accuracy is high and meets the measurement requirements.

Key words: , measurement system, model solving, calibration error, parameter optimization, accuracy evaluation

摘要： 复杂视觉测量系统存在多种标定误差，且误差的相互耦合直接影响系统测量的精度，因此提高系统标定参数的准确性是保证系统测量精度的关键。提出了一种基于多维角点误差补偿的标定参数优化方法。首先定义多维角点误差函数，建立相应的优化模型，并利用LM算法求解最优的标定参数；然后以系统标定误差优化率来评价参数优化方法对系统标定优化的效果。实验结果表明系统标定误差优化率可达48%，系统测量精度较高，满足测量需求。

关键词: 测量系统, 模型求解, 标定误差, 参数优化, 精度评估

CLC Number:

TP391.41

SUN Jiale, LUO Chen, ZHOU Yijun, WANG Wei, ZHANG Gang. Calibration Parameter Optimization and Accuracy Evaluation of Complex Visual Measurement Systems[J]. China Mechanical Engineering, 2023, 34(14): 1741-1748,1755.

孙家乐, 罗晨, 周怡君, 王伟, 张刚. 复杂视觉测量系统的标定参数优化及精度评估[J]. 中国机械工程, 2023, 34(14): 1741-1748,1755.

References

［1］罗桂娥. 双目立体视觉深度感知与三维重建若干问题研究［D］. 长沙：中南大学， 2012.
LUO Guie. Some Issues of Depth Perception and Three Dimension Reconstruction from Binocular Stereo Vision［D］. Changsha：Central South University， 2012.
［2］李帅. 主动式结构光的立体视觉方法研究［D］. 杭州：浙江工业大学， 2012.
LI Shuai. Active Stereo Vision Method Research Based on Structured Light［D］. Hangzhou：Zhejiang University of Technology， 2012.
［3］王荣. 基于三维点云的工件曲面轮廓检测与机器人打磨轨迹规划［D］. 上海：东华大学， 2022.
WANG Rong. Workpiece Surface Contour Detection Based on 3D Point Cloud and Robot Grinding Trajectory［D］. Shanghai：Donghua University， 2022.
［4］ZENG A， SONG S， YU K， et al. Robotic Pick-and-place of Novel Objects in Clutter with Multi-affordance Grasping and Cross-domain Image Matching［C］∥IEEE International Conference on Robotics and Automation. Brisbane， 2018：3750-3757.
［5］蒋宝，徐冬至，黄瑞生，等. 基于视觉传感的焊接机器人焊缝识别跟踪技术研究现状［J］. 金属加工（热加工）， 2022， 3（1）：10-17.
JIANG Bao， XU Dongzhi， HUANG Ruisheng， et al. Research Status of Welding Robot Weld Recognition and Tracking Technology Based on Visual Sensing［J］. MW Metal Forming， 2022， 3（1）：10-17.
［6］JIA Z， YANG J， LIU W， et al. Improved Camera Calibration Method Based on Perpendicularity Compensation for Binocular Stereo Vision Measurement System［J］. Optics Express， 2015， 23（12）：15205-15223.
［7］张素枝，秦宇锦. 基于主动视觉的相机标定方法在太阳能电池片丝印机上的应用［J］. 机电工程， 2016， 33（3）：378-382.
ZHANG Suzhi， QIN Yujin. Application of Camera Calibration Method Based on Active Vision in Solar Cell Chip Screen Printing Machine［J］. Journal of Mechanical & Electrical Engineering， 2016， 33（3）：378-382.
［8］王美珍，刘学军，卢玥，等. 多几何特征约束的单幅图像相机自标定方法［J］. 地球信息科学学报， 2012， 14（5）：644-651.
WANG Meizhen， LIU Xuejun， LU Yue， et al. Camera Self-calibration Using Multiple Geometric Constraints in a Single Image［J］. Journal of Geo-information Science， 2012， 14（5）：644-651.
［9］吴军，徐刚，董增来，等. 引入灭点约束的Tsai两步法相机标定改进研究［J］. 武汉大学学报（信息科学版）， 2012， 37（1）：17-21.
WU Jun， XU Gang， DONG Zenglai， et al. An Improved Tsais Two-stage Camera Calibration Approach Using Vanish Point Constrain［J］. Geomatics and Information Science of Wuhan University， 2012， 37（1）：17-21.
［10］刘艳，李腾飞. 对张正友相机标定法的改进研究［J］. 光学技术， 2014， 40（6）：565-570.
LIU Yan， LI Tengfei. Research of the Improvement of Zhangs Camera Calibration Method［J］. Optical Technique， 2014， 40（6）：565-570.
［11］王颖，董再励，孙茂相，等. 一种基于线性模型的机器人手眼标定新方法［J］. 模式识别与人工智能， 2005， 18（4）：491-495.
WANG Ying， DONG Zaili， SUN Maoxiang， et al. A New Approach for Robot Hand-Eye Calibration Based on Linear Prototype［J］. Pattern Recognition and Artificial Intelligence， 2005， 18（4）：491-495.
［12］ENEBUSE I， FOO M， IBRAHIM B S K K， et al. A Comparative Review of Hand-Eye Calibration Techniques for Vision Guided Robots［J］. IEEE ACCESS， 2021， 9：113143-113155.
［13］尚忠义，董明利，李伟仙，等. 基于手眼标定方程AX=XB的精度影响因素研究［J］. 传感器与微系统， 2017， 36（3）：36-39.
SHANG Zhongyi， DONG Mingli， LI Weixian， et al. Research on Precision Influence Factors Based on Hand-Eye Calibration Equations AX=XB［J］. Transducer and Microsystem Technologies， 2017， 36（3）：36-39.
［14］BRIESE D， NIEBLER C， ROSE G. Hand-Eye Calibration Using Dual Quaternions in Medical Environment［C］∥SPIE Medical Imaging：International Society for Optics and Photonics. San Diego， 2014：90361U.
［15］刘冲. 面向视觉三维测量的机器人手眼标定技术研究［D］. 沈阳：沈阳航空航天大学， 2018.
LIU Chong. The Study of Robot Hand Eye Calibration Technique for Visual Three-dimensional Measurement［D］. Shenyang：Shenyang Aerospace University， 2018.
［16］PARK F C， MARTIN B J. Robot Sensor Calibration：Solving AX=XB on the Euclidean Group［J］. IEEE Transactions on Robotics and Automation， 2002， 10（5）：717-721.
［17］ZHI X， SCHWERTFEGER S. Simultaneous Hand-Eye Calibration and Reconstruction［C］∥IEEE International Conference on Intelligent Robots and Systems. Vancouver， 2017：1470-1477.
［18］SHANG Z， DONG M， LI W X， et al. Research on Precision Influence Factors Based on Hand-Eye Calibration Equations AX=XB［J］. Transducer and Microsystem Technologies， 2017， 36（3）：36-39.
［19］KOIDE K， MENEGATTI E. General Hand-Eye Calibration Based on Reprojection Error Minimization［J］. IEEE Robotics and Automation Letters， 2019， 4（2）：1021-1028.
［20］MALTI A. Hand-Eye Calibration with Epipolar Constraints：Application to Endoscopy［J］. Robotics and Autonomous Systems， 2013， 61（2）：161-169.
［21］吴庆阳，李景镇，苏显渝，等. 线结构光三维测量系统中旋转轴的标定方法［J］. 中国激光， 2008， 35（8）：1224-1227.
WU Qingyang， LI Jingzhen， SU Xianyu， et al. An Approach for Calibrating Rotor Position of Three-dimensional Measurement System for Line-structure Light［J］. Chinese Journal of Lasers， 2008， 35（8）：1224-1227.
［22］王福昌，曹慧荣，朱红霞. 经典最小二乘与全最小二乘法及其参数估计［J］. 统计与决策， 2009（1）：16-17.
WANG Fuchang， CAO Huirong， ZHU Hongxia. Classical Least Squares and Full Least Squares and Their Parameter Estimation［J］. Statistics & Decision， 2009（1）：16-17.
［23］尹洪涛，刘成，李一兵，等. 相机标定误差因素分析［J］. 长江信息通信， 2012（1）：28-30.
YIN Hongtao， LIU Cheng， LI Yibing， et al. Analysis of Factors on the Error of the Camera Calibration［J］. Changjiang Information & Communications， 2012（1）：28-30.
［24］李中伟. 基于数字光栅投影的结构光三维测量技术与系统研究［D］. 武汉：华中科技大学， 2009.
LI Zhongwei. Research on Structured Light 3D Measuring Technology and System Based on Digital Fringe Projection［D］. Wuhan：Huazhong University of Science and Technology， 2009.
［25］LIU Z， LIU X， DUAN G， et al. Precise Hand-Eye Calibration Method Based on Spatial Distance and Epipolar Constraints［J］. Robotics and Autonomous Systems， 2021， 145：103868.
［26］程晓亮. 基于双目立体视觉的三维重构研究［D］. 哈尔滨：哈尔滨工业大学， 2006.
CHENG Xiaoliang. The Research on 3D Reconstruction Based on Binocular Stereo Vision［D］. Harbin：Harbin Institute of Technology， 2006.
［27］杨其昌. 双目立体视觉手眼标定技术研究［D］. 深圳：深圳大学， 2018.
YANG Qichang. Research on Binocular Stereoscopic Vision Eye Calibration［D］. Shenzhen：Shenzhen University， 2018.

[1]	ZHENG Kun, LIAN Zhiwei, GU Xinyan, ZHU Changjian, XU Hui, FENG Xueqing. Hybrid Flow Shop Scheduling Problems with Unrelated Parallel Machine Solved by Improved Adaptive Genetic Algorithm(IAGA) with ITPX [J]. China Mechanical Engineering, 2023, 34(14): 1647-1658，1671.
[2]	WU Chaoqun, ZHAO Song, LEI Ting. Robot Welding Trajectory Planning and High Frequency Control for Curved Seams [J]. China Mechanical Engineering, 2023, 34(14): 1723-1728.
[3]	CHEN Yu, XIANG Wei, GONG Chuan. Online Diagnostic Inspection and Prediction of Product Quality in Injection Molding Intelligent Factories Based on Data Mining [J]. China Mechanical Engineering, 2023, 34(14): 1749-1755.
[4]	WEI Bingyang, GU Dewan, WANG Yongqiang, YANG Jianjun, . Friction Power Loss Analysis and Efficiency Test of High Reduction Hypoid Gears [J]. China Mechanical Engineering, 2023, 34(13): 1525-1532.
[5]	LI Yongfan, SONG Yong, HAO Muming, ZHUANG Suguo, ZHOU Rui, LI Tianzhao, WANG Chenyin, REN Baojie, LI Xiaozu. Experimental Study of Thermal Deformation and Wear Characteristics of Spherically-assembled Mechanical Seals for Turbo Pumps [J]. China Mechanical Engineering, 2023, 34(13): 1550-1558.
[6]	TIAN Long, HUANG Chuanzhen, LIU Dun , YAO Peng , LIU Hanlian, LIU Xuefei. Experimental Study of Laser Assisted Water Jet Micromilling of Single Crystal β-Ga2O3 Substrates [J]. China Mechanical Engineering, 2023, 34(13): 1559-1567.
[7]	XIE Fawu, LI Lingling, LI Li, HUANG Yangpeng. Energy-efficient Job Shop Scheduling with Variable Lot Splitting and Sublots ntermingling Based on Multi-objective Hybrid Evolutionary Algorithm [J]. China Mechanical Engineering, 2023, 34(13): 1576-1588,1598.
[8]	WANG Fei, FENG Yi, LI Xinchao, LIU Zhuhan. Research on Multiple Arc Erosion Properties of Cu-Diamond Composites [J]. China Mechanical Engineering, 2023, 34(13): 1599-1604.
[9]	CAO Leilei, KANG Fanjun, GUO Chengchen, SONG Xuding, LYU Wenche. Multi-axis Fatigue Life Analysis Method for Welded Structures of Transmission Intermediate Shafts [J]. China Mechanical Engineering, 2023, 34(13): 1605-0610,1627.
[10]	ZHANG Jingdong, DENG BoGUI Xuewen, LI Jian, LIAO Ridong. Finite Element Analysis for Extrusion, Assembly and Loosening Processes of Hi-lock Nuts [J]. China Mechanical Engineering, 2023, 34(12): 1387-1394，1406.
[11]	DING Chuan, ZHANG Lichao, XIA Ning, CHEN Haoqi, RUAN Jian, MENG Bin, . Experimental Study of Shear Cavitation in Two-dimensional Piston/Cylinder Pairs Micro-gap Flow Fields [J]. China Mechanical Engineering, 2023, 34(12): 1395-1406.
[12]	PENG Xiang, JIANG Haohao, GUO Yuliang, LI Jiquan, YI Bing, JIANG Shaofei, . Collaborative Optimization of Stacking Sequence and Material Distribution for Wing Skins [J]. China Mechanical Engineering, 2023, 34(12): 1415-1424,1435.
[13]	YU Minfeng, PENG Xudong, MENG Xiangkai, LIANG Yangyang, . Research on Heat Transfer Enhancement Mechanism of Contact Mechanical Seals with Textured Circumference Surfaces#br# [J]. China Mechanical Engineering, 2023, 34(11): 1268-1279.
[14]	YANG Fei, JIANG Wei, CHEN Cheng, HUANG Zhigao, ZHOU Huamin, . Study on Infrared Heat Source-assisted Open-space Industrial Robotic FDM Equipment Design and Forming Performance [J]. China Mechanical Engineering, 2023, 34(11): 1343-1352,1385.
[15]	PAN Ling, LIN Guobin, HAN Yuqing, YU Hui. Molecular Dynamics Simulation for Effect of Nanoparticle Additives on Boundary Lubrication [J]. China Mechanical Engineering, 2023, 34(10): 1140-1156.