A Review of Force Sensing Technology in Robot-assisted Laparoscopic Surgery

doi:10.3969/j.issn.1004-132X.2021.21.001

Abstract

Abstract: In order to promote the further research and clinical applications of force sensing technology in robot-assisted laparoscopic surgery， the research progresses were reviewed. Sensor force sensing was divided into two categories：electrical signal-based sensing and optical signal-based sensing. Some key indicators were analyzed， such as sensor position distribution on surgical instruments， mechanical structure， measurement range， measurement accuracy and electromagnetic compatibility. Sensors advantages and disadvantages were discussed. Sensorless force sensing was divided into two categories：vision-based sensing and dynamic model-based sensing. And the realization method， technical obstacle and error sources were analyzed. Finally， the development trend of force sensing technology in robot-assisted laparoscopic surgery was prospected.

Key words: , force sensor, force sensing, research progress, robot-assisted laparoscopic surgery

摘要： 为了推动机器人辅助腹腔镜手术中力感知技术的深入研究和临床应用，综述了其研究进展。针对有传感器的力感知，将其分为基于电信号和基于光信号两类，分析了传感器在手术器械上的位置分布、机械结构、测量范围、测量精度和电磁兼容性等关键指标，并讨论了其优势和局限；针对无传感器的力感知，将其分为基于视觉和基于动力学模型两类，并分析了其实现方法、技术障碍和误差来源。最后，展望了机器人辅助腹腔镜手术中力感知技术的发展趋势。

关键词: 力传感器, 力感知, 研究进展, 机器人辅助腹腔镜手术

CLC Number:

TP242

ZHANG Jianxun, YAO Bin, DAI Yu, XIA Guangming, . A Review of Force Sensing Technology in Robot-assisted Laparoscopic Surgery[J]. China Mechanical Engineering, 2021, 32(21): 2521-2531.

张建勋, 姚斌, 代煜, 夏光明, . 机器人辅助腹腔镜手术中力感知技术的研究进展[J]. 中国机械工程, 2021, 32(21): 2521-2531.

References

［1］BROUWER I， USTIN J， BENTLEY L M， et al. Measuring in Vivo Animal Soft Tissue Properties for Haptic Modeling in Surgical Simulation［J］. Stud. Health Technol. Inform.， 2001， 81：69-74.
［2］OKAMURA A M. Haptic Feedback in Robot-assisted Minimally Invasive Surgery［J］. Current Opinion in Urology， 2009， 19（1）：102-107.
［3］付宜利，李坤，潘博，等. 微创手术机器人力检测与力反馈技术研究现状［J］. 机器人， 2014， 36（1）：117-128.
FU Yili， LI Kun， PAN Bo， et al. A Survey of Force Sensing and Force Feedback Technology for Robot-assisted Minimally Invasive Surgical System［J］. Robot， 2014， 36（1）：117-128.
［4］SAUERLAND S， JASCHINSKI T， NEUGEBAUER E. Laparoscopic versus Open Surgery for Suspected Appendicitis［J］. Cochrane Database of Systematic Reviews， 2018（11）：CD001546.
［5］OKAMURA A M. Methods for Haptic Feedback in Teleoperated Robot-assisted Surgery［J］. Industrial Robot， 2004， 31（6）：499-508.
［6］DINESH V， SEAN C. Peer Review and Surgical Innovation：Robotic Surgery and Its Hurdles［J］. American Journal of Robotic Surgery， 2015， 2（1）：39-44.
［7］GWILLIAM J C， MAHVASH M， VAGVOLGYI B， et al. Effects of Haptic and Graphical Force Feedback on Teleoperated Palpation［C］∥ International Conference on Robotics and Automation. Kobe， 2009：677-682.
［8］WAGNER C R， STYLOPOULOS N， JACKSON P G， et al. The Benefit of Force Feedback in Surgery：Examination of Blunt Dissection［J］. Presence：Teleoperators Virtual Environments， 2007， 16（3）：252-262.
［9］REILEY C E， AKINBIYI T， BURSCHKA D， et al. Effects of Visual Force Feedback on Robot-assisted Surgical Task Performance［J］. The Journal of Thoracic Cardiovascular Surgery， 2008， 135（1）：196-202.
［10］DEMI B， ORTMAIER T， SEIBOLD U. The Touch and Feel in Minimally Invasive Surgery［C］∥ IEEE International Workshop on Haptic Audio Visual Environments and Their Applications. Ottawa， 2005：8894919.
［11］DARGAHI J， NAJARIAN S. An Endoscopic Force-position Sensor Grasper with Minimum Sensors［J］. Canadian Journal of Electrical Computer Engineering， 2003， 28（3）：155-161.
［12］PRASAD S K， KITAGAWA M， FISCHER G S， et al. A Modular 2-DOF Force-sensing Instrument for Laparoscopic Surgery［C］∥ Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention. Montreal， 2003：279-286.
［13］FISCHER G S， AKINBIYI T， SAHA S， et al. Ischemia and Force Sensing Surgical Instruments for Augmenting Available Surgeon Information［C］∥ The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics. Pisa， 2006：1030-1035.
［14］LI K， PAN B， ZHAN J， et al. Design and Performance Evaluation of a 3-axis Force Sensor for MIS Palpation［J］. Sensor Review， 2015， 35（2）：219-228.
［15］代煜，张建勋. 基于小波变换和维纳滤波的半导体器件1/f噪声滤波［J］. 物理学报， 2011， 60（11）：185-190.
DAI Yu， ZHANG Jianxun. Reduction of 1/f Noise in Semiconductor Devices Based on Wavelet Transform and Wiener Filter［J］. Acta Physica Sinica， 2011， 60（11）：185-190.
［16］孙会娇，代煜，张建勋，等. 直流电源激励下的电路高分辨力应变信号处理［J］. 仪器仪表学报， 2019， 40（8）：184-190.
SUN Huijiao， DAI Yu， ZHANG Jianxun， et al. High Resolution Strain Signal Processing for the Circuit under DC Source Excitation［J］. Chinese Journal of Scientific Instrument， 2019， 40（8）：184-190.
［17］SOKHANVAR S， PACKIRISAMY M， DARGAHI J. A Multifunctional PVDF-based Tactile Sensor for Minimally Invasive Surgery［J］. Smart Materials Structures， 2007， 16（4）：989-998.
［18］SOKHANVAR S， PACKIRISAMY M， DARGAHI J. MEMS Endoscopic Tactile Sensor：Toward In-situ and In-vivo Tissue Softness Characterization［J］. IEEE Sensors Journal， 2009， 9（12）：1679-1687.
［19］DAI Y， ABIRI A， LIU S， et al. Grasper Integrated Tri-axial Force Sensor System for Robotic Minimally Invasive Surgery［C］∥ 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society（EMBC）. Jeju， 2017：3936-3939.
［20］KIM U， KIM Y B， SO J， et al. Sensorized Surgical Forceps for Robotic-assisted Minimally Invasive Surgery［J］. IEEE Transactions on Industrial Electronics， 2018， 65（12）：9604-9613.
［21］DARGAHI J， PARAMESWARAN M. A Micromachined Piezoelectric Tactile Sensor for an Endoscopic Grasper-theory， Fabrication and Experiments［J］. Journal of Microelectromechanical Systems， 2000， 9（3）：329-335.
［22］SEIBOLD U， HIRZINGER G. A 6-axis Forche/Torque Sensor Design for Haptic Feedback in Minimally Invasive Robotic Surgery［C］∥ 2nd VDE World Microtechnologies Congress. Munich， 2003：239-244.
［23］KALANTARI M， RAMEZANIFARD M， AHMADI R， et al. A Piezoresistive Tactile Sensor for Tissue Characterization during Catheter-based Cardiac Surgery［J］. International Journal of Medical Robotics and Computer Assisted Surgery， 2011， 7（4）：431-440.
［24］BAKI P， SZEKELY G， KOSA G. Miniature Tri-axial Force Sensor for Feedback in Minimally Invasive Surgery［C］∥ 4th IEEE RAS & EMBS International Conference on Biomedical Robotics & Biomechatronics. Rome， 2012：12967935.
［25］HWANG J H， KWON J H， KIM T K， et al. Design of Simple Structured Tactile Sensor for the Minimally Invasive Robotic Palpation［C］∥ IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Wollongong， 2013：1296-1299.
［26］LEE J， CHOI W， YOO Y K， et al. A Micro-fabricated Force Sensor Using an All Thin Film Piezoelectric Active Sensor［J］. Sensors， 2014， 14（12）：22199-22207.
［27］KIM U， LEE D H， YOON W J， et al. Force Sensor Integrated Surgical Forceps for Minimally Invasive Robotic Surgery［J］. IEEE Transactions on Robotics， 2016， 31（5）：1214-1224.
［28］LEE D H， KIM U， GULREZ T， et al. A Laparoscopic Grasping Tool with Force Sensing Capability［J］. IEEE/ASME Transactions on Mechatronics， 2016， 21（1）：130-141.
［29］HESSINGER M， PILIC T， WERTHSCHUTZKY R， et al. Miniaturized Force/Torque Sensor for in Vivo Measurements of Tissue Characteristics［C］∥ International Conference of the IEEE Engineering in Medicine & Biology Society. Orlando， 2016：2022-2025.
［30］KIM U， KIM Y B， SEOK D， et al. A Surgical Palpation Probe with 6-axis Force/Torque Sensing Capability for Minimally Invasive Surgery［J］. IEEE Transactions on Industrial Electronics， 2018， 65（3）：2755-2765.
［31］YU L， YAN Y， YU X， et al. Design and Realization of Forceps with 3-D Force Sensing Capability for Robot-assisted Surgical System［J］. IEEE Sensors Journal， 2018， 18（21）：8924-8932.
［32］PUANGMALI P， LIU H， SENEVIRATNE L， et al. Miniature 3-axis Distal Force Sensor for Minimally Invasive Surgical Palpation［J］. IEEE-ASME Transactions on Mechatronics， 2012， 17（4）：646-656.
［33］FONTANELLI G A， BUONOCORE L R， FICUCIELLO F， et al. A Novel Force Sensing Integrated into the Trocar for Minimally Invasive Robotic Surgery［C］∥ IEEE/RSJ International Conference on Intelligent Robots and Systems（IROS）. Vancouver， 2017：131-136.
［34］ZEMITI N， MOREL G， ORTMAIER T， et al. Mechatronic Design of a New Robot for Force Control in Minimally Invasive Surgery［J］. IEEE/ASME Transactions on Mechatronics， 2007， 12（2）：143-153.
［35］BANDARI N， DARGAHI J， PACKIRISAMY M. Miniaturized Optical Force Sensor for Minimally Invasive Surgery with Learning-based Nonlinear Calibration［J］. IEEE Sensors Journal， 2020， 20（7）：3579-3592.
［36］HASLINGER R， LEYENDECKER P， SEIBOLD U. A Fiberoptic Force-Torque-sensor for Minimally Invasive Robotic Surgery［C］∥ IEEE International Conference on Robotics and Automation. Karlsruhe， 2013：4390-4395.
［37］HOSEOK S， HEECHUL K， JUWON J， et al. Development of FBG Sensor System for Force-feedback in Minimally Invasive Robotic Surgery［C］∥ 5th International Conference on Sensing Technology. Palmerston North， 2011：16-20.
［38］LYU C， WANG S， SHI C. A High-precision and Miniature Fiber Bragg Grating-based Force Sensor for Tissue Palpation during Minimally Invasive Surgery［J］. Annals of Biomedical Engineering， 2019， 48（20）：669-681.
［39］姚斌，张建勋，代煜，等. 用于微创外科手术机器人的多维力传感器解耦方法研究［J］. 仪器仪表学报， 2020， 41（1）：147-153.
YAO Bin， ZHANG Jianxun， DAI Yu， et al. Research on Decoupling Method of Multi-dimensional Force Sensor Used in Minimally Invasive Surgical Robot［J］. Chinese Journal of Scientific Instrument， 2020， 41（1）：147-153.
［40］TADA M， SASAKI S， OGASAWARA T. Development of an Optical 2-axis Force Sensor Usable in MRI Environments［C］∥ Proceedings of IEEE Sensors. Orlando， 2002：984-989.
［41］PEIRS J， CLIJNEN J， REYNAERTS D， et al. A Micro Optical Force Sensor for Force Feedback during Minimally Invasive Robotic Surgery［J］. Sensors and Actuators A：Physical， 2004， 115（2）：447-455.
［42］MULLER M， HOFFMANN L， BUCK T， et al. Fiber Bragg Grating-based Force-Torque Sensor with Six Degrees of Freedom［J］. International Journal of Optomechatronics， 2009， 3（3）：201-214.
［43］POLYGERINOS P， SCHAEFFTER T， SENEVIRATNE L， et al. A Fibre-optic Catheter-tip Force Sensor with MRI Compatibility：a Feasibility Study［C］∥Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Minneapolis， 2009：1501-1504.
［44］AHMADI R， ARBATANI S， PACKIRISAMY M， et al. Micro-optical Force Distribution Sensing Suitable for Lump/Artery Detection［J］. Biomedical Microdevices， 2015， 17：10.
［45］XUE R F， REN B Y， HUANG J Q， et al. Design and Evaluation of FBG-based Tension Sensor in Laparoscope Surgical Robots［J］. Sensors， 2018， 18：2067.
［46］ZARRIN P S， ESCOTO A， XU R， et al. Development of a 2-DOF Sensorized Surgical Grasper for Grasping and Axial Force Measurements［J］. IEEE Sensors Journal， 2018， 18（7）：2816-2826.
［47］LI T， SHI C， REN H. A High-sensitivity Tactile Sensor Array Based on Fiber Bragg Grating Sensing for Tissue Palpation in Minimally Invasive Surgery［J］. IEEE/ASME Transactions on Mechatronics， 2018， 23（5）：2306-2315.
［48］SHI C， LI M， LYU C， et al. A High-sensitivity Fiber Bragg Grating-based Distal Force Sensor for Laparoscopic Surgery［J］. IEEE Sensors Journal， 2020， 20（5）：2467-2475.
［49］NOOHI E， PARASTEGARI S， EFRAN M. Using Monocular Images to Estimate Interaction Forces during Minimally Invasive Surgery［C］∥ 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems. Chicago， 2014：4297-4302.
［50］GESSERT N， BERINGHOFF J， OTTE C， et al. Force Estimation from OCT Volumes Using 3D CNNs［J］. International Journal of Computer Assisted Radiology and Surgery， 2018， 13（7）：1073-1082.
［51］ROSEN J， HANNAFORD B， MACFARLANE M P， et al. Force Controlled and Teleoperated Endoscopic Grasper for Minimally Invasive Surgery-experimental Performance Evaluation［J］. IEEE Transactions on Biomedical Engineering， 1999， 46（10）：1212-1221.
［52］SANG H， YUN J， MONFAREDI R， et al. External Force Estimation and Implementation in Robotically Assisted Minimally Invasive Surgery［J］. International Journal of Medical Robotics and Computer Assisted Surgery， 2017， 13（2）：28466997.
［53］THOLEY G， PILLARISETTI A， GREEN W， et al. Design， Development， and Testing of an Automated Laparoscopic Grasper with 3-D Force Measurement Capability［C］∥ International Symposium on Medical Simulation. Cambridge， 2004：38-48.
［54］KENNEDY C W， DESAI J P. A Vision-based Approach for Estimating Contact Forces：Applications to Robot-assisted Surgery［J］. Applied Bionics and Biomechanics， 2005， 2（1）：53-60.
［55］YOON S M， LEE M， KIM C. Sliding Perturbation Observer Based Reaction Force Estimation Method of Surgical Robot Instrument for Haptic Realization［J］. International Journal of Humanoid Robotics， 2015， 12（2）：1550013.
［56］AVILES A I， ALSALEH S， SOBREVILLA P， et al. Sensorless Force Estimation Using a Neuro-vision-based Approach for Robotic-assisted Surgery［C］∥ 7th International IEEE/EMBS Conference on Neural Engineering（NER）. Montpellier， 2015：86-89.
［57］RAHMAN N， LEE M. Actual Reaction Force Separation Method of Surgical Tool by Fuzzy Logic Based SMCSPO［J］. International Journal of Control， Automation， and Systems， 2015， 13（2）：379-389.
［58］ZHAO B， NELSON C A. Estimating Tool-tissue Forces Using a 3-Degree-of-freedom Robotic Surgical Tool［J］. Journal of Mechanisms and Robotics， 2016， 8（5）：051015.
［59］LIN W， SONG K. Instrument Contact Force Estimation Using Endoscopic Image Sequence and 3D Reconstruction Model［C］∥ 2016 International Conference on Advanced Robotics and Intelligent Systems（ARIS）. Taipei， 2016：16774744.
［60］LI Y， HANNAFORD B. Gaussian Process Regression for Sensorless Grip Force Estimation of Cable-driven Elongated Surgical Instruments［J］. IEEE Robotics and Automation Letters， 2017， 2（3）：1312-1319.
［61］HWANG W， LIM S. Inferring Interaction Force from Visual Information without Using Physical Force Sensors［J］. Sensors， 2017， 17（11）：2455.
［62］WANG Z Y， WANG D M， CHEN B， et al. A Clamping Force Estimation Method Based on a Joint Torque Disturbance Observer Using PSO-BPNN for Cable-driven Surgical Robot End-effectors［J］. Sensors（Basel）， 2019， 19（23）：5291.
［63］XUE R F， DU Z J， YAN Z Y， et al. An Estimation Method of Grasping Force for Laparoscope Surgical Robot Based on the Model of a Cable-pulley System［J］. Mechanism and Machine Theory， 2019， 134：440-454.

[1]	DING Kai, LI Qilin, LEI Weining, XU Mingzhou, WANG Xu. Material Removal Mechanism during UAG of SiC Ceramic with a Brazed Single Abrasive Grain Tool [J]. China Mechanical Engineering, 2021, 32(19): 2331-2339.
[2]	LI Xinqing, ZHAO Qinghai, ZHANG Hongxin, ZHANG Tiezhu, CHEN Jianliang. Steady-state Heat Conduction Topology Optimization Design for Periodic Functional Gradient Structures [J]. China Mechanical Engineering, 2021, 32(19): 2348-2356.
[3]	SHAN Zenghai, LI Zhiyuan, ZHANG Xu, HUANG Yixiang, LI Yanming, LIU Chengliang, ZHANG Xuan. Health Status Assessment of Hydraulic Pumps Based on Multi-sensor Information Fusion and Multi-grained Cascade Forest Model [J]. China Mechanical Engineering, 2021, 32(19): 2374-2382.
[4]	. Quasi-Hertz Loaded Tooth Contact Analysis of Gears Based on Ease-off Surface Topology [J]. China Mechanical Engineering, 2021, 32(18): 2174-2180.
[5]	LIU Yanxiong, WANG Genju, HUA Lin, ZHAO Xinhao, . Double-drive Coordinated Control Systems of Fine Stamping Machines Based on Adaptive Sliding Mode Variable Structure Control [J]. China Mechanical Engineering, 2021, 32(18): 2189-2196.
[6]	GE Jimin, DENG Zhaohui, LI Wei, LI Chongyang, CHEN Xi, PENG Deping. Research Progresses of Robot Grinding and Polishing Force Compliance Controls [J]. China Mechanical Engineering, 2021, 32(18): 2217-2230,2238.
[7]	MAO Meijiao, XU Qing, LIU Jingli, YUAN Julong, LI Min, HU Zihua. Contact States of Workpiece-Abrasive Particles-Polishing Pad in Cemented Carbide CMP Processes [J]. China Mechanical Engineering, 2021, 32(17): 2074-2081.
[8]	HU Lai, ZHA Jun, ZHU Yongsheng, WEI Wenming, LI Dongya, LUO Ming, NIU Wentie, CHEN Yaolong. Research Progresses of Basic Equipment Manufacturing and High-grade Integrated CNC Machine Tools [J]. China Mechanical Engineering, 2021, 32(16): 1891-1903.
[9]	NIU Bin, YAN Jiaming, MAO Yuming, LIU Haiyang. Collaborative Design Optimization of Damping Layers and Stiffener Layout of Thin-walled Stiffened Plate Structures for Dynamics Performances [J]. China Mechanical Engineering, 2021, 32(16): 1912-1920.
[10]	LU Hao, CHEN Yang, WU Huaiyu, CHENG Lei, . Path Planning of Substation Inspection Robot under Road Network and Measurement Constraints [J]. China Mechanical Engineering, 2021, 32(16): 1972-1982.
[11]	ZHOU Xiaochun, LIANG Jun, CHEN Long, WANG Yafei, GONG Jinfeng. Intelligent Connected Vehicle PnP Networking Model and Decision Fusion Algorithm [J]. China Mechanical Engineering, 2021, 32(16): 1983-1993.
[12]	GU Zhenhua, LI Ke, GU Jiefei, , SU Lei, SU Wensheng. Fatigue Crack Growth Prediction Based on NPF Algorithm [J]. China Mechanical Engineering, 2021, 32(14): 1709-1715.
[13]	GE Kedi, ZHAO Huan, CHEN Pengfei, DING Han. Programming by Demonstration with Virtual Fixture Assistance for Robotic Machining of Complex Surfaces [J]. China Mechanical Engineering, 2021, 32(14): 1716-1725.
[14]	ZHANG Ying, SUN Hao, MA Shuaishuai. Design of a Kind of Multi-dimensional Attitude Adjustment and Vibration Isolation Platform Based on 4-UPS/CPC Parallel Mechanisms#br# [J]. China Mechanical Engineering, 2021, 32(13): 1513-1522,1529.
[15]	LI Yujia, HUANG Bing, LU Juan, ZHONG Qijing, CHEN Chaoyi, LIAO Xiaoping, MA Junyan. Multi-objective Optimization of Cutting Parameters in Ti6Al4V Milling Processes Based on Finite Element Simulation#br# [J]. China Mechanical Engineering, 2021, 32(13): 1555-1561,1570.