Intention Recognition Method of Human Robot Cooperative Assembly Based on EEG-EMG Signals

doi:10.3969/j.issn.1004-132X.2022.17.008

Abstract

Abstract: Aiming at the problems of low accuracy and poor stability of identifying cooperative intention based on single source physiological electrical signals in human robot cooperative assembly scene， firstly， support vector machine was used to recognize single source cooperative assembly intentions from EEG and EMG signals respectively， and then D-S evidence theory was used to fuse the recognition results of multi-source cooperative assembly intentions. A human robot collaborative assembly intention recognition method was proposed based on EEG-EMG signals. Experimental results show that the proposed method may effectively improve the accuracy and stability of human robot cooperative assembly intention recognition.

Key words: human robot collaboration, assembly, intention recognition, electroencephalogram（EEG） signals, electromyogram（EMG） signals

摘要： 针对人机协作装配场景下基于单源生理电信号识别协作意图准确率不高、稳定性不好的问题，首先采用支持向量机方法分别从脑电信号和肌电信号识别单源协作装配意图，然后采用D-S证据理论对多源协作装配意图识别结果进行融合，提出了一种融合EEG-EMG信号的人机协作装配意图识别方法。实验结果表明，所提方法可以有效提高人机协作装配意图识别的准确率和稳定性。

关键词: 人机协作, 装配, 意图识别, 脑电信号, 肌电信号

CLC Number:

TP274

DONG Yuanfa, JIANG Lei, PENG Wei, ZHOU Bin, FANG Zifan. Intention Recognition Method of Human Robot Cooperative Assembly Based on EEG-EMG Signals[J]. China Mechanical Engineering, 2022, 33(17): 2071-2078.

董元发, 蒋磊, 彭巍, 周彬, 方子帆. 融合脑电-肌电信号的人机协作装配意图识别方法[J]. 中国机械工程, 2022, 33(17): 2071-2078.

References

［1］刘检华，孙清超，程晖，等. 产品装配技术的研究现状、技术内涵及发展趋势［J］. 机械工程学报， 2018， 54（11）：2-28.
LIU Jianhua， SUN Qingchao， CHENG Hui， et al. The State-of-the-art， Connotation and Developing Trends of the Products Assembly Technology［J］. Journal of Mechanical Engineering， 2018， 54（11）：2-28.
［2］肖明珠，朱文敏，范秀敏. 人机时空共享协作装配技术研究综述［J］. 航空制造技术， 2019， 62（18）：24-32.
XIAO Mingzhu， ZHU Wenmin， FAN Xiumin. A Review on Human-robot Time-space Sharing Collaborative Assembly Technology［J］. Aeronautical Manufacturing Technology， 2019， 62（18）：24-32.
［3］WANG L， GAO R， VNCZA J， et al. Symbiotic Human-robot Collaborative Assembly［J］. CIRP Annals—Manufacturing Technology， 2019， 68（2）：701-726.
［4］NIKOLAIDIS S， RAMAKRISHNAN R， GU K， et al. Efficient Model Learning from Joint-action Demonstrations for Human-robot Collaborative Tasks［C］∥10th ACM/IEEE International Conference on Human-robot Interaction（HRI）. Portland， OR， 2015：189-196.
［5］SICHAO L， LIHUI W， VINCENT W X. Sensorless Haptic Control for Human-robot Collaborative Assembly［J］. CIRP Journal of Manufacturing Science and Technology， 2021， 32：132-144.
［6］LIU D X， XU J， CHEN C， et al. Vision-assisted Autonomous Lower-limb Exoskeleton Robot［J］. IEEE Transactions on Systems， Man， and Cybernetics：Systems， 2021， 51（6）：3759-3770.
［7］PRAKAKSITA N， KUO C Y， KUO C H. Development of a Motor Imagery BasedBrain-computer Interface for Humanoid Robot Control Applications［C］∥2016 IEEE International Conference on Industrial Technology（ICIT）. Taipei， 2016：1607-1613.
［8］TANG J， JIANG J， YU Y， et al. Humanoid Robot Operation by a Brain-computer Interface［C］∥7th International Conference on Information Technology in Medicine and Education（ITME）. Huangshan， 2015：476-479.
［9］PRATAKSITA N， LIN Y T， CHOU H C， et al. Brain-robot Control Interface：Development and Application［C］∥IEEE International Symposium on Bioelectronics and Bioinformatics（IEEE ISBB 2014）. Chung Li， 2014：1-4.
［10］WANG L， LIU S， COOPER C， et al. Function Block-based Human-robot Collaborative Assembly Driven by Brainwaves［J］. CIRP Annals—Manufacturing Technology， 2021， 70（1）：5-8.
［11］LIU Y， HABIBNEZHAD M， JEBELLI H. Brain-computer Interface for Hands-free Teleoperation of Construction Robots［J］. Automation in Construction， 2021， 123：1-16.
［12］DING Q， HAN J， ZHAO X. Continuous Estimation of Human Multi-joint Angles from sEMG Using a State-space Model［J］. IEEE Transactions on Neural Systems and Rehabilitation Engineering， 2017， 25（9）：1518-1528.
［13］CALABR R， NARO A， RUSSO M， et al. Shaping Neuroplasticity by Using Powered Exoskeletons in Patients with Stroke：a Randomized Clinical Trial［J］. Journal of NeuroEngineering and Rehabilitation， 2018， 15（1）：1-16.
［14］谢平，陈迎亚，郝艳彪，等. 基于脑肌电融合的混合脑机接口研究［J］. 中国生物医学工程学报， 2016， 35（1）：20-30.
XIE Ping， CHEN Yingya， HAO Yanbiao， et al. Multimodal Fusion of EEG and EMG Signals for a Hybrid BCI［J］. Chinese Journal of Biomedical Engineering， 2016， 35（1）：20-30.
［15］LEEB R， SAGHA H， CHAVARRIAGA R， et al. A Hybrid Brain-computer Interface Based on the Fusion of Electroencephalographic and Electromyographic Activities［J］. Journal of Neural Engineering， 2011， 8（2）：025011.
［16］HOODA N， DAS R， KUMAR N. Fusion of EEG and EMG Signals for Classification of Unilateral Foot Movements［J］. Biomedical Signal Processing and Control， 2020， 60：101990.
［17］LI X， SAMUEL O W， ZHANG X， et al. A Motion-classification Strategy Based on sEMG-EEG Signal Combination for Upper-limb Amputees［J］. Journal of Neuroengineering & Rehabilitation， 2017， 14（1）：1-13.
［18］XI X， MA C， YUAN C， et al. Enhanced EEG-EMG Coherence Analysis Based on Hand Movements［J］. Biomedical Signal Processing and Control， 2020， 56：101727.
［19］WAN B， LIU Y， MING D， et al. Feature Recognition of Multi-class Imaginary Movements in Brain-computer Interface［C］∥IEEE International Conference on Virtual Environments， Human-computer Interfaces and Measurements Systems. Hong Kong， 2009：250-254.
［20］THOMAS K P， GUAN C， LAU C T， et al. A New Discriminative Common Spatial Pattern Method for Motor Imagery Brain-computer Interfaces［J］. IEEE Transactions on Biomedical Engineering， 2009， 56（11）：2730-2733.
［21］RAMOSER H， MULLER-GERKING J. Optimal Spatial Filtering of Single Trial EEG during Imagined Hand Movement［J］. IEEE Transactions on Rehabilitation Engineering， 2000， 8：441-446.
［22］DONG E Z， LI C H， LI L T， et al. Classification of Multi-class Motor Imagery with a Novel Hierarchical SVM Algorithm for Brain-computer Interfaces［J］. Medical & Biological Engineering & Computing， 2017， 55（10）：1809-1818.
［23］王崴，赵敏睿，高虹霓，等. 基于脑电和眼动信号的人机交互意图识别研究［J］. 航空学报， 2021， 42（2）：292-302.
WANG Wei， ZHAO Minrui， GAO Hongni， et al. Human-computer Interaction：EEG-based and Eye Tracking-based Intention Recognition ［J］. Acta Aeronautica et Astronautica Sinica， 2021， 42（2）：292-302.
［24］HSU C W， LIN C J. A Comparison of Methods for Multiclass Support Vector Machines［J］. IEEE Transactions on Neural Networks， 2002， 13（2）：415-425.

[1]	CHEN Shuai, GUO Feiyan, MENG Yuemei, WANG Mingyang, HOU Zhixia . Iterative Optimization and Evaluation Method for Repair Quantity of Aviation Structural Parts Considering Measured Data [J]. China Mechanical Engineering, 2022, 33(17): 2061-2070，2078.
[2]	LI Hao, XU Zhiling, XU Yong, ZHAO Youwei. Grouping Selective Assembly Method for Mechanical Products Based on Local Search Strategy for NSGA-Ⅱ [J]. China Mechanical Engineering, 2022, 33(09): 1127-1133.
[3]	HAN Zhoupeng, LIU Yong, BA Li, SHI Huifan. Discovery of Modular Units for Complex Three-dimension CAD Assembly Model Based on Complex Network [J]. China Mechanical Engineering, 2022, 33(06): 690-697，755.
[4]	FANG Yuntao, WANG Xiaodong, XU Song, WANG Huibin, LUO Yi, . Miniature Thread Pairs Automatic Assembly System for Gimbals [J]. China Mechanical Engineering, 2022, 33(06): 698-706.
[5]	ZHANG Haowei, CHEN Wenliang, WANG Min, PAN Jinwei, HUANG Wen. Lightweight Mobile Hole-drilling System Positioning Method Based on Redundant Reference Holes [J]. China Mechanical Engineering, 2021, 32(22): 2697-2704.
[6]	PAN Guowei, CHEN Wenliang. Optimization of Posture Adjustment Trajectory of a Redundant and Hybrid ADRM [J]. China Mechanical Engineering, 2021, 32(21): 2571-2576，2589.
[7]	ZHAO Lianpeng, TANG Qiuhua, ZHANG Zikai, MENG kai, . Multi-objective Restart Variable Neighborhood Search Algorithm for Assembly Line Balancing Considering Preventive Maintenance [J]. China Mechanical Engineering, 2021, 32(21): 2606-2616.
[8]	XIAO Shihong, ZHANG Jingke, ZHANG Huiyao, ZHOU Shichao, HE Xianyou, YUE Linlin. Analysis of Mechanics Characteristics and Contact Performance for Electrical Contacts under Great Temperature Variation Conditions [J]. China Mechanical Engineering, 2021, 32(19): 2383-2389.
[9]	ZHANG Jiahua, LI Aiping, LIU Xuemei. Routing Planning for Assembly Line Material Distributions under Interval Uncertain Travel Time [J]. China Mechanical Engineering, 2021, 32(18): 2239-2246.
[10]	GUO Lei, LIU Jianhua, ZHANG Jiapeng, LI Xiayu, ZHANG Xiumin, XIA Huanxiong. Research Status Analysis of Adhesively Connection Technology in Aerospace Industry#br# [J]. China Mechanical Engineering, 2021, 32(12): 1395-1405.
[11]	CHEN Hongyue, ZHANG Zhanli, LIN Qingzhu. Design and Research of Refrigeration Linear Compressor Spring Assembly [J]. China Mechanical Engineering, 2021, 32(12): 1449-1455.
[12]	GUO Jun, WANG Zhendong, DU Baigang, LI Yibing, . Selective Asynchronous Parallel Disassembly Sequence Planning Considering Indeterminate Degree of Disassembly#br# [J]. China Mechanical Engineering, 2021, 32(09): 1080-1090,1101.
[13]	LI Yi, TANG Qian, LIULianchao, PENG Xiaogang, YAN Xianhong. An Improved ACO Algorithm for Automobile Mixed-flow Assembly Scheduling Problems#br# [J]. China Mechanical Engineering, 2021, 32(09): 1126-1133.
[14]	ZHONG Baihong；WANG Lin；ZHONG Shisheng. Selective Assembly for Coordinator Parts by RNGRU Based on Comprehensive Grey Relational Order Model [J]. China Mechanical Engineering, 2021, 32(03): 314-320,356.
[15]	LIU Xuemei1;WANG Xiao1;LIU Yuelei2. Optimization of Assembly Line Material Distribution Planning under Fuzzy Time Window Constraints [J]. China Mechanical Engineering, 2020, 31(17): 2095-2103.