Intention Recognition Method of Human Robot Cooperative Assembly Based on EEG-EMG Signals

doi:10.3969/j.issn.1004-132X.2022.17.008

Abstract

Abstract: Aiming at the problems of low accuracy and poor stability of identifying cooperative intention based on single source physiological electrical signals in human robot cooperative assembly scene， firstly， support vector machine was used to recognize single source cooperative assembly intentions from EEG and EMG signals respectively， and then D-S evidence theory was used to fuse the recognition results of multi-source cooperative assembly intentions. A human robot collaborative assembly intention recognition method was proposed based on EEG-EMG signals. Experimental results show that the proposed method may effectively improve the accuracy and stability of human robot cooperative assembly intention recognition.

Key words: human robot collaboration, assembly, intention recognition, electroencephalogram（EEG） signals, electromyogram（EMG） signals

摘要： 针对人机协作装配场景下基于单源生理电信号识别协作意图准确率不高、稳定性不好的问题，首先采用支持向量机方法分别从脑电信号和肌电信号识别单源协作装配意图，然后采用D-S证据理论对多源协作装配意图识别结果进行融合，提出了一种融合EEG-EMG信号的人机协作装配意图识别方法。实验结果表明，所提方法可以有效提高人机协作装配意图识别的准确率和稳定性。

关键词: 人机协作, 装配, 意图识别, 脑电信号, 肌电信号

CLC Number:

TP274

DONG Yuanfa, JIANG Lei, PENG Wei, ZHOU Bin, FANG Zifan. Intention Recognition Method of Human Robot Cooperative Assembly Based on EEG-EMG Signals[J]. China Mechanical Engineering, 2022, 33(17): 2071-2078.

董元发, 蒋磊, 彭巍, 周彬, 方子帆. 融合脑电-肌电信号的人机协作装配意图识别方法[J]. 中国机械工程, 2022, 33(17): 2071-2078.

References

［1］刘检华，孙清超，程晖，等. 产品装配技术的研究现状、技术内涵及发展趋势［J］. 机械工程学报， 2018， 54（11）：2-28.
LIU Jianhua， SUN Qingchao， CHENG Hui， et al. The State-of-the-art， Connotation and Developing Trends of the Products Assembly Technology［J］. Journal of Mechanical Engineering， 2018， 54（11）：2-28.
［2］肖明珠，朱文敏，范秀敏. 人机时空共享协作装配技术研究综述［J］. 航空制造技术， 2019， 62（18）：24-32.
XIAO Mingzhu， ZHU Wenmin， FAN Xiumin. A Review on Human-robot Time-space Sharing Collaborative Assembly Technology［J］. Aeronautical Manufacturing Technology， 2019， 62（18）：24-32.
［3］WANG L， GAO R， VNCZA J， et al. Symbiotic Human-robot Collaborative Assembly［J］. CIRP Annals—Manufacturing Technology， 2019， 68（2）：701-726.
［4］NIKOLAIDIS S， RAMAKRISHNAN R， GU K， et al. Efficient Model Learning from Joint-action Demonstrations for Human-robot Collaborative Tasks［C］∥10th ACM/IEEE International Conference on Human-robot Interaction（HRI）. Portland， OR， 2015：189-196.
［5］SICHAO L， LIHUI W， VINCENT W X. Sensorless Haptic Control for Human-robot Collaborative Assembly［J］. CIRP Journal of Manufacturing Science and Technology， 2021， 32：132-144.
［6］LIU D X， XU J， CHEN C， et al. Vision-assisted Autonomous Lower-limb Exoskeleton Robot［J］. IEEE Transactions on Systems， Man， and Cybernetics：Systems， 2021， 51（6）：3759-3770.
［7］PRAKAKSITA N， KUO C Y， KUO C H. Development of a Motor Imagery BasedBrain-computer Interface for Humanoid Robot Control Applications［C］∥2016 IEEE International Conference on Industrial Technology（ICIT）. Taipei， 2016：1607-1613.
［8］TANG J， JIANG J， YU Y， et al. Humanoid Robot Operation by a Brain-computer Interface［C］∥7th International Conference on Information Technology in Medicine and Education（ITME）. Huangshan， 2015：476-479.
［9］PRATAKSITA N， LIN Y T， CHOU H C， et al. Brain-robot Control Interface：Development and Application［C］∥IEEE International Symposium on Bioelectronics and Bioinformatics（IEEE ISBB 2014）. Chung Li， 2014：1-4.
［10］WANG L， LIU S， COOPER C， et al. Function Block-based Human-robot Collaborative Assembly Driven by Brainwaves［J］. CIRP Annals—Manufacturing Technology， 2021， 70（1）：5-8.
［11］LIU Y， HABIBNEZHAD M， JEBELLI H. Brain-computer Interface for Hands-free Teleoperation of Construction Robots［J］. Automation in Construction， 2021， 123：1-16.
［12］DING Q， HAN J， ZHAO X. Continuous Estimation of Human Multi-joint Angles from sEMG Using a State-space Model［J］. IEEE Transactions on Neural Systems and Rehabilitation Engineering， 2017， 25（9）：1518-1528.
［13］CALABR R， NARO A， RUSSO M， et al. Shaping Neuroplasticity by Using Powered Exoskeletons in Patients with Stroke：a Randomized Clinical Trial［J］. Journal of NeuroEngineering and Rehabilitation， 2018， 15（1）：1-16.
［14］谢平，陈迎亚，郝艳彪，等. 基于脑肌电融合的混合脑机接口研究［J］. 中国生物医学工程学报， 2016， 35（1）：20-30.
XIE Ping， CHEN Yingya， HAO Yanbiao， et al. Multimodal Fusion of EEG and EMG Signals for a Hybrid BCI［J］. Chinese Journal of Biomedical Engineering， 2016， 35（1）：20-30.
［15］LEEB R， SAGHA H， CHAVARRIAGA R， et al. A Hybrid Brain-computer Interface Based on the Fusion of Electroencephalographic and Electromyographic Activities［J］. Journal of Neural Engineering， 2011， 8（2）：025011.
［16］HOODA N， DAS R， KUMAR N. Fusion of EEG and EMG Signals for Classification of Unilateral Foot Movements［J］. Biomedical Signal Processing and Control， 2020， 60：101990.
［17］LI X， SAMUEL O W， ZHANG X， et al. A Motion-classification Strategy Based on sEMG-EEG Signal Combination for Upper-limb Amputees［J］. Journal of Neuroengineering & Rehabilitation， 2017， 14（1）：1-13.
［18］XI X， MA C， YUAN C， et al. Enhanced EEG-EMG Coherence Analysis Based on Hand Movements［J］. Biomedical Signal Processing and Control， 2020， 56：101727.
［19］WAN B， LIU Y， MING D， et al. Feature Recognition of Multi-class Imaginary Movements in Brain-computer Interface［C］∥IEEE International Conference on Virtual Environments， Human-computer Interfaces and Measurements Systems. Hong Kong， 2009：250-254.
［20］THOMAS K P， GUAN C， LAU C T， et al. A New Discriminative Common Spatial Pattern Method for Motor Imagery Brain-computer Interfaces［J］. IEEE Transactions on Biomedical Engineering， 2009， 56（11）：2730-2733.
［21］RAMOSER H， MULLER-GERKING J. Optimal Spatial Filtering of Single Trial EEG during Imagined Hand Movement［J］. IEEE Transactions on Rehabilitation Engineering， 2000， 8：441-446.
［22］DONG E Z， LI C H， LI L T， et al. Classification of Multi-class Motor Imagery with a Novel Hierarchical SVM Algorithm for Brain-computer Interfaces［J］. Medical & Biological Engineering & Computing， 2017， 55（10）：1809-1818.
［23］王崴，赵敏睿，高虹霓，等. 基于脑电和眼动信号的人机交互意图识别研究［J］. 航空学报， 2021， 42（2）：292-302.
WANG Wei， ZHAO Minrui， GAO Hongni， et al. Human-computer Interaction：EEG-based and Eye Tracking-based Intention Recognition ［J］. Acta Aeronautica et Astronautica Sinica， 2021， 42（2）：292-302.
［24］HSU C W， LIN C J. A Comparison of Methods for Multiclass Support Vector Machines［J］. IEEE Transactions on Neural Networks， 2002， 13（2）：415-425.

[1]	Lingling SHI, Yimin DU, Lili GUO, Zhijing ZHANG, Xin JIN, Jiadi LI. Intelligent Decision-making for Assembly Processes of Micro-device Products [J]. China Mechanical Engineering, 2025, 36(10): 2159-2170.
[2]	Haining XIAO, Huihui SUN, Minghua PENG, Jianzhou WANG. An IMBOA Based Collaborative Sequencing Method for Automotive Multi Associated Workshops [J]. China Mechanical Engineering, 2025, 36(08): 1796-1810.
[3]	GUO Feiyan1, ZHANG Hui2, SONG Changjie1, ZHANG Shuo1. Identification and Evaluation of Key Error Elements in Complex Composite Aviation Componts Assembly Driven by Mechanism and Data Model Fusion [J]. China Mechanical Engineering, 2025, 36(07): 1530-1543.
[4]	WEN Xiaoyu1, ZHANG Hao1, ZHANG Yuyan1, LIU Siren2, JI Shuo1, GUO Weifei1, LI Hao1. Optimization of Laser Tracker Positions in Aircraft Assembly Processes under Digital Twin Environments [J]. China Mechanical Engineering, 2025, 36(07): 1573-1581,1635.
[5]	. Geometric Feature Modeling and Assembly Interference Detection Method for Large Ship Components [J]. China Mechanical Engineering, 2025, 36(07): 1636-1649.
[6]	WANG Yunfan1, 2, ZHU Libin1, 2, CUI Chuangchuang1, 2, HUANG Haihong1, 2. DIA Method for Multi-part Stacked Structure Devices Based on Disassembly Information Extraction [J]. China Mechanical Engineering, 2025, 36(06): 1269-1279.
[7]	GUO Feiyan1, ZHANG Yongliang2, LIU Jialiang1, ZHANG Hui2. Effects of Forced Positioning&Clamping on Geometric and Physical Assembly Performances for Composite Structures and Collaborative Guarantee Strategies [J]. China Mechanical Engineering, 2025, 36(04): 655-670.
[8]	TUO Yang, ZHANG Zeqiang, XIE Xinlan, SONG Haoxuan. Modeling and Optimization of Multimanned Two-sided Disassembly Line Balancing Problems for Walking Workers [J]. China Mechanical Engineering, 2025, 36(01): 113-122,132.
[9]	JIA Kang1, 2, TANG Jing1, 2, REN Dongxu1, 2, WANG Hao1, 2, ZHAO Qiangqiang1, 2, HONG Jun1, 2. Construction of Assembly Information Model Based on Assembly Feature Automatic Extraction for STEP Models [J]. China Mechanical Engineering, 2025, 36(01): 123-132.
[10]	FU Junjian1, 2, 4, MENG Yonggen1, WU Haihua1, HU Huan3, LI Xiang1, 2, ZHOU Xiangman1. Design and Performance Regulation of Discretely Assembled Octahedral Metamaterials [J]. China Mechanical Engineering, 2024, 35(12): 2268-2279.
[11]	LI Hao1, JIAO Yanchao1, ZHANG Yuyan1, ZHANG Hao1, XING Hongwen2, WEN Xiaoyu1, WANG Haoqi1, YE Guoyong1, GUAN Xiao2. Research on Station Optimization of Aircraft Assembly Laser Trackers Based on Digital Twins [J]. China Mechanical Engineering, 2024, 35(11): 1986-1994.
[12]	WANG Hong, WU Lihui, CHEN Da, ZHANG Jie. Scheduling in SAT in Multi-operation Mode Based on Artificial Hummingbird Algorithm with Twin Population [J]. China Mechanical Engineering, 2024, 35(02): 260-267，279.
[13]	LIN Jie, HU Zhikai, LIU Siyuan, TANG Weiwei, CHU Zhongyi. Assembly Array Tractile State Sensing Technology of Micro Flexible Flat Cables [J]. China Mechanical Engineering, 2024, 35(02): 287-292，304.
[14]	LIU Yi, YI Wangmin, YAO Jiantao, WANG Xingda, YU Peng, ZHAO Yongshen. Design and Research of Heavy-duty Posture-adjusting Assembly Robots in Narrow Space [J]. China Mechanical Engineering, 2024, 35(02): 324-336.
[15]	GUO Jutao, LYU Youlong, DAI Zheng, ZHANG Jie, GUO Yu. Compound Rules and Reinforcement Learning Based Scheduling Method for Mixed Model Assembly Lines [J]. China Mechanical Engineering, 2023, 34(21): 2600-2606,2614.