Non-negative Matrix Factorization Based on Clustering and Its Application

Abstract

Abstract: With the increasing complexity of electromechanical system state informations, traditional feature extraction and selection methods were unable to meet the needs. According to the characteristics of conventional non-negative matrix factorization(NMF) algorithm, a NMF method for monitoring and fault diagnosis was proposed based on the clustering property of NMF. By comparing classification accuracy and iteration efficiency, an improved alternating least square iterative algorithm with sparsity and correlation constraints was selected, and the low-dimensional embedded dimension and iterative initialization method were also determined. Experimental results to UCI test datasets and fault diagnosis of Tennessee-Eastman process(TEP) systems show that this approach is more effective to extract the fault features, and enhance the failure pattern capabilities.

Key words: non-negative matrix factorization（NMF）, clustering, iterative algorithm, feature selection

摘要： 针对不断增加的机电系统运行状态信息，传统的特征提取和选择方法已无法满足需求。根据非负矩阵分解典型算法的特点，基于非负矩阵分解的聚类特性，提出了一种面向故障诊断的分解方法。通过分类能力和迭代效率的对比分析，选择了相关性约束和稀疏性约束的改进型交替最小二乘迭代算法，确定了低维嵌入维数及迭代初始化方法，在UCI测试数据集和TEP系统的特征选择应用中验证了该方法的有效性。

关键词: 非负矩阵分解, 聚类, 迭代算法, 特征选择

CLC Number:

TH16

LI Maolin1;LIANG Lin2;CHEN Yuanming2;XU Guanghua2;HE Kangkang2. Non-negative Matrix Factorization Based on Clustering and Its Application[J]. China Mechanical Engineering.

栗茂林1;梁霖2;陈元明2;徐光华2;何康康2. 基于聚类优化的非负矩阵分解方法及其应用[J]. 中国机械工程.

References

[1]张培林，王怀光，张磊，等.非负矩阵分解在发动机故障特征提取中的应用[J].振动工程学报，2013，26(6)：944-950.
ZHANG Peilin，WANG Huaiguang，ZHANG Lei，et al. Feature Extraction for Engine Fault Diagnosis by Utilizing Adaptive Multi-scale Morphological Gradient and Non-negative Matrix Factorization[J]. Journal of Vibration Engineering，2013，26(6)：944-950.
[2]李兵，米双山，刘鹏远，等.二维非负矩阵分解在齿轮故障诊断中的应用[J].振动测试与诊断，2012，32(5)：836-840.
LI Bing，MI Shuangshan，LIU Pengyuan，et al. Application of Two-dimensional Non-negative Factorization for Gear Fault Diagnosis[J]. Journal of Viaration, Measurement & Diagnosis，2012，32(5)：836-840.
[3]陈霖，邹金慧.基于NMF-SVM的复杂化工过程故障诊断[J].计算机与应用化学，2014，31(8)：1015-1018.
CHEN Lin，ZOU Jinhui.Fault Diagnosis of Complex Chemical Process Based on NMF-SVM [J].Computers and Applied Chemistry，2014，31(8)：1015-1018.
[4]唐曦凌，梁霖，高慧中，等.结合连续小波变换和多约束非负矩阵分解的故障特征提取方法[J].振动与冲击，2013，32(19)：7-11.
TANG Xiling，LIANG Lin，GAO Huizhong，et al.Fault Feature Extraction Method Combining Continuous Wavelet Transformation with Multi-consitraint Nonnegative Matrix Factorization[J]. Journal of Vibration and Shock，2013，32(19)：7-11.
[5]WANG Yuxiong，ZHANG Yujin.Nonnegative Matrix Factorization: a Comprehensive Review[J]. IEEE Transactions on Knowledge and Data Engineering，2013，25(6)：1336-1353.
[6]BERRY M W，BROWNE M，LANGVILLE A N，et al. Algorithms and Applications for Approximate Nonnegative Matrix Factorization[J]. Computational Statistics & Data Analysis，2007，52(1)：155-173.
[7]LI T，DING C.The Relationships among Various Nonnegative Matrix Factorization Methods for Clustering[C]//Sixth International Conference on Data Mining. Hong Kong，2006：362-371.
[8]CICHOCKI A，ZDUNEK R，PHAN A H，et al. Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation [M]. Hoboken：Wiley，2009：203-213.
[9]YU Shaohui，ZHANG Yujun，LIU Wenqing，et al. A Novel Initialization Method for Nonnegative Matrix Factorization and Its Application in Component Recognition with Three-dimensional Fluorescence Spectra[J]. Spectrochimica Acta Part A: Molecular and Biomolecular Spectroscopy，2012，86：315-319.
[10]XUE Yun，TONG C S，CHEN Ying，et al. Clustering-based Initialization for Non-negative Matrix Factorization[J]. Applied Mathematics and Computation，2008，205 (2)：525-536.
[11]JANECEK A，TAN Y. Using Population Based Algorithms for Initializing Nonnegative Matrix Factorization[J]. Lecture Notes in Computer Science, 2011，6729：307-316.

[1]	HU Sheng1, 2, GAO Bingbing1, ZHANG Xi1, LIU Dengji1. Multicollinearity Parameter Feature Selection for Manufacturing Processes Based on LLEs [J]. China Mechanical Engineering, 2025, 36(06): 1238-1246.
[2]	QIN Datong, CHEN Moji, CAO Yuhang, GAO Di. Research on Driving Style Classification and Recognition Methods Based on Driving Events [J]. China Mechanical Engineering, 2024, 35(09): 1534-1541.
[3]	GUO Fengze, YANG Bo, RONG Zhixiang, YANG Junman, FENG Yishuo. Misalignment Monitoring System Based on Position Sensitive Detector [J]. China Mechanical Engineering, 2024, 35(08): 1509-1519.
[4]	GAO Wenbin1, 2, ZHAN Qingyuan1, 2. Research on Robot Parameter Calibration Based on Configuration Similarity Clustering [J]. China Mechanical Engineering, 2024, 35(07): 1168-1177，1187.
[5]	NIE Xin, TAN Tian, SHEN Danfeng. Research on Stamping Springback of Automobile Beam Parts Based on Deep Learning [J]. China Mechanical Engineering, 2023, 34(07): 838-846.
[6]	JIANG Jiawei, HU Yihuai, FANG Yunhu, ZHANG Chen, RUI Xiaosong, WANG Meng. Fault Diagnosis Method of Marine Fans Based on MTAD and Fuzzy Entropy [J]. China Mechanical Engineering, 2022, 33(10): 1178-1188.
[7]	LI Minbo, DONG Weiwei. Quality Prediction of Automotive Parts for Imbalanced Datasets [J]. China Mechanical Engineering, 2022, 33(01): 88-96.
[8]	ZOU Yuji, SONG Yuchuan, WANG Xinkun, WANG Yi. Clustering Genetic Algorithm for Multi-objective Integrated Scheduling of AGVs and Machine [J]. China Mechanical Engineering, 2022, 33(01): 97-108.
[9]	SHI Hongxia, WANG Jianmin. Feature Line Extraction for Point Cloud Based on Normal Vector Region Clustering Segmentation [J]. China Mechanical Engineering, 2021, 32(21): 2552-2561.
[10]	LIU Xiaofeng, TAN Qi, YE Rongting. Ensemble Variable Predictive Model Based on Optimal Features and Its Applications [J]. China Mechanical Engineering, 2021, 32(18): 2153-2158，2164.
[11]	LU Hao, CHEN Yang, WU Huaiyu, CHENG Lei, . Path Planning of Substation Inspection Robot under Road Network and Measurement Constraints [J]. China Mechanical Engineering, 2021, 32(16): 1972-1982.
[12]	ZHOU Xiaochun, LIANG Jun, CHEN Long, WANG Yafei, GONG Jinfeng. Intelligent Connected Vehicle PnP Networking Model and Decision Fusion Algorithm [J]. China Mechanical Engineering, 2021, 32(16): 1983-1993.
[13]	LIU Daoyuan, GUO Yu, HUANG Shaohua, FANG Weiguang, YANG Nengjun, CUI Shiting. A SOM-FWFCM Based Feature Selection Algorithm for Order Remaining Completion Time Prediction#br# [J]. China Mechanical Engineering, 2021, 32(09): 1073-1079.
[14]	LYU Youlong;XU Hongwei;ZHENG Cheng;ZHANG Jie;ZHENG Peng. #br# Wafer Acceptance Test Key Parameter Identification Based on Hybrid Feature Selection Method [J]. China Mechanical Engineering, 2020, 31(16): 1978-1984,1997.
[15]	GU Yong, YUAN Yuanyi, ZHANG Lie, DUAN Jingjing. Multi-depot Half Open Vehicle Routing Problem with Time Windows [J]. China Mechanical Engineering, 2020, 31(14): 1733-1740.