[质量优化]基于FP-Growth改进算法的轮胎质量数据分析

中国机械工程

[质量优化]基于FP-Growth改进算法的轮胎质量数据分析

李敏波1,2;丁铎1;易泳1

1.复旦大学软件学院, 上海，200433
2.复旦大学上海市数据科学重点实验室, 上海，200433

出版日期:2019-01-25 发布日期:2019-01-29
基金资助:
国家自然科学基金资助项目（61671157）；
上海科技创新行动计划资助项目（18511107800）;
山东省重大科技创新工程资助项目（2018CXGC0604）

Data Analysis of Tyre Quality Based on Improved FP-Growth Algorithm

LI Minbo1,2;DING Duo1;YI Yong1

1.Software School, Fudan University, Shanghai, 200433
2.Shanghai Key Laboratory of Data Science, Fudan University, Shanghai, 200433

Online:2019-01-25 Published:2019-01-29

摘要/Abstract

摘要： 针对轮胎制造过程质量异常的问题分析，介绍了轮胎质量数据获取、有效整合与数据分析流程，基于Hive数据仓库构建了生产数据与产品检测数据相关联的结构化数据集。针对现有频繁模式增长（FP-Growth）算法存在FP树建树性能较低与大数据处理效率低的问题，提出了一种改进的FP-Growth算法，在原有的频繁项头表基础上新增一个tail属性，加速FP树构建。实验结果表明，改进后的FP-Growth并行算法能够有效提高轮胎质量异常数据的关联分析效率, 能够找出影响轮胎质量的生产制造重要因素，并且适用于大数据量的数据挖掘。

关键词: 工业大数据, 质量分析, FP-Growth算法, 数据挖掘

Abstract: According to the problem analyses of abnormal quality in tyre manufacturing processes, tyre quality data acquisition, effective integration and data analysis processes were discussed. The structured data sets associated with production data and product inspection data were constructed based on Hive data warehouse. For the existing frequent pattern-growth (FP-Growth) algorithm, the performance of FP-tree was low, an improved FP-growth algorithm was proposed. A new tail attribute was added to the existing header table of frequent item and accelerate the construction of FP-tree. The experiments show that the improved FP-growth algorithm may effectively improve the correlation analysis efficiency of tyre quality abnormal data. The improved FP-growth algorithm is able to identify the factors that affect the quality of tire productions, and it is also suitable for large data mining.

Key words: industrial big data, quality analysis, FP-growth algorithm, data mining

中图分类号:

TP182

李敏波, 丁铎, 易泳. [质量优化]基于FP-Growth改进算法的轮胎质量数据分析[J]. 中国机械工程.

LI Minbo, DING Duo, YI Yong. Data Analysis of Tyre Quality Based on Improved FP-Growth Algorithm[J]. China Mechanical Engineering.

参考文献

[1]李敏波, 王海鹏, 陈松奎，等. 工业大数据分析技术与轮胎销售数据预测[J].计算机工程与应用,2017, 53(11):100-109.
LI Minbo, WANG Haipeng, CHEN Songkui, et al. Data Analysis of Industrial Big Data and Sales Forecast of Tyre Industry[J].Computer Engineering and Applications, 2017,53(11):100-109.
[2]刘强,秦泗钊.过程工业大数据建模研究展望[J].自动化学报, 2016, 42(2):161-171.
LIU Qiang, QIN Sizhao.Perspectives on Big Data Modeling of Process Industries[J].ACTA Automatica SINICA, 2016, 42(2):161-171.
[3]YAN Jihong, MENG Yue, LU Lei, et al. Industrial Big Data in an Industry 4.0 Environment: Challenges, Schemes and Applications for Predictive Maintenance[J]. IEEE Access, 2017, 5: 23484-23491.
[4]张洁, 高亮, 秦威，等.大数据驱动的智能车间运行分析与决策方法体系[J].计算机集成制造系统,2016, 22(5):1220-1228.
ZHANG Jie, GAO Liang, QIN Wei, et al. Big-data-driven Operational Analysis and Decision-making Methodology in Intelligent Workshop[J].Computer Integrated Manufacturing Systems， 2016, 22(5):1220-1228.
[5]YANG L P, WANG F Z, WANG T. Analysis of Dishonorable Behavior on Railway Online Ticketing System Based on K-means and FP-growth[C]//IEEE International Conference on Information and Automation. Macau,2017:1173-1177.
[6]AGRAWAL R, IMIELINSKI T, SWAMI A. Mining Association Rules between Sets of Items in Large Databases[C]//Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data.Washington, D. C., 1993:207-216.
[7]PEI J, HAN J, MAO R. An Efficient Algorithm for Mining Frequent Closed Itemsets[C]//ACM-SIGMOD Workshop on Data Mining and Knowledge Discovery. Dallas, 2000：146-148.
[8]GOUDA K, ZAI M J. Efficiently Mining Maximal Frequent Itemsets[C]//IEEE International Conference on Data Mining. San Jose, 2001:163-170.
[9]HAN Jiawei， PEI Jian, YIN Yiwen. Mining Frequent Patterns without Candidate Generation[J].ACM SIGMOD Record, 2000, 29(2):1-12.
[10]凌绪雄，王社国，李阳，等. 无项头表的FP-Growth算法[J].计算机应用, 2001,31(5):1391-1394.
LING Xuxiong, WANG Sheguo, LI Yang, et al. No-header-table FP-Growth Algorithm[J].Journal of Computer Applications, 2001,31(5):1391-1394.
[11]余彪,刘守全.基于FP-growth算法的改进关联规则挖掘算法[J].计算机与网络,2017,43(14):68-71.
YU Biao, LIU Shouquan. Improved Association Rules Mining Algorithm Based on FP-Growth Algorithm[J].Computer and Network, 2017,43(14):68-71.
[12]AISSATOU D, FODE C, SANBA N. S-FPG: A Parallel Version of FP-Growth Algorithm under Apache Spark[C]//2nd IEEE International Conference on Cloud Computing and Big Data Analysis. Chengdu, 2017:98-101.
[13]ZHOU Le, ZHONG Zhiyong, CHANG Jin, et al. Balanced Parallel FP-Growth with Map Reduce[C]//IEEE Youth Conference on Information, Computing and Telecommunications. Beijing,2010:243-246.