基于部分可观察马尔可夫决策过程的机电装备动态可靠性评价方法

摘要/Abstract

摘要： 针对机电装备运行维护问题,提出了基于部分可观察马尔可夫决策过程(POMDP)理论的动态可靠性评价方法。该方法将可靠性动态演变看成POMDP问题,通过不完全观测到的设备运行信息（如噪声、温度、压力等）,对可靠性状态进行估计,同时分析不同的维修行为对可靠性水平的影响规律,构建了基于状态转移的动态可靠性评价模型。然后,提出了以最小化维修成本费用和潜在故障危害为目标的维护策略制定方法,并通过案例分析验证了该方法的有效性,实现了机电装备动态可靠性的有效评价与维护策略的科学制订。

关键词: 可靠性评价;维护策略, POMDP;机电装备

Abstract: This paper focused on the operation and maintenance problems of electromechanical equipment, and proposed a new approach to assess the reliability and formulate the maintenance strategies based on POMDP theory. In the new approach, the dynamic reliability of electromechanical equipment was considered as an uncertain state which might be estimated by the monitoring informations (such as noise, pressure, temperature, vibration, et al.) according to POMDP theory. Furthermore, the influences of different maintenance strategies on reliability level of electromechanical equipment were investigated, and a dynamic reliability model was developed based on state transition. In order to plan the optimal maintenance strategy, an evaluation function was defined by minimizing the maintenance costs and the lost of faults. The experimental results confirm that the new approach based on POMDP is reasonable for electromechanical equipment, and possesses application and dissemination values.

Key words: reliability assessment, maintenance policy, partially observable Markov decision process(POMDP), electromechanical equipment

中图分类号:

TB114.3

张红旗, 邵晓东, 胡祥涛. 基于部分可观察马尔可夫决策过程的机电装备动态可靠性评价方法[J]. 中国机械工程.

Zhang Hongqi, Shao Xiaodong, Hu Xiangtao. Dynamic Reliability Assessment Method Based on POMDP for Electromechanical Equipment[J]. China Mechanical Engineering.

参考文献

[1]刘繁茂,朱海平,邵新宇,等.状态不完全可观条件下设备检修策略研究[J].计算机集成制造系统,2009,15(8):1628-1632.

Liu Fanmao, Zhu Haiping, Shao Xinyu, et al. Inspection and Maintenance Policy of Machine Based on Partially Observable Markov Decision Processes[J]. Computer Integrated Manufacturing Systems, 2009, 15(8):1628-1632.

[2]黄飞腾,郁军,肖航.基于Markov状态转移的动态可靠性分析[J].海军工程大学学报,2002,14(6):80-83.

Huang Feiteng, Yu Jun, Xiao Hang. Dynamic Reliability Analysis Based on Markov State Transition[J]. Journal of Naval University of Engineering, 2002, 14(6):80-83.

[3]Siu N. Risk Assessment for Dynamic Systems: an Overview[J]. Reliability Engineering and System Safety, 1994,43:43-73.

[4]Ellis H, Jiang Mingxiang, Corotis R B. Inspection, Maintenance, and Repair with Partial Observability[J]. Journal of Infrastructure System, 1995, 1(2):92-99.

[5]Cassandra A R. A Survey of POMDP Applications[C]//Proceedings of the 3rd Annual Conference on Uncertainty in Artificial Intelligence (UAI-98). San Francisco, CA., USA: Morgan Kaufmann, 1998:472-478.

[6]Kuo Y. Optimal Adaptive Control Policy for Joint Machine Maintenance and Product Quality Control[J]. European Journal of Operational Research, 2006, 171(2):586-597.

[7]Ivy J S, Nembhard H B. A Modeling Approach to Maintenance Decisions Using Statistical Quality Control and Optimization [J]. Quality and Reliability Engineering International, 2005, 21(4):355-366.

[8]Hsu S P, Arapostathis A. Safety Control of Partially Observed MDPs with Applications to Machine Maintenance problems[C]//Proceedings of IEEE International Conference on Systems, Man and Cybemetics. Hague, Netherlands: IEEE, 2004:261-265.

[9]胡祥涛,张红旗,林宁,等.基于动态贝叶斯网络的天线俯仰系统动态可靠性评估[J].电子机械工程,2014,30(6):22-26.

Hu Xiangtao, Zhang Hongqi, Lin Ning, et al. Reliability Assessment for Antenna Pitching System Based on Dynamic Bayesian Network[J]. Electro-mechanical Engineering, 2014, 30(6):22-26.

[10]沈戈,苏春,许映秋.基于Petri网理论的动态系统可靠性建模方法研究[J].机械工程与自动化,2006,30(2):1-3.

Shen Ge, Su Chun, Xu Yingqiu. Research on Dynamic System Reliability Modeling Method Based on Petri Net Theory[J]. Mechanical Engineering & Automation, 2006, 30(2):1-3.

[11]尚永爽,许爱强,李文海,等.部分可观测信息条件下系统最佳检修策略分析[J].系统工程与电子技术,2012,34(4):749-753.

Shang Yongshuang, Xu Aiqiang, Li Wenhai, et al. Analysis of Optimal Inspection and Maintenance Policy with Partially Observed Information[J]. System Engineering and Electronics, 2012, 34(4):749-753.

[12]胡祥涛,张红旗,李自成,等.基于部分可观测Markov决策过程理论的盾构推进载荷规划[J].机械工程学报,2014,50(21):84-91.

Hu Xiangtao, Zhang Hongqi, Li Zicheng， et al. POMDP-based Planning Model of Driving Force During Shield Tunneling[J]. Journal of Mechanical Engineering, 2014, 50(21):84-91.

[13]Monahan G E. ASurvey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms[J]. Management Science, 1982, 28(1):1-16.

[14]Hu Xiangtao, Huang Yongan, Yin Zhoupin, et al. Driving Force Planning in Shield Tunneling Based on Markov Decision Processes[J]. Sci. China Tech. Sci., 2012, 55(4):1022-1030.

[15]Puterman M L. Markov Decision Processes: Discrete Stochastic Dynamic Programming[M]. New York: John Wiley & Sons Inc，1994.