|
|
|
| Research on Bayesian Network Structure Learning Based on Hybrid Simplified Particle Swarm Algorithm |
| LIU Haoran1,2,LI Sheng1,2,CUI Shaopeng1,2,WANG Niantai1,2,CAI Yanbin1,2,SHI Qianrui1,2,ZHANG Liyue1,2 |
1. School of Information Science and Engineering, Yanshan University, Qinhuangdao, Hebei 066004, China
2. The Key Laboratory for Special Fiber and Fiber Sensor of Hebei Province, Qinhuangdao, Hebei 066004, China |
|
|
|
|
Abstract In order to improve the problems that the current Bayesian network structure learning algorithm tends to fall into local optimization, premature convergence and low optimization efficiency, a hybrid simplified particle swarm algorithm is proposed to optimize Bayesian network structure learning(BNs-HsPSO). The algorithm uses the maximum support tree to constrain the search space, and proposes an initial orientation strategy combining V-structure and conditional relative average entropy(CRAE), and then uses the mountain-climbing strategy to establish the initial particle swarm, uses the improved particle swarm optimization algorithm and genetic algorithm to iteratively optimize the initial population, proposes a conditional crossing and mutation strategy in the iterative process to avoid random divergence update of particles, and updates the unoptimized particles in combination with the sub-particle slowing strategy to avoid the algorithm falling into local optimum. The algorithm is compared with other algorithms in simulation experiments under four standard networks.The experimental results show that the proposed algorithm has an average higher BIC score of 5.775%, 5.8%, 0.475%, and 2.75% compared to MMHC, GS, BNC-PSO, and PC-PSO algorithms in ASIA, CAR, CHILD, and ARM networks, respectively; the Hamming distance HD is lower and the accuracy ACC is higher.
|
|
Received: 10 April 2023
Published: 21 February 2024
|
|
|
|
|
|
| ［8］ |
WANG Z, GAO X, TAN X, et al. Learning Bayesian networks using A search with ancestral constraints［J］. Neurocomputing (Amsterdam), 2021, 451: 107-124.
|
|
HU W, LI Z S. A Simplified and Efficient Particle Swarm Optimization Algorithm［J］. Journal of Software, 2007(4): 861-868.
|
|
TANG L, FAN Y F, XU S F, et al. Fault Diagnosis of Rolling Bearing Based on Bayesian Optimization and Improved LeNet-5［J］. Acta Metrologica Sinica, 2022, 43(7): 913-919.
|
| ［7］ |
吕志刚, 李叶, 王洪喜, 等. 贝叶斯网络的结构学习综述［J］. 西安工业大学学报, 2021, 41(1): 1-17.
|
| ［14］ |
刘浩然, 苏昭玉, 张力悦,等. 改进遗传-狼群对节点序寻优的贝叶斯网络结构算法［J］. 计量学报, 2023, 44(1): 120-126.
|
|
SHI P M, LIU A Y, ZHANG Y L, et al. Chatter Monitoring Method of Rolling Mill Based on Dynamic Bayesian Network and Dempster/Shafer Evidence Theory［J］. Acta Metrologica Sinica, 2022, 43(9): 1178-1185.
|
| ［12］ |
MADSEN A L, JENSEN F, SALMERN A, et al. A parallel algorithm for Bayesian network structure learning from large data sets［J］. Knowledge-Based Systems, 2017, 117: 46-55.
|
| ［13］ |
武梦娇, 刘继. 基于微生物遗传算法的贝叶斯网络结构学习［J］. 重庆科技学院学报(自然科学版), 2020, 22(6): 70-74.
|
| ［2］ |
LIU K, CUI Y, REN J, et al. An Improved Particle Swarm Optimization Algorithm for Bayesian Network Structure Learning via Local Information Constraint［J］. IEEE access, 2021.DOI:10.1109/ACCESS.2021.3065532.
|
| ［4］ |
CAO Y, RAOOF M, SZABO E, et al. Using Bayesian Networks to Predict Long-Term Health-Related Quality of Life and Comorbidity after Bariatric Surgery: A Study Based on the Scandinavian Obesity Surgery Registry［J］. Journal of Clinical Medicine, 2020, 9(6): 1895.
|
| ［11］ |
ANDREWS B, RAMSEY J, COOPER G F. Scoring Bayesian networks of mixed variables［J］. International Journal of Data Science and Analytics, 2018, 6(1): 3-18.
|
|
LIU H R, ZHANG L Y, FAN R X, et al. Bayesian Network Structure Learning Based on Improved Whale Optimization Strategy［J］. Journal of Electronics & Information Technology, 2019, 41(6): 1434-1441.
|
| ［18］ |
WANG T, YANG J. A heuristic method for learning Bayesian networks using discrete particle swarm optimization［J］. Knowledge and Information Systems, 2010, 24(2): 269-281.
|
| ［3］ |
WANG J, LIU S. A novel discrete particle swarm optimization algorithm for solving bayesian network structures learning problem［J］. International journal of computer mathematics, 2019, 96(12): 2423-2440.
|
|
L Z G, LI Y, WANG H X, et al. Overview of Bayesian Network Structure Learning［J］. Journal of Xian Technological University, 2021, 41(1): 1-17.
|
| ［16］ |
刘浩然, 张力悦, 范瑞星, 等. 基于改进鲸鱼优化策略的贝叶斯网络结构学习算法［J］. 电子与信息学报, 2019, 41(6): 1434-1441.
|
|
FAN R X, LIU H R, ZHANG L Y, et al. Hybrid particle Swarm-Difference Algorithm for Bayesian Network Inference Learning［J］. Small microcomputer system, 2020, 41(6): 1156-1162.
|
| ［22］ |
WANG J, LIU S. Learning Bayesian networks based on bi-velocity discrete particle swarm optimization with mutation operator［J］. Open mathematics (Warsaw, Poland), 2018, 16(1): 1022-1036.
|
| ［27］ |
单国厚, 刘建, 水艳, 等. 贪婪搜索算法在卫星调度中的应用［J］. 计算机应用, 2017, 37(6): 1814-1819.
|
| ［6］ |
时培明, 刘奥运, 张逸伦, 等. 基于动态贝叶斯网络与DS证据理论的轧机颤振监测方法［J］. 计量学报, 2022, 43(9): 1178-1185.
|
|
LIU H R, SU Z Y, ZHANG L Y, et al. Bayesian Network Structure Learning for Node Order Optimization Based on Improved Genetic-Wolf Pack Algorithm［J］. Acta Metrologica Sinica, 2023, 44(1): 120-126.
|
| ［20］ |
GHEISARI S, MEYBODI M R. BNC-PSO: structure learning of Bayesian networks by Particle Swarm Optimization［J］. Information sciences, 2016, 348: 272-289.
|
| ［24］ |
胡旺, 李志蜀. 一种更简化而高效的粒子群优化算法［J］. 软件学报, 2007(4): 861-868.
|
| ［25］ |
刘浩然, 王念太, 王毅,等. 基于V-结构&对数似然函数定向与禁忌爬山的贝叶斯网络结构算法［J］. 电子与信息学报, 2021,43(11):3272-3281.
|
|
SHANG G H, LIU J, SHUI Y et al. Application of greedy search algorithm in satellite scheduling［J］. Journal of Computer Applications, 2017, 37(6): 1814-1819.
|
| ［21］ |
SHYAMA D , IDICULA S M .Greedy Search-Binary PSO Hybrid for Biclustering Gene Expression Data［J］. International Journal of Computer Applications, 2010,2(3):1-5.
|
|
LIU H R, WANG N T, WANG Y,et al. Bayesian Network Structure Algorithm Based on V-structure & Log-Likelihood Orientation and Tabu Hill Climbing［J］. Journal of Electronics & Information Technology, 2021,43(11):3272-3281.
|
| ［26］ |
TSAMARDINOS I, BROWN L E , ALIFERIS C F. The max-min hill-climbing Bayesian network structure learning algorithm［J］. Machine Learning, 2006, 65(1):31-78.
|
| ［28］ |
王守会, 覃飙. 基于集成学习和反馈策略的贝叶斯网络结构学习［J］. 计算机学报, 2021, 44(6): 1051-1063.
|
| ［1］ |
LI M, ZHANG R, LIU K. A New Ensemble Learning Algorithm Combined with Causal Analysis for Bayesian Network Structural Learning［J］. Symmetry, 2020(12).doi:10.3390/SYM12122054..
|
| ［9］ |
GUO Z, CONSTANTINOU A C. Approximate Learning of High Dimensional Bayesian Network Structures via Pruning of Candidate Parent Sets［J］. Entropy (Basel), 2020.doi:10.3390/e22101142.
|
| ［10］ |
JIANG Y, LIANG Z, GAO H, et al. An improved constraint-based Bayesian network learning method using Gaussian kernel probability density estimator［J］. Expert systems with applications, 2018, 113: 544-554.
|
| ［23］ |
SUN B, ZHOU Y, WANG J, et al. A new PC-PSO algorithm for Bayesian network structure learning with structure priors［J］. Expert Systems with Applications, 2021,184: 115237.
|
|
WANG S H, QIN B. Bayesian Network Structure by Ensemble Learning and Feedback Strategy［J］. Chinese Journal of Computers, 2021, 44(6): 1051-1063.
|
| ［5］ |
汤亮, 凡焱峰, 徐适斐,等. 基于贝叶斯优化与改进LeNet-5的滚动轴承故障诊断［J］. 计量学报, 2022, 43(7): 913-919.
|
|
WU M J, LIU J. Bayesian network structure learning based on microbial genetic Algorithm［J］. Journal of Chongqing University of Science and Technology (Natural Science Edition), 2022, 22(6): 70-74.
|
| ［15］ |
刘浩然, 孙美婷, 李雷, 等. 基于蚁群节点寻优的贝叶斯网络结构算法研究［J］. 仪器仪表学报, 2017, 38(1): 143-150.
|
|
LIU H R, SUN M T, LI L, et al. Study on Bayesian network structure learning algorithm based onant colony node order optimization［J］. Chinese Journal of Scientific Instrument, 2017, 38(1): 143-150.
|
| ［17］ |
范瑞星, 刘浩然, 张力悦, 等. 贝叶斯网络推理学习的混合粒子群-差分算法［J］. 小型微型计算机系统, 2020, 41(6): 1156-1162.
|
| ［19］ |
ZHANG Q, LI Z, ZHOU C J, et al. Bayesian network structure learning based on the chaotic particle swarm optimization algorithm［J］. Genet Mol Res, 2013, 12(4): 4468-4479.
|
|
|
|
2024, Vol. 45 
