区域渐近增强与感受野结合的多核近似学习网

doi:10.3969/j.issn.1000-1158.2021.06.02

摘要
图/表
参考文献(26)
相关文章 (15)

全文: PDF (2760 KB) HTML (1 KB)
输出: BibTeX | EndNote (RIS)

摘要为充分提取图像中可辨识信息、提高分类正确率,提出多核近似学习网,该网络主要由2部分构成。在特征提取部分,利用二维高斯分布对原始图像进行区域渐进增强,局部感受野和全局感受野被用于充分提取原始图像和区域渐进增强图像中的局部和全局特征,并将其串联以组成代表图像的特征向量。在分类部分,提出多核近似算法,将近似核映射编码出的低秩特征矩阵作为网络的隐藏层,以求解网络的输出权重。为验证该网络的有效性,利用USPS、MNIST和NORB数据集进行实验,实验证明所提出的多核近似学习网能够在局部感受野极端学习机的基础上进一步提取出特征信息,有效提高了分类正确率。

	服务

	把本文推荐给朋友
	加入我的书架
	加入引用管理器
	E-mail Alert
	RSS
	作者相关文章
	刘彬
	刘静
	吴超
	李雅倩
	张亚茹
	杨有恒

关键词 ：计量学, 图像识别, 多核近似映射, 二维高斯分布, 局部感受野, 全局感受野, 极端学习机

Abstract：In order to fully extract the identifiable information in the image and improve classification accuracy rate, a structure named multiple kernel empirical learning network(MKELN) was proposed. In the feature extraction part, the original image is gradually enhanced by the two-dimensional Gaussian distribution. The local receptive field and the global receptive field are used to fully extract features in the original image and the gradually regional enhancement image, and they are connected in series to form feature vector that represents an image. In the classification part, a multiple kernel empirical algorithm was proposed, and the low rank feature matrix is used as the hidden layer of the network to solve the output weight of the network. To verify the effectiveness of this network, it was tested with USPS, MNIST and NORB data sets. The experiment proves that the proposed MKELN can further extract feature information based on ELM-LRF, effectively improving the classification accuracy.

Key words： metrology image recognition multiple kernel empirical mapping two-dimensional Gaussian distribution local receptive field global receptive field extreme learning machine

收稿日期: 2019-07-20 发布日期: 2021-06-23

PACS:	TB96
	TB973

基金资助:国家自然科学基金(51641609);河北省自然科学基金(F2019203320)

通讯作者: 刘静(1996-),女,山东济南人,燕山大学在读硕士研究生,研究方向为机器学习。Email: jingliu@stumail.ysu.edu.cn E-mail: jingliu@stumail.ysu.edu.cn

作者简介: 刘彬(1953-),男,黑龙江哈尔滨人,燕山大学电气工程学院教授,主要从事信号估计与识别算法、机器学习、智能传感与无线传感器网络关键技术的研究。Email: liubin311@163.com

引用本文:

刘彬,刘静,吴超,李雅倩,张亚茹,杨有恒. 区域渐近增强与感受野结合的多核近似学习网[J]. 计量学报, 2021, 42(6): 694-703.
LIU Bin,LIU Jing,WU Chao,LI Ya-qian,ZHANG Ya-ru,YANG You-heng. Multiple Kernel Empirical Learning Network with Gradually Enhanced Region and Receptive Field. Acta Metrologica Sinica, 2021, 42(6): 694-703.

链接本文:

http://jlxb.china-csm.org:81/Jwk_jlxb/CN/10.3969/j.issn.1000-1158.2021.06.02 或 http://jlxb.china-csm.org:81/Jwk_jlxb/CN/Y2021/V42/I6/694

［1］ Huang G B , Zhu Q Y , Siew C K . Extreme learning machine: Theory and applications［J］. Neurocomputing, 2006, 70(1-3): 489-501.
［2］李荣雨, 王立明. 基于ISOMAP-ELM的软测量建模及化工应用［J］. 计量学报, 2016, 37(5): 548-552.
Li R Y, Wang L M. Soft measurement modeling and chemical application based on ISOMAP-ELM neural network［J］. Acta Metrologica Sinica, 2016, 37(5): 548-552.
［3］李荣雨, 戚桂洪. 基于CSSE-OSELM算法的软测量建模及其工业应用［J］. 计量学报, 2017, 38(5): 650-655.
Li R Y, Qi G H. Soft sensor modeling based on CSSE-OSELM［J］. Acta Metrologica Sinica, 2017, 38(5): 650-655.
［4］牛培峰, 史春见, 刘楠, 等. 基于GSA-PELM的锅炉NOx预测模型［J］. 计量学报, 2018, 39(5): 741-746.
Niu P F, Shi C J, Liu N, et al. Optimization for NOx prediction model from boilers based on GSA-PELM［J］. Acta Metrologica Sinica, 2018, 39(5): 741-746.
［5］魏立新, 张宇, 孙浩, 等. 基于改进OS-ELM的冷连轧在线轧制力预报［J］. 计量学报, 2019, 40(1): 111-116.
Wei L X, Zhang Y, Sun H, et al. Online cold rolling prediction based on improved OS-ELM［J］. Acta Metrologica Sinica, 2019, 40(1): 111-116.
［6］ Yu J, Song W, Li M, et al. A novel image classification algorithm based on extreme learning machine［J］. China Communications, 2015, 12(s2): 48-54.
［7］ Zhou Y, Peng J, Chen C L, et al. Extreme learning machine with composite kernels for hyperspectral image classification［J］. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015, 8(6): 2351-2360.
［8］ Zhu M, Song Y, Guo J, et al. PCA and kernel-based extreme learning machine for side-scan sonar image classification［C］//IEEE OES International Symposium on Underwater Technology (UT), South Korea, Busan, 2017.
［9］ Krizhevsky A, Sutskever I, Hinton G E, et al. ImageNet classification with deep convolutional neural networks［J］. Neural Information Processing Systems, 2012, 141(5): 1097-1105.
［10］ Huang G B, Bai Z, Kasun L L C, et al. Local receptive fields based extreme learning machine［J］. IEEE Computational Intelligence Magazine, 2015, 10(2): 18-29.
［11］ Shan P, Xinyi Y. Deep Convolutional extreme learning machine and its application in handwritten digit classification［J］. Computational Intelligence and Neuroscience, 2016, 2016(3): 1-10.
［12］ Huang J, Yu Z L, Cai Z, et al. Extreme learning machine with multi-scale local receptive fields for texture classification［J］. Multidimensional Systems and Signal Processing, 2017, 28(3): 995-1011.
［13］ Wu C, Li Y, Zhao Z, et al. Extreme learning machine with autoencoding receptive fields for image classification［J］. Neural Computing and Applications, 2019, 1-17.
［14］ Kasun L L C, Zhou H, Huang G B, et al. Representational Learning with Extreme Learning Machine for Big Data［J］. IEEE Intelligent Systems, 2013, 28(6), 31-34.
［15］ Jia X, Li X, Jin Y, et al. Region-enhanced multi-layer extreme learning machine［J］. Cognitive Computation, 2019, 11(1): 101-109.
［16］ Huang G B, Zhou H, Ding X, et al. Extreme learning machine for regression and multiclass classification［J］. IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics), 2012, 42(2): 513-529.
［17］ Vong C M, Chen C, Wong P K, et al. Empirical kernel map-based multilayer extreme learning machines for representation learning［J］. Neurocomputing, 2018, 310: 265-276.
［18］钱萌, 唐家康. 基于混合核极限学习机的多标签学习研究［J］. 重庆科技学院学报(自然科学版), 2019, 21(2): 79-85.
Qian M, Tang J K. Multi-label learning based on mixed kernel extreme learning machine［J］. Journal of Chongqing University of Science and Technology(Natural Sciences Edition), 2019, 21(2): 79-85.
［19］ Li X, Mao W, Jiang W. Multiple-kernel-learning-based extreme learning machine for classification design［J］. Neural Computing and Applications, 2016, 27(1): 175-184.
［20］ Liu X, Wang L, Huang G B, et al. Multiple kernel extreme learning machine［J］. Neurocomputing, 2015, 149(A): 253-264.
［21］ Cao L, Huang W, Sun F, et al. Optimization-based extreme learning machine with multi-kernel learning approach for classification［C］// 22nd International Conference on Pattern Recognition, Stockholm, Sweden, 2014.
［22］ Xue J, Liu Q, Li M, et al. Incremental multiple kernel extreme learning machine and its application in Robo-advisors［J］. Soft Computing, 2018, 22(11): 3507-3517.
［23］ Ding S, Guo L, Hou Y. Extreme learning machine with kernel model based on deep learning［J］. Neural Computing and Applications, 2017, 28(8): 1975-1984.
［24］ Wang Y, Xie Z, Xu K, et al. An efficient and effective convolutional auto-encoder extreme learning machine network for 3d feature learning［J］. Neurocomputing, 2016, 174(PB): 988-998.
［25］ Tang J, Deng C, Huang G B, et al. Extreme learning machine for multilayer perceptron［J］. IEEE Transactions on Neural Networks, 2016, 27(4): 809-821.
［26］ He B, Song Y, Zhu Y, et al. Local receptive fields based extreme learning machine with hybrid filter kernels for image classification［J］. Multidimensional Systems and Signal Processing, 2019, 30(3): 1149-1169.