基于多视角热像图序列的物体表面温度场重建

doi:10.3969/j.issn.1000-1158.2024.07.09

Abstract
Figure/Table
References (27)
Related Citation (13)

Download: PDF (1083 KB) HTML (1 KB)
Export: BibTeX | EndNote (RIS)

Abstract The surface temperature field model effectively reflects the temperature distribution on the surface of the object. Since the image information collected from one single viewpoint cannot cover the entire object, it is difficult to reconstruct the temperature field of the entire object surface. Additionally, in the temperature field model, the presence of non-target objects can affect temperature model analysis. A method for reconstructing the objects surface temperature field based on a multi-view thermal image sequence was proposed. Firstly, a semantic segmentation algorithm was employed to extract the contours of the target object from visible light images, and then the fusion of the single view temperature point cloud of the target object was achieved by combining depth data with temperature information from the thermal image. Subsequently, the method of multi-view image data and multi-view temperature point cloud stitching was adopted, and the initial stitching of the temperature point cloud was carried out using the poses of cameras from various viewpoints, the multi-view LM-ICP algorithm was applied to optimize the registration of the global temperature point cloud. Experimental results show that the method effectively reconstructs the object surface temperature field model, and has small size error(2.61mm) and temperature errors(0.56℃).

Key words： temperature measurement temperature field reconstruction multiple perspectives;thermal image sequence pose estimation;point cloud registration

Received: 04 September 2023 Published: 04 July 2024

PACS:

TB942

	Service

	E-mail this article
	Add to my bookshelf
	Add to citation manager
	E-mail Alert
	RSS
	Articles by authors
	BI Chunkai
	ZHANG Yuanhui
	FU Duo

Cite this article:

BI Chunkai,ZHANG Yuanhui,FU Duo. Surface Temperature Field Reconstruction Based on Multi-view Thermal Image Sequence[J]. Acta Metrologica Sinica, 2024, 45(7): 997-1006.

URL:

http://jlxb.china-csm.org:81/Jwk_jlxb/EN/10.3969/j.issn.1000-1158.2024.07.09 OR http://jlxb.china-csm.org:81/Jwk_jlxb/EN/Y2024/V45/I7/997

［2］	韩伟, 刘岩, 杜蕾, 等. 发射率对半导体器件显微红外测温结果的影响［J］. 计量学报, 2021, 42(1): 35-40.
［7］	张远辉, 徐栢锐, 朱俊江, 等. 可见光与热像融合的三维温度模型重建［J］. 计量学报, 2022, 43(2): 256-263.
［3］	曹彦鹏, 许宝杯, 何泽威, 等. 红外热成像信号处理技术的研究进展［J］. 振动、测试与诊断, 2018, 38(2): 219-227.
［5］	JIA T, WANG H, CHEN D, et al. 3D Temperature Distribution Model Based on Thermal Infrared Image ［J］.Journal of Sensors,2017, 2017: 1-10.
［10］	杨炎龙, 徐超. 一种人体体表三维温度场的融合重建方法［J］. 红外技术, 2022, 44(1): 33-40.
［12］	陈博洋, 孙韶媛, 叶国林, 等. 基于视觉里程计的单目红外视频三维重建［J］. 激光与红外, 2017, 47(10): 1271-1275.
［18］	汤婧婧, 章盛, 徐立中. 图像语义分割方法研究进展［J］. 图像与信号处理, 2023, 12(1): 61-75.
［21］	AIGER D, MITRA N J, COHEN-OR D. 4-points congruent sets for robust pairwise surface registration ［R］.ACM SIGGRAPH 2008 papers. 2008.
	CAO Y P, XU B B, HE Z W, et al. Research progress of infrared thermal imaging signal processing technology ［J］. Journal of Vibration,Measurement & Diagnosis, 2018, 38(2): 219-227.
［4］	DLESK A, VACH K, PAVELKA K. Photogrammetric co-processing of thermal infrared images and RGB images ［J］. Sensors, 2022, 22(4): 1655-1676.
［6］	MA Y, WANG Y, MEI X, et al. Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed Features ［J］. IEEE Access, 2019, 7: 19199-19211.
	XU S Y, ZHU J H, TIAN Z Q, et al. Stepwise refinement method for multi-view point cloud registration ［J］. Acta Automatica Sinica, 2019, 45(8): 1486-1494.
	YANG Y L, XU C. Fusion and reconstruction method of three-dimensional temperature field on human body surface ［J］.Infrared Technology, 2022,44(1):33-40.
［11］	PANTOJA-ROSERO B G, ACHANTA R, KOZINSKI M, et al. Generating LOD3 building models from structure-from-motion and semantic segmentation ［J］. Automation in Construction, 2022, 141: 104430-104445.
	CHEN B Y, SUN S Y, YE G L, et al. 3D reconstruction method of monocular infrared video based on visual odometry ［J］. Laser and Infrared, 2017, 47(10): 1271-1275.
［13］	Intel. Intel RealSense Product Family D400 Series datasheet ［EB/OL］.［2023-08-04］.https://dev.intelrealsense.com/docs/intel-realsense-d400-series-product-family-datasheet.
［25］	HAARBACH A. Multiview ICP［EB/OL］.http: //www. adrian-haarbach. de/mv-lm-icp/docs/mv-lm-icp. pdf.
［27］	KAZHDAN M, BOLITHO M, HOPPE H. Poisson surface reconstruction ［C］// Proceedings of the fourth Eurographics Symposium on Geometry Processing. 2006.
［1］	董泽文, 侯德鑫, 叶树亮. 基于热成像的软包锂电池导热系数测试方法［J］. 计量学报, 2021, 42(12): 1597-1603.
	ZHANG Y H, XU B R, ZHU J J, et al. Reconstruction of 3D temperature model based on fusion of visible light and thermal image ［J］. Acta Metrology Sinica, 2022, 43(2): 256-263.
［14］	Intel. Intel RealSense Documentation-Get Started［EB/OL］. ［2023-08-04］.https: //dev. intelrealsense. com/docs.
［16］	ZHANG Z Y. Flexible camera calibration by viewing a plane from unknown orientations［C］//Proceedings of the Seventh IEEE International Conference on Computer Vision. Kerkyra, Greece, 1999.
［19］	CHEN L C, ZHU Y, PAPANDREOU G, et al. Encoder-decoder with atrous separable convolution for semantic image segmentation ［C］// Proceedings of the European conference on computer vision (ECCV). 2018.
	LIU Y W, BI Y W, ZHANG L J, et al. Research on multi-view point cloud registration based on depth sensor ［J］. Laser Journal,2024,45(3):161-167.
［22］	MELLADO N, AIGER D, MITRA N J. Super 4PCS Fast Global Pointcloud Registration via Smart Indexing ［J］. Computer Graphics Forum, 2014, 33(5): 205-215.
	LU T D, YUAN Z C, ZHENG K. Super 4PCS point cloud registration method combined with scale-invariant features ［J］. Remote Sensing Information, 2019, 34(5): 15-20.
	HAN W, LIU Y, DU L, et al. Effect of emissivity on microscopic infrared temperature measurement results of semiconductor devices ［J］. Acta Metrologica Sinica, 2021, 42(1): 35-40.
［9］	LI H, WANG S, BAI Z, et al. Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared ［J］. Sensors, Multidisciplinary Digital Publishing Institute, 2023, 23(17):7372-7378.
［17］	QI C R, SU H, MO K, et al. Pointnet: Deep learning on point sets for 3d classification and segmentation ［C］//Proceedings of the IEEE conference on computer vision and pattern recognition. 2017.
［24］	BESL P J, MCKAY N D. A method for registration of 3-D shapes ［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2): 239-256.
	DONG Z W, HOU D X, YE S L. Testing method for thermal conductivity of soft-pack lithium batteries based on thermal imaging ［J］. Acta Metrologica Sinica, 2021, 42(12): 1597-1603.
［8］	徐思雨, 祝继华, 田智强, 等. 逐步求精的多视角点云配准方法［J］. 自动化学报, 2019, 45(8): 1486-1494.
［15］	KESELMAN L,WOODFILL J I,GRUNNET-JEPSEN A, et al.Intel(R) RealSense(TM) Stereoscopic Depth Cameras［C］//2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).Honolulu, HI, USA,2017.
［23］	鲁铁定, 袁志聪, 郑坤. 结合尺度不变特征的Super 4PCS点云配准方法［J］. 遥感信息, 2019, 34(5): 15-20.
	TANG J J, ZHANG S, XU L Z. Research progress on image semantic segmentation methods ［J］. Image and Signal Processing, 2023, 12(1): 61-75.
［20］	刘耀文, 毕远伟, 张鲁建, 等. 基于深度传感器的多视角点云配准研究［J］. 激光杂志,2024,45(3):161-167.
［26］	LOWE D G. Distinctive Image Features from Scale-Invariant Keypoints ［J］. International Journal of Computer Vision, 2004, 60(2): 91-110.