Abstract:To realize the automation and intellectualization of micro-channel heat exchanger production line, a 3D vision based automatic corner location and dimension measurement method for micro-channel heat exchanger was proposed to guide the manipulator to grasp and load and unload. First, the product was photographed with a 3D camera from the top view, the obtained image was corrected and the RGB image was aligned to the depth image. Secondly, with the help of 3D information of the product, accurate two-dimensional image segmentation and two-dimensional coordinate positioning were realized. Finally, the depth values of the corner points were weighted, and the three-dimensional coordinates were obtained through the conversion of the two-dimensional coordinates and depth information of the corner points, and the product dimension was calculated. The experimental results show that the algorithm can achieve accurate image segmentation and size measurement in complex background, and the relative error of dimension measurement can be controlled within 1% when the measurement distance is 4000mm, which can meet the requirement of the system.
舒子超,曹松晓,蒋庆,徐志鹏,楼旭东. 基于3D视觉的微通道换热器定位与尺寸测量[J]. 计量学报, 2022, 43(9): 1128-1134.
SHU Zi-chao,CAO Song-xiao,JIANG Qing,XU Zhi-peng,LOU Xu-dong. Positioning and Dimension Measurement of Micro-channel Heat Exchangers Based on 3D Vision. Acta Metrologica Sinica, 2022, 43(9): 1128-1134.
[1]巫江虹, 薛志强, 金鹏, 等. 电动汽车热泵空调微通道换热器温度分布特性 [J]. 浙江大学学报 (工学版), 2016, 50 (8): 1537-1544.
Wu J H, Xue Z Q, Jin P, et al. Temperature Maldistribution in Micro-channel Heat Exchanger Applied to Electrical Vehicles Heat Pum [J]. Journal of Zhejiang University (Engineer Science), 2016, 50 (8): 1537-1544.
[2]朱传辉, 李保国, 杨会芳. 微通道换热器研究及应用进展 [J]. 热能动力工程, 2020, 35 (9): 1-9.
Zhu C H, Li B G, Yang H F. Progress in Research and Application of Microchannel Heat Exchangers [J]. Journal of Engineering for Thermal Energy and Power, 2020, 35 (9): 1-9.
[3]包能胜, 方海涛. 连续运动螺纹尺寸自适应机器视觉检测 [J]. 计量学报, 2020, 41 (9): 1062-1069.
Bao S N, Fang H T. Continuous Motion Thread Size Detection with Adaptive Machine Vision [J]. Acta Metrologica Sinica, 2020, 41 (9): 1062-1069.
[4]Ali M H, Aizat K, Yerkhan K, et al. Vision-based Robot Manipulator for Industrial Applications [J]. Procedia Computer Science, 2018, 133: 205-212.
[5]Yang L. Talking About the Industrial Robot Grasping Technology Based on Machine Vision [J]. Journal of Physics: Conference Series, 2021, 1769: 012075.
[6]卢清华, 许重川, 王华, 等. 基于机器视觉的大幅面陶瓷地砖尺寸测量研究 [J]. 光学学报, 2013, 33 (3): 172-178.
Lu Q H, Xu Z C, Wang H, et al. Research on Dimension Measurement of Large Size Ceramic Floor Tiles Based on Machine Vision [J]. Acta Optica Sinica, 2013, 33 (3): 172-178.
[7]刘斌, 董正天, 胡春海, 等.基于机器视觉的丝网印刷样板尺寸测量方法 [J]. 计量学报, 2021, 42 (2): 150-156.
Liu B, Dong Z T, Hu C H, et al. Measurement Method of Screen Printing Template Size Based on Machine Vision [J]. Acta Metrologica Sinica, 2021, 42 (2): 150-156.
[8]Butt S I, Asgher U, Mushtaq U, et al. Intelligent Machine Vision Based Modeling and Positioning System in Sand Casting Process [J]. Advances in Materials Science and Engineering, 2017: 1-12.
[9]Hou B, Zhao Y. Welding Robot Positioning Method Based on Machine Vision and Laser Ranging [C] // 2020 Chinese Control And Decision Conference. Hefei, China, 2020: 391-396.
[10]苗中华, 陈苏跃, 何创新. 基于3D视觉的青饲机拖车车斗自动识别与定位方法 [J]. 农业机械学报, 2019, 50 (5): 43-49.
Miao Z H, Chen S Y, He C X. Automatic Identification and Location Method of Forage Harvester Trailer Hopper Based on 3D Vision [J]. Transactions of The Chinese Society of Agricultural Machinery, 2019, 50 (5): 43-49.
[11]解则晓, 陈文柱, 迟书凯, 等. 基于结构光视觉引导的工业机器人定位系统 [J]. 光学学报, 2016, 36 (10): 400-407.
Xie Z X, Chen W Z, Chi S K, et al. Industrial Robot Positioning System Based on the Guidance of the Structured-Light Vision [J]. Acta Optica Sinica, 2016, 36 (10): 400-407.
[12]Ngo N V, Hsu Q C, Hsiao W L, et al. Development of a Simple Three-dimensional Machine-vision Measurement System for In-process Mechanical Parts[J]. Advances in Mechanical Engineering, 2017, 9 (10): 1-11.
[13]Kim J, Bae H, Lee S G. Image Distortion and Rectification Calibration Algorithms and Validation Technique for a Stereo Camera [J]. Electronics, 2021, 10 (3): 1-20.
[14]Li W, Shan S, Liu H. High-precision Method of Binocular Camera Calibration with a Distortion Model [J]. Applied Optics, 2017, 56 (8): 2368-2377.
[15]Syed T N, Jizhan L, Xin Z, et al. Seedling-lump Integrated Non-destructive Monitoring for Automatic Transplanting with Intel RealSense Depth Camera[J]. Artificial Intelligence in Agriculture, 2019, 3: 18-32.
[16]贺杰, 王桂梅, 刘杰辉, 等. 基于图像处理的皮带机上煤量体积计量 [J]. 计量学报, 2020, 41 (12): 1516-1520.
He J, Wang J M, Liu J H, et al. Volume Measurement of Coal Volume on Belt Conveyor Based on Image Processing [J]. Acta Metrologica Sinica, 2020, 41 (12): 1516-1520.
[17]邢雪亮, 甘文波, 蒋朝根. 基于机器视觉的航空铆钉尺寸检测技术 [J]. 计量学报, 2020, 41 (5): 518-523.
Xing X L, Gan W B, Jiang C G. Technology of Detection of Air Rivets Based on Machine Vision [J]. Acta Metrologica Sinica, 2020, 41 (5): 518-523.