Machine vision-based surface defect detection method for welds
More details
Hide details
1
School of Innovation and Entrepreneurship, Jiangsu Ocean University, Lianyungang, 222000, China
2
School of Mechanical Engineering, Jiangsu Ocean University, Lianyungang, 222000, China
3
Institute of Vocational Education and Adult Education, Chongqing Academy of Education Science, Chongqing, 400010, China
Submission date: 2024-08-22
Final revision date: 2024-10-14
Acceptance date: 2024-11-12
Online publication date: 2025-01-06
Publication date: 2025-01-06
Corresponding author
Xianzhang Zhou
Institute of Vocational Education and Adult Education, Chongqing Academy of Education Science, Chongqing, 400010, China
KEYWORDS
TOPICS
ABSTRACT
The texture feature extraction including grayscale co-occurrence matrix and various shape feature extraction methods are adopted in this paper, as well as convolutional neural network based on Visual Geometry Group-16 structure. In particular, the Squeeze-and-Excitation module and dilated convolution technique are introduced to improve the model, aiming to enhance its feature extraction and classification capabilities. On the JPEGWELD dataset, the improved model had 98.7% accuracy in the training set, 97.9% accuracy in the test set, and 98.7% recall rate. In the comparative analysis, although the number of parameters of the improved VGG16 model was 33.64M and the maximum model size was 385MB, the detection time was only 1.3s. The results demonstrated that the model had efficient optimization and computational performance, with a good balance between design and optimization while maintaining a short detection time. The proposed method exhibits high accuracy and efficiency in the detection of various types of weld defects, demonstrating strong universality and adaptability. Its applicability to diverse industrial settings is evident. The study provides an effective solution for industrial automated inspection, which is of great significance to improve the quality control level and production efficiency of manufacturing industry.
FUNDING
The research is supported by: 2022 Jiangsu Provincial College Students’ Innovation Training Provincial Key Project SZ202211641649001 – Anti-epidemic medical waste harmless treatment robot under the dual carbon target; 2023 Jiangsu Provincial College Students’ Innovation Training Provincial General Project SY202311641651001 – Design of medical supplies rapid delivery system based on unmanned aerial vehicle technology; The author gratefully acknowledges the financial supports by the 2021 Chongqing Municipal Education Commission Science and Technology Research Plan Major Project under Grant numbers KJZD-M20211440; 2022 Chongqing Municipal Research Institute Performance Incentive Guidance Special Project under Grant numbers cstc2022jxjl40004.
REFERENCES (28)
1.
Lee H, Heogh W, Yang J, Yoon J, Park J, Ji S, Lee H. Deep learning for in-situ powder stream fault detection in directed energy deposition process. Journal of Manufacturing Systems. 2022;62(4):575-587.
https://doi.org/10.1016/j.jmsy....
2.
Chen Y G, Shu Y, Li X, Xiong C, Cao S, Wen X, Xie Z. Research on detection algorithm of lithium battery surface defects based on embedded machine vision. J. Intell. Fuzzy Syst. 2021;41(3):4327-4335.
https://doi.org/10.3233/JIFS-1....
3.
Wang W, Lu K, Wu Z, Long H, Wang B. Surface defects classification of hot rolled strip based on improved convolutional neural network. ISIJ International. 2021;61(5):1579-1583.
https://doi.org/10.2355/isijin....
4.
Abhilash P M, Chakradhar D. Image processing algorithm for detection, quantification and classification of microdefects in wire electric discharge machined precision finish cut surfaces. Journal of Micromanufacturing. 2021;5(2):116-126.
https://doi.org/10.1177/251659....
5.
Lai J Y, Tsao Y R, Liu C Y. High-accuracy detection and classification of defect and deformation of metal screw head achieved by convolutional neural networks. Applied Mechanics and Materials. 2022;909(1):75-80.
https://doi.org/10.4028/p-fy36....
6.
Chen L, Yao X, Liu K, Tan C, Moon S. Multisensor fusion-based digital twin in additive manufacturing for in-situ quality monitoring and defect correction. Proceedings of the Design Society. 2023;3(1):2755-2764.
https://doi.org/10.1017/pds.20....
7.
Pratt L, Govender D, Klein R. Defect detection and quantification in electroluminescence images of solar PV modules using U-net semantic segmentation. Renewable Energy. 2021;178(1):1211-1222.
https://doi.org/10.1016/j.rene....
8.
Nagata F, Watanabe K, Habib M K. Design and implementation of convolutional neural network-based SVM technique for manufacturing defect detection. International Journal of Mechatronics and Automation. 2021;8(2):53-61.
https://doi.org/10.1504/IJMA.2....
9.
Eshkevari M, Rezaee M J, Zarinbal M, Hamidreza I. Automatic dimensional defect detection for glass vials based on machine vision: A heuristic segmentation method. Journal of Manufacturing Processes. 2021; 68(2):973-987.
https://doi.org/10.1016/j.jmap....
10.
Iker P, Sanz B, Tellaeche A, Psaila G, Gaviria J, Bringas P. Quality assessment methodology based on machine learning with small datasets: Industrial castings defects. Neurocomputing. 2021;456(7):622-628.
https://doi.org/10.1016/j.neuc....
11.
Mohamed A R, Elgamal R A, Elmasry G, Radwan S. Development of a real-time machine vision prototype to detect external defects in some agricultural products. Journal of Soil Sciences and Agricultural Engineering. 2021;11(9):317-325.
https://doi.org/10.21608/jssae....
12.
Liu J, Guo F, Gao H, Li M, Zhang Y, Zhou H. Defect detection of injection molding products on small datasets using transfer learning. Journal of Manufacturing Processes. 2021;70(7):400-413.
https://doi.org/10.1016/j.jmap....
13.
Zuo F, Liu J, Fu M, Wang L, Zhao Z. An X-Ray-based multiexpert inspection method for automatic welding defect assessment in intelligent pipeline systems. IEEE/ASME Transactions on Mechatronics; 2024; 1(2):1-12.
https://doi.org/10.1109/TMECH.....
14.
Jiang H, Hu Q, Zhi Z, Gao J, Gao Z, Wang R, et al. Convolution neural network model with improved pooling strategy and feature selection for weld defect recognition. Welding in the World. 2021;65(1):731-744.
https://doi.org/10.1007/s40194....
15.
Amini N, Shalbaf A. Automatic classification of severity of COVID-19 patients using texture feature and random forest based on computed tomography images. International journal of imaging systems and technology. 2022;32(1):102-110.
https://doi.org/10.1002/ima.22....
16.
Wei W, Liu C, Wang J. Objective evaluation of optical illusion skirt based on image texture features. International Journal of Clothing Science and Technology. 2021;33(5):843-859.
https://doi.org/10.1108/IJCST-....
17.
Hui T, Xu Y L, Jarhinbek R. Detail texture detection based on Yolov4-tiny combined with attention mechanism and bicubic interpolation. IET Image Processing. 2021;15(12):2736-2748.
https://doi.org/10.1049/ipr2.1....
18.
Pal S, Roy A, Shivakumara P, Pal U. Adapting a swin transformer for license plate number and text detection in drone images. Artificial Intelligence and Applications. 2023;1(3):145-154.
https://doi.org/10.47852/bonvi....
19.
Vafaeian B, Riahi H T, Amoushahi H, Jomha N M, Adeeb S. A feature‐based statistical shape model for geometric analysis of the human talus and development of universal talar prostheses. Journal of Anatomy. 2022; 240(2):305-322.
https://doi.org/10.1111/joa.13....
20.
Li Z, Wei X, Hassaballah M, Li Y, Jiang X. A deep learning model for steel surface defect detection. Complex & Intelligent Systems. 2024;10(1):885-897.
https://doi.org/10.1007/s40747....
21.
Tang R, Liu Z, Song Y, Duan G, Tan J. Hierarchical multi-scale network for cross-scale visual defect detection. Journal of Intelligent Manufacturing. 2024; 35(3): 1141-1157.
https://doi.org/10.1007/s10845....
22.
Yang Z, Zhang M, Chen Y, Hu N,Gao L, Liu L, Xi E, Song J. Surface defect detection method for air rudder based on positive samples. Journal of Intelligent Manufacturing. 2024;35(1):95-113.
https://doi.org/10.1007/s10845....
23.
Kansal K, Chandra T B, Singh A. ResNet-50 vs. EfficientNet-B0: Multi-centric classification of various lung abnormalities using deep learning "session id: ICMLDsE.004". Procedia Computer Science. 2024; 235(1):70-80.
https://doi.org/10.1016/j.proc....
24.
Russel NS, Selvaraj A. Wavelet scattering transform and deep features for automated classification and grading of dates fruit. Journal of ambient intelligence and humanized computing. 2024;15(6):2909-2923.
https://doi.org/10.1007/s12652....
25.
Jenipher V N, Radhika S. Lung tumor cell classification with lightweight mobileNetV2 and attention-based SCAM enhanced faster R-CNN. Evolving Systems. 2024;15(4):1381-1398.
https://doi.org/10.1007/s12530....
26.
Zhang X, Chen G. Detection of dense small rigid targets based on convolutional neural network and synthetic images. Traitement du Signal: signal image parole, 2021;38(1):61-71.
https://doi.org/10.18280/ts.38....
27.
Ruckstuhl Y, Janji T, Rasp S. Training a convolutional neural network to conserve mass in data assimilation. Nonlinear Processes in Geophysics. 2021;28(1):111-119.
https://doi.org/10.5194/npg-28....
28.
Bhaskar N, Ganashree. Lung nodule detection from ct scans using gaussian mixture convolutional autoencoder and convolutional neural network. Annals of the Romanian Society for Cell Biology. 2021;25(4):6524-6531.