Advancements in and Research on Coplanar Capacitive Sensing Techniques for Non-Destructive Testing and Evaluation: A State-of-the-Art Review.

In contrast to conventional non-destructive testing (NDT) and non-destructive evaluation (NDE) methodologies, including radiography, ultrasound, and eddy current analysis, coplanar capacitive sensing technique emerges as a novel and promising avenue within the field. This paper endeavors to elucidate the efficacy of coplanar capacitive sensing, also referred to as capacitive imaging (CI), within the realm of NDT. Leveraging extant scholarly discourse, this review offers a comprehensive and methodical examination of the coplanar capacitive technique, encompassing its fundamental principles, factors influencing sensor efficacy, and diverse applications for defect identification across various NDT domains. Furthermore, this review deliberates on extant challenges and anticipates future trajectories for the technique. The manifold advantages inherent to coplanar capacitive sensing vis-à-vis traditional NDT methodologies not only afford its versatility in application but also underscore its potential for pioneering advancements in forthcoming applications.

Advanced Image Stitching Method for Dual-Sensor Inspection.

Efficient image stitching plays a vital role in the Non-Destructive Evaluation (NDE) of infrastructures. An essential challenge in the NDE of infrastructures is precisely visualizing defects within large structures. The existing literature predominantly relies on high-resolution close-distance images to detect surface or subsurface defects. While the automatic detection of all defect types represents a significant advancement, understanding the location and continuity of defects is imperative. It is worth noting that some defects may be too small to capture from a considerable distance. Consequently, multiple image sequences are captured and processed using image stitching techniques. Additionally, visible and infrared data fusion strategies prove essential for acquiring comprehensive information to detect defects across vast structures. Hence, there is a need for an effective image stitching method appropriate for infrared and visible images of structures and industrial assets, facilitating enhanced visualization and automated inspection for structural maintenance. This paper proposes an advanced image stitching method appropriate for dual-sensor inspections. The proposed image stitching technique employs self-supervised feature detection to enhance the quality and quantity of feature detection. Subsequently, a graph neural network is employed for robust feature matching. Ultimately, the proposed method results in image stitching that effectively eliminates perspective distortion in both infrared and visible images, a prerequisite for subsequent multi-modal fusion strategies. Our results substantially enhance the visualization capabilities for infrastructure inspection. Comparative analysis with popular state-of-the-art methods confirms the effectiveness of the proposed approach.

Robust Multi-Modal Image Registration for Image Fusion Enhancement in Infrastructure Inspection.

Efficient multi-modal image fusion plays an important role in the non-destructive evaluation (NDE) of infrastructures, where an essential challenge is the precise visualizing of defects. While automatic defect detection represents a significant advancement, the determination of the precise location of both surface and subsurface defects simultaneously is crucial. Hence, visible and infrared data fusion strategies are essential for acquiring comprehensive and complementary information to detect defects across vast structures. This paper proposes an infrared and visible image registration method based on Euclidean evaluation together with a trade-off between key-point threshold and non-maximum suppression. Moreover, we employ a multi-modal fusion strategy to investigate the robustness of our image registration results.

Experimental Study and FEM Simulations for Detection of Rebars in Concrete Slabs by Coplanar Capacitive Sensing Technique.

In the present study, a relatively novel non-destructive testing (NDT) method called the coplanar capacitive sensing technique was applied in order to detect different sizes of rebars in a reinforced concrete (RC) structure. This technique effectively detects changes in the dielectric properties during scanning in various sections of concrete with and without rebars. Numerical simulations were carried out by three-dimensional (3D) finite element modelling (FEM) in COMSOL Multiphysics software to analyse the impact of the presence of rebars on the electric field generated by the coplanar capacitive probe. In addition, the effect of the presence of a surface defect on the rebar embedded in the concrete slab was demonstrated by the same software for the first time. Experiments were performed on a concrete slab containing rebars, and were compared with FEM results. The results showed that there is a good qualitative agreement between the numerical simulations and experimental results.

Dual-Intended Deep Learning Model for Breast Cancer Diagnosis in Ultrasound Imaging.

Automated medical data analysis demonstrated a significant role in modern medicine, and cancer diagnosis/prognosis to achieve highly reliable and generalizable systems. In this study, an automated breast cancer screening method in ultrasound imaging is proposed. A convolutional deep autoencoder model is presented for simultaneous segmentation and radiomic extraction. The model segments the breast lesions while concurrently extracting radiomic features. With our deep model, we perform breast lesion segmentation, which is linked to low-dimensional deep-radiomic extraction (four features). Similarly, we used high dimensional conventional imaging throughputs and applied spectral embedding techniques to reduce its size from 354 to 12 radiomics. A total of 780 ultrasound images-437 benign, 210, malignant, and 133 normal-were used to train and validate the models in this study. To diagnose malignant lesions, we have performed training, hyperparameter tuning, cross-validation, and testing with a random forest model. This resulted in a binary classification accuracy of 78.5% (65.1-84.1%) for the maximal (full multivariate) cross-validated model for a combination of radiomic groups.

Data Enhancement via Low-Rank Matrix Reconstruction in Pulsed Thermography for Carbon-Fibre-Reinforced Polymers.

Pulsed thermography is a commonly used non-destructive testing method and is increasingly studied for the assessment of advanced materials such as carbon fibre-reinforced polymer (CFRP). Different processing approaches are proposed to detect and characterize anomalies that may be generated in structures during the manufacturing cycle or service period. In this study, matrix decomposition using Robust PCA via Inexact-ALM is investigated as a pre- and post-processing approach in combination with state-of-the-art approaches (i.e., PCT, PPT and PLST) on pulsed thermography thermal data. An academic sample with several artificial defects of different types, i.e., flat-bottom-holes (FBH), pull-outs (PO) and Teflon inserts (TEF), was employed to assess and compare defect detection and segmentation capabilities of different processing approaches. For this purpose, the contrast-to-noise ratio (CNR) and similarity coefficient were used as quantitative metrics. The results show a clear improvement in CNR when Robust PCA is applied as a pre-processing technique, CNR values for FBH, PO and TEF improve up to 164%, 237% and 80%, respectively, when compared to principal component thermography (PCT), whilst the CNR improvement with respect to pulsed phase thermography (PPT) was 77%, 101% and 289%, respectively. In the case of partial least squares thermography, Robust PCA results improved not only only when used as a pre-processing technique but also when used as a post-processing technique; however, this improvement is higher for FBHs and POs after pre-processing. Pre-processing increases CNR scores for FBHs and POs with a ratio from 0.43% to 115.88% and from 13.48% to 216.63%, respectively. Similarly, post-processing enhances the FBHs and POs results with a ratio between 9.62% and 296.9% and 16.98% to 92.6%, respectively. A low-rank matrix computed from Robust PCA as a pre-processing technique on raw data before using PCT and PPT can enhance the results of 67% of the defects. Using low-rank matrix decomposition from Robust PCA as a pre- and post-processing technique outperforms PLST results of 69% and 67% of the defects. These results clearly indicate that pre-processing pulsed thermography data by Robust PCA can elevate the defect detectability of advanced processing techniques, such as PCT, PPT and PLST, while post-processing using the same methods, in some cases, can deteriorate the results.

Impartially Validated Multiple Deep-Chain Models to Detect COVID-19 in Chest X-ray Using Latent Space Radiomics.

The COVID-19 pandemic continues to spread globally at a rapid pace, and its rapid detection remains a challenge due to its rapid infectivity and limited testing availability. One of the simply available imaging modalities in clinical routine involves chest X-ray (CXR), which is often used for diagnostic purposes. Here, we proposed a computer-aided detection of COVID-19 in CXR imaging using deep and conventional radiomic features. First, we used a 2D U-Net model to segment the lung lobes. Then, we extracted deep latent space radiomics by applying deep convolutional autoencoder (ConvAE) with internal dense layers to extract low-dimensional deep radiomics. We used Johnson-Lindenstrauss (JL) lemma, Laplacian scoring (LS), and principal component analysis (PCA) to reduce dimensionality in conventional radiomics. The generated low-dimensional deep and conventional radiomics were integrated to classify COVID-19 from pneumonia and healthy patients. We used 704 CXR images for training the entire model (i.e., U-Net, ConvAE, and feature selection in conventional radiomics). Afterward, we independently validated the whole system using a study cohort of 1597 cases. We trained and tested a random forest model for detecting COVID-19 cases through multivariate binary-class and multiclass classification. The maximal (full multivariate) model using a combination of the two radiomic groups yields performance in classification cross-validated accuracy of 72.6% (69.4-74.4%) for multiclass and 89.6% (88.4-90.7%) for binary-class classification.

Multiscale Analysis of Solar Loading Thermographic Signals for Wall Structure Inspection.

Infrared thermography has been widely adopted in many applications for material structure inspection, where data analysis methods are often implemented to elaborate raw thermal data and to characterize material structural properties. Herein, a multiscale thermographic data analysis framework is proposed and applied to building structure inspection. In detail, thermograms are first collected by conducting solar loading thermography, which are then decomposed into several intrinsic mode functions under different spatial scales by multidimensional ensemble empirical mode decomposition. At each scale, principal component analysis (PCA) is implemented for feature extraction. By visualizing the loading vectors of PCA, the important building structures are highlighted. Compared with principal component thermography that applies PCA directly to raw thermal data, the proposed multiscale analysis method is able to zoom in on different types of structural features.

Evaluation and Selection of Video Stabilization Techniques for UAV-Based Active Infrared Thermography Application.

Unmanned Aerial Vehicles (UAVs) that can fly around an aircraft carrying several sensors, e.g., thermal and optical cameras, to inspect the parts of interest without removing them can have significant impact in reducing inspection time and cost. One of the main challenges in the UAV based active InfraRed Thermography (IRT) inspection is the UAV's unexpected motions. Since active thermography is mainly concerned with the analysis of thermal sequences, unexpected motions can disturb the thermal profiling and cause data misinterpretation especially for providing an automated process pipeline of such inspections. Additionally, in the scenarios where post-analysis is intended to be applied by an inspector, the UAV's unexpected motions can increase the risk of human error, data misinterpretation, and incorrect characterization of possible defects. Therefore, post-processing is required to minimize/eliminate such undesired motions using digital video stabilization techniques. There are number of video stabilization algorithms that are readily available; however, selecting the best suited one is also challenging. Therefore, this paper evaluates video stabilization algorithms to minimize/mitigate undesired UAV motion and proposes a simple method to find the best suited stabilization algorithm as a fundamental first step towards a fully operational UAV-IRT inspection system.

Detecting Vasodilation as Potential Diagnostic Biomarker in Breast Cancer Using Deep Learning-Driven Thermomics.

Breast cancer is the most common cancer in women. Early diagnosis improves outcome and survival, which is the cornerstone of breast cancer treatment. Thermography has been utilized as a complementary diagnostic technique in breast cancer detection. Artificial intelligence (AI) has the capacity to capture and analyze the entire concealed information in thermography. In this study, we propose a method to potentially detect the immunohistochemical response to breast cancer by finding thermal heterogeneous patterns in the targeted area. In this study for breast cancer screening 208 subjects participated and normal and abnormal (diagnosed by mammography or clinical diagnosis) conditions were analyzed. High-dimensional deep thermomic features were extracted from the ResNet-50 pre-trained model from low-rank thermal matrix approximation using sparse principal component analysis. Then, a sparse deep autoencoder designed and trained for such data decreases the dimensionality to 16 latent space thermomic features. A random forest model was used to classify the participants. The proposed method preserves thermal heterogeneity, which leads to successful classification between normal and abnormal subjects with an accuracy of 78.16% (73.3-81.07%). By non-invasively capturing a thermal map of the entire tumor, the proposed method can assist in screening and diagnosing this malignancy. These thermal signatures may preoperatively stratify the patients for personalized treatment planning and potentially monitor the patients during treatment.

Eddy current pulsed thermography for ballistic impact evaluation in basalt-carbon hybrid composite panels.

In this paper, eddy current pulsed thermography was used to evaluate ballistic impact damages in basalt-carbon hybrid fiber-reinforced polymer composite laminates for the first time, to our knowledge. In particular, different hybrid structures including intercalated stacking and sandwich-like sequences were used. Pulsed phase thermography, wavelet transform, principle component thermography, and partial least-squares thermography were used to process the thermographic data. Ultrasound C-scan testing and X-ray computed tomography were also performed for comparative purposes. Finite element analysis was used for validation. Finally, an analytical and comparative study was conducted based on signal-to-noise ratio analysis.

Continuum removal for ground-based LWIR hyperspectral infrared imagery applying non-negative matrix factorization.

Continuum removal is vital in hyperspectral image analysis. It enables data to be used for any application and usually requires approximations or assumptions to be made. One of these approximations is related to the calculation of the spectra of the background's blackbody temperature. Here, we present a new method to calculate the continuum removal process. The proposed method eliminates the calculation for ground-based hyperspectral infrared imagery by applying two acquisition sets before and after using the heating source. The approach involves a laboratory experiment on a long-wave infrared (LWIR; 7.7-11.8 µm), with a LWIR-macro lens, an Infragold plate, and a heating source. To calculate the continuum removal process, the approach applies non-negative matrix factorization (NMF) to extract Rank-1 NMF, estimate the downwelling radiance, and compare it with that of other conventional methods. NMF uses gradient-descent-based rules (GD) and non-negative least-squares (NNLS) optimization algorithms to obtain Rank-1 NMF. A comparative analysis is performed with 1%-20% additive noise for all algorithms by using the spectral angle mapper and normalized cross correlation (NCC). Results reveal the promising performance of NMF-GD (average of 72.5% similarity percentage using NCC) and NMF-NNLS (average of 77.6% similarity percentage using NCC).

Enhanced Infrared Image Processing for Impacted Carbon/Glass Fiber-Reinforced Composite Evaluation.

In this paper, an infrared pre-processing modality is presented. Different from a signal smoothing modality which only uses a polynomial fitting as the pre-processing method, the presented modality instead takes into account the low-order derivatives to pre-process the raw thermal data prior to applying the advanced post-processing techniques such as principal component thermography and pulsed phase thermography. Different cases were studied involving several defects in CFRPs and GFRPs for pulsed thermography and vibrothermography. Ultrasonic testing and signal-to-noise ratio analysis are used for the validation of the thermographic results. Finally, a verification that the presented modality can enhance the thermal image performance effectively is provided.

Automated assessment and tracking of human body thermal variations using unsupervised clustering.

The presented approach addresses a review of the overheating that occurs during radiological examinations, such as magnetic resonance imaging, and a series of thermal experiments to determine a thermally suitable fabric material that should be used for radiological gowns. Moreover, an automatic system for detecting and tracking of the thermal fluctuation is presented. It applies hue-saturated-value-based kernelled k-means clustering, which initializes and controls the points that lie on the region-of-interest (ROI) boundary. Afterward, a particle filter tracks the targeted ROI during the video sequence independently of previous locations of overheating spots. The proposed approach was tested during experiments and under conditions very similar to those used during real radiology exams. Six subjects have voluntarily participated in these experiments. To simulate the hot spots occurring during radiology, a controllable heat source was utilized near the subject's body. The results indicate promising accuracy for the proposed approach to track hot spots. Some approximations were used regarding the transmittance of the atmosphere, and emissivity of the fabric could be neglected because of the independence of the proposed approach for these parameters. The approach can track the heating spots continuously and correctly, even for moving subjects, and provides considerable robustness against motion artifact, which occurs during most medical radiology procedures.