Unsupervised machine learning for flaw detection in automated ultrasonic testing of carbon fibre reinforced plastic composites.

The use of Carbon Fibre Reinforced Plastic (CFRP) composite materials for critical components has significantly surged within the energy and aerospace industry. With this rapid increase in deployment, reliable post-manufacturing Non-Destructive Evaluation (NDE) is critical for verifying the mechanical integrity of manufactured components. To this end, an automated Ultrasonic Testing (UT) NDE process delivered by an industrial manipulator was developed, greatly increasing the measurement speed, repeatability, and locational precision, while increasing the throughput of data generated by the selected NDE modality. Data interpretation of UT signals presents a current bottleneck, as it is still predominantly performed manually in industrial settings. To reduce the interpretation time and minimise human error, this paper presents a two-stage automated NDE evaluation pipeline consisting of a) an intelligent gating process and b) an autoencoder (AE) defect detector. Both stages are based on an unsupervised method, leveraging density-based spatial clustering of applications with noise clustering method for robust automated gating and undefective UT data for the training of the AE architecture. The AE network trained on ultrasonic B-scan data was tested for performance on a set of reference CFRP samples with embedded and manufactured defects. The developed model is rapid during inference, processing over 2000 ultrasonic B-scans in 1.26 s with the area under the receiver operating characteristic curve of 0.922 in simple and 0.879 in complex geometry samples. The benefits and shortcomings of the presented methods are discussed, and uncertainties associated with the reported results are evaluated.

Can Mn:PIN-PMN-PT piezocrystal replace hard piezoceramic in power ultrasonic devices?

Mn:PIN-PMN-PT piezocrystal is investigated to determine whether its enhanced energy density makes it a candidate transducer material for power ultrasonics applications. To this end, the electromechanical and vibrational characteristics of a simple configuration of a bolted Langevin transducer (BLT) and then an ultrasonic surgical device, both incorporating Mn:PIN-PMN-PT piezocrystal, are compared with the same transducer configurations incorporating a conventional hard PZT piezoceramic commonly used in high-power ultrasonic transducers. The material properties of Mn:PIN-PMN-PT are determined using a single sample characterisation technique and these are used in finite element analysis (FEA) to design and then fabricate the BLT and ultrasonic surgical device, tuned to the first and second longitudinal modes at 20 kHz respectively. FEA is similarly used for the hard PZT versions. It is found that the superior elastic compliance of Mn:PIN-PMN-PT results in a higher radial piezo-stack deformation than the hard PZT under ultrasonic excitation of the BLT. However, the resulting longitudinal displacement amplitude of the two BLTs and two ultrasonic surgical devices is found to be equal, despite the higher figure of merit (Qkeff2) of those incorporating Mn:PIN-PMN-PT. The electrical impedance is measured at increasing excitation levels to evaluate the quality factor, Q. It is found that damping in the BLT with hard PZT is negligibly affected in the excitation range considered; however, the BLT incorporating Mn:PIN-PMN-PT exhibits a large reduction in Q. These findings indicate that, for measurements in air, the advantages of the high figure of merit of the piezocrystal material are not realised in a high-power transducer due to significantly increased damping at high excitation levels. To compare the vibrational response of the two ultrasonic surgical devices, L-C electrical impedance matching was implemented to maximise the efficiency of energy transfer from the source to the transducer under load. Results suggest that similar responses occurred for the two surgical devices in cutting tests using a low strength bone mimic material. However, the Mn:PIN-PMN-PT device exhibited better performance in cutting through higher strength ex-vivo chicken femur.

Effect of Phase-Change Nanodroplets and Ultrasound on Blood-Brain Barrier Permeability In Vitro.

Phase-change nanodroplets (PCND;NDs) are emulsions with a perfluorocarbon (PFC) core that undergo acoustic vaporisation as a response to ultrasound (US). Nanodroplets change to microbubbles and cavitate while under the effect of US. This cavitation can apply forces on cell connections in biological barrier membranes, such as the blood-brain barrier (BBB), and trigger a transient and reversible increased permeability to molecules and matter. This study aims to present the preparation of lipid-based NDs and investigate their effects on the brain endothelial cell barrier in vitro. The NDs were prepared using the thin-film hydration method, followed by the PFC addition. They were characterised for size, cavitation (using a high-speed camera), and PFC encapsulation (using FTIR). The bEnd.3 (mouse brain endothelial) cells were seeded onto transwell inserts. Fluorescein with NDs and/or microbubbles were applied on the bEND3 cells and the effect of US on fluorescein permeability was measured. The Live/Dead assay was used to assess the BBB integrity after the treatments. Size and PFC content analysis indicated that the NDs were stable while stored. High-speed camera imaging confirmed that the NDs cavitate after US exposure of 0.12 MPa. The BBB cell model experiments revealed a 4-fold increase in cell membrane permeation after the combined application of US and NDs. The Live/Dead assay results indicated damage to the BBB membrane integrity, but this damage was less when compared to the one caused by microbubbles. This in vitro study shows that nanodroplets have the potential to cause BBB opening in a similar manner to microbubbles. Both cavitation agents caused damage on the endothelial cells. It appears that NDs cause less cell damage compared to microbubbles.

Optimization and fabrication of programmable domains for soft magnetic robots: A review.

Driven by the aim of realizing functional robotic systems at the milli- and submillimetre scale for biomedical applications, the area of magnetically driven soft devices has received significant recent attention. This has resulted in a new generation of magnetically controlled soft robots with patterns of embedded, programmable domains throughout their structures. This type of programmable magnetic profiling equips magnetic soft robots with shape programmable memory and can be achieved through the distribution of discrete domains (voxels) with variable magnetic densities and magnetization directions. This approach has produced highly compliant, and often bio-inspired structures that are well suited to biomedical applications at small scales, including microfluidic transport and shape-forming surgical catheters. However, to unlock the full potential of magnetic soft robots with improved designs and control, significant challenges remain in their compositional optimization and fabrication. This review considers recent advances and challenges in the interlinked optimization and fabrication aspects of programmable domains within magnetic soft robots. Through a combination of improvements in the computational capacity of novel optimization methods with advances in the resolution, material selection and automation of existing and novel fabrication methods, significant further developments in programmable magnetic soft robots may be realized.

Machine learning-enabled quantitative ultrasound techniques for tissue differentiation.

PURPOSE: Quantitative ultrasound (QUS) infers properties about tissue microstructure from backscattered radio-frequency ultrasound data. This paper describes how to implement the most practical QUS parameters using an ultrasound research system for tissue differentiation. METHODS: This study first validated chicken liver and gizzard muscle as suitable acoustic phantoms for human brain and brain tumour tissues via measurement of the speed of sound and acoustic attenuation. A total of thirteen QUS parameters were estimated from twelve samples, each using data obtained with a transducer with a frequency of 5-11 MHz. Spectral parameters, i.e., effective scatterer diameter and acoustic concentration, were calculated from the backscattered power spectrum of the tissue, and echo envelope statistics were estimated by modelling the scattering inside the tissue as a homodyned K-distribution, yielding the scatterer clustering parameter α and the structure parameter κ. Standard deviation and higher-order moments were calculated from the echogenicity value assigned in conventional B-mode images. RESULTS: The k-nearest neighbours algorithm was used to combine those parameters, which achieved 94.5% accuracy and 0.933 F1-score. CONCLUSION: We were able to generate classification parametric images in near-real-time speed as a potential diagnostic tool in the operating room for the possible use for human brain tissue characterisation.

Flexible Piezoelectric Sensors for Miniaturized Sonomyography.

Sonomyography refers to the measurement of muscle activity with an ultrasonic transducer. It is a candidate modality for applications in diagnosis of muscle conditions, rehabilitation engineering and prosthesis control as an alternative to electromyography. We propose a mechanically-flexible piezoelectric sonomyography transducer. Simulating different components of the transducer, using COMSOL Multiphysics® software, we analyze various electromechanical parameters, such as von Mises stress and charge accumulation. Our findings on modelling of a single-element device, comprised of a PZT-5H layer of thickness 66µm, with a polymer substrate (E = 2.5 GPa), demonstrate optimal flexibility and charge accumulation for sonomyography. The addition of Polyimide and PMMA (Polymethyl methacrylate) as an acoustic matching layer and an acoustic lens, respectively, allowed for adequate energy transfer to the medium, whilst still maintaining good mechanical properties. In addition, preliminary ultrasound transmission simulations (200 kHz to 30 MHz) showed the importance of the aspect ratio of the device and how there is a need for further studies on it. The development of such a technology could be of great use within the healthcare sector, not only due to its ability to provide highly accurate and varied real-time muscle data, but also because of the range of applications that could benefit from its use.

Ultrasound mediated delivery of quantum dots from a proof of concept capsule endoscope to the gastrointestinal wall.

Biologic drugs, defined as therapeutic agents produced from or containing components of a living organism, are of growing importance to the pharmaceutical industry. Though oral delivery of medicine is convenient, biologics require invasive injections because of their poor bioavailability via oral routes. Delivery of biologics to the small intestine using electronic delivery with devices that are similar to capsule endoscopes is a promising means of overcoming this limitation and does not require reformulation of the therapeutic agent. The efficacy of such capsule devices for drug delivery could be further improved by increasing the permeability of the intestinal tract lining with an integrated ultrasound transducer to increase uptake. This paper describes a novel proof of concept capsule device capable of electronic application of focused ultrasound and delivery of therapeutic agents. Fluorescent markers, which were chosen as a model drug, were used to demonstrate in vivo delivery in the porcine small intestine with this capsule. We show that the fluorescent markers can penetrate the mucus layer of the small intestine at low acoustic powers when combining microbubbles with focused ultrasound during in vivo experiments using porcine models. This study illustrates how such a device could be potentially used for gastrointestinal drug delivery and the challenges to be overcome before focused ultrasound and microbubbles could be used with this device for the oral delivery of biologic therapeutics.

A Learning-Based Microultrasound System for the Detection of Inflammation of the Gastrointestinal Tract.

Inflammation of the gastrointestinal (GI) tract accompanies several diseases, including Crohn's disease. Currently, video capsule endoscopy and deep bowel enteroscopy are the main means for direct visualisation of the bowel surface. However, the use of optical imaging limits visualisation to the luminal surface only, which makes early-stage diagnosis difficult. In this study, we propose a learning enabled microultrasound ( µ US) system that aims to classify inflamed and non-inflamed bowel tissues. µ US images of the caecum, small bowel and colon were obtained from mice treated with agents to induce inflammation. Those images were then used to train three deep learning networks and to provide a ground truth of inflammation status. The classification accuracy was evaluated using 10-fold evaluation and additional B-scan images. Our deep learning approach allowed robust differentiation between healthy tissue and tissue with early signs of inflammation that is not detectable by current endoscopic methods or by human inspection of the µ US images. The methods may be a foundation for future early GI disease diagnosis and enhanced management with computer-aided imaging.

Full Set of Material Properties of Lead-Free PIC 700 for Transducer Designers.

The impact of Pb on the environment and human health and recent restrictions on its use in electronic devices are generating demand for Pb-free piezoelectric materials. Examples are now available commercially, but the full elastic-piezoelectric-dielectric (EPD) matrices needed for device design, including over a range of operating conditions, have not yet been published. The standard IEEE EPD matrix measurement method needs four sample geometries, making it inconvenient and increasing errors. Here, we present an alternative method combining resonant ultrasound spectroscopy with optimization algorithms to measure the EPD matrix from a single exact cube sample. The Levenberg-Marquardt (LM) and Nelder-Mead (NM) optimizations are compared in refining the independent parameters. Both give convergent solutions, but the LM algorithm is more accurate and efficient. The single-sample approach was used to obtain results from Pb-free Na1/2Bi1/2TiO3 (PIC 700, PI Ceramics, Lederhose, Germany) piezoceramic ( ∞ mm sample symmetry) characterized with the standard IEEE method at ambient temperature and with the single-sample method at ambient temperature and additionally up to 80 °C. The results are validated with the laser Doppler vibrometry via mode shape reconstruction and comparison with finite-element analysis (FEA). They demonstrate that convenient measurement of the EPD matrix of Pb-free materials with temperature dependence is possible, providing a crucial capability for the adoption of these materials in devices.

Introduction of a Measurement Setup to Monitor the Pressure Applied During Handheld Ultrasound Elastography.

Shear-wave elastography may produce misleadingly high values if too much pressure is applied during the imaging process. However, in clinical routine there is presently no way to monitor the pressure applied during the measurements. In this work we introduce a novel measurement setup which can directly be attached to an ultrasonic imaging transducer and allows observation of the applied pressure in real time. The setup supports free-hand imaging according to the clinical standard. We tested the setup by carrying out shear-wave elastography under varying pressures on ex vivo animal tissue. The values increased with pressure, as was expected. Thus, the setup is a possible solution for measuring applied pressure in real time.

Ultrasound Capsule Endoscopy With a Mechanically Scanning Micro-ultrasound: A Porcine Study.

Wireless capsule endoscopy has been used for the clinical examination of the gastrointestinal (GI) tract for two decades. However, most commercially available devices only utilise optical imaging to examine the GI wall surface. Using this sensing modality, pathology within the GI wall cannot be detected. Micro-ultrasound (µUS) using high-frequency (>20 MHz) ultrasound can provide a means of transmural or cross-sectional image of the GI tract. Depth of imaging is approximately 10 mm with a resolution of between 40-120 µm that is sufficient to differentiate between subsurface histologic layers of the various regions of the GI tract. Ultrasound capsule endoscopy (USCE) uses a capsule equipped with µUS transducers that are capable of imaging below the GI wall surface, offering thereby a complementary sensing technique to optical imaging capsule endoscopy. In this work, a USCE device integrated with a ∼30 MHz ultrasonic transducer was developed to capture a full 360° image of the lumen. The performance of the device was initially evaluated using a wire phantom, indicating an axial resolution of 69.0 µm and lateral resolution of 262.5 µm. Later, in vivo imaging performance was characterised in the oesophagus and small intestine of anaesthetized pigs. The reconstructed images demonstrate clear layer differentiation of the lumen wall. The tissue thicknesses measured from the B-scan images show good agreement with ex vivo images from the literature. The high-resolution ultrasound images in the in vivo porcine model achieved with this device is an encouraging preliminary step in the translation of these devices toward future clinical use.

Multi-Channel Signal-Generator ASIC for Acoustic Holograms.

A complementary metal-oxide-semiconductor (CMOS) application-specific integrated circuit (ASIC) has been developed to generate arbitrary, dynamic phase patterns for acoustic hologram applications. An experimental prototype has been fabricated to demonstrate phase shaping. It comprises a cascadable 1 ×9 array of identical, independently controlled signal generators implemented in a 0.35- [Formula: see text] minimum-feature-size process. It can individually control the phase of a square wave on each of the nine output pads. The footprint of the integrated circuit is [Formula: see text]. A 128-MHz clock frequency is used to produce outputs at 8 MHz with a phase resolution of 16 levels (4 bits) per channel. A 6 ×6 air-coupled matrix array ultrasonic transducer was built and driven by four ASICs, with the help of commercial buffer amplifiers, for the application demonstration. Acoustic pressure mapping and particle manipulation were performed. In addition, a 2 ×2 array piezoelectric micromachined ultrasonic transducer (PMUT) was connected and driven by four output channels of a single ASIC, demonstrating the flexibility of the ASIC to work with different transducers and the potential for direct integration of CMOS and PMUTs.

Multimodal Integrated Sensor Platform for Rapid Biomarker Detection.

Precision metabolomics and quantification for cost-effective rapid diagnosis of disease are the key goals in personalized medicine and point-of-care testing. At present, patients are subjected to multiple test procedures requiring large laboratory equipment. Microelectronics has already made modern computing and communications possible by integration of complex functions within a single chip. As More than Moore technology increases in importance, integrated circuits for densely patterned sensor chips have grown in significance. Here, we present a versatile single complementary metal-oxide-semiconductor chip forming a platform to address personalized needs through on-chip multimodal optical and electrochemical detection that will reduce the number of tests that patients must take. The chip integrates interleaved sensing subsystems for quadruple-mode colorimetric, chemiluminescent, surface plasmon resonance, and hydrogen ion measurements. These subsystems include a photodiode array and a single photon avalanche diode array with some elements functionalized to introduce a surface plasmon resonance mode. The chip also includes an array of ion sensitive field-effect transistors. The sensor arrays are distributed uniformly over an active area on the chip surface in a scalable and modular design. Bio-functionalization of the physical sensors yields a highly selective simultaneous multiple-assay platform in a disposable format. We demonstrate its versatile capabilities through quantified bio-assays performed on-chip for glucose, cholesterol, urea, and urate, each within their naturally occurring physiological range.

Intelligent magnetic manipulation for gastrointestinal ultrasound.

Diagnostic endoscopy in the gastrointestinal tract has remained largely unchanged for decades and is limited to the visualization of the tissue surface, the collection of biopsy samples for diagnoses, and minor interventions such as clipping or tissue removal. In this work, we present the autonomous servoing of a magnetic capsule robot for in-situ, subsurface diagnostics of microanatomy. We investigated and showed the feasibility of closed-loop magnetic control using digitized microultrasound (µUS) feedback; this is crucial for obtaining robust imaging in an unknown and unconstrained environment. We demonstrated the functionality of an autonomous servoing algorithm that uses µUS feedback, both on benchtop trials as well as in-vivo in a porcine model. We have validated this magnetic-µUS servoing in instances of autonomous linear probe motion and were able to locate markers in an agar phantom with 1.0 ± 0.9 mm position accuracy using a fusion of robot localization and µUS image information. This work demonstrates the feasibility of closed-loop robotic µUS imaging in the bowel without the need for either a rigid physical link between the transducer and extracorporeal tools or complex manual manipulation.

Thin Film PZT-Based PMUT Arrays for Deterministic Particle Manipulation.

Lead zirconate titanate (PZT)-based piezoelectric micromachined ultrasonic transducers (PMUTs) for particle manipulation applications were designed, fabricated, characterized, and tested. The PMUTs had a diaphragm diameter of 60 [Formula: see text], a resonant frequency of ~8 MHz, and an operational bandwidth (BW) of 62.5%. Acoustic pressure output in water was 9.5 kPa at 7.5 mm distance from a PMUT element excited with a unipolar waveform at 5 Vpp . The element consisted of 20 diaphragms connected electrically in parallel. Particle trapping of 4 [Formula: see text] silica beads was shown to be possible with 5 Vpp unipolar excitation. Trapping of multiple beads by a single element and deterministic control of particles via acoustophoresis without the assistance of microfluidic flow were demonstrated. It was found that the particles move toward diaphragm areas of highest pressure, in agreement with literature and simulations. Unique bead patterns were generated at different driving frequencies and were formed at frequencies up to 60 MHz, much higher than the operational BW. Levitation planes were generated above the 30 MHz driving frequency.

Gastrointestinal diagnosis using non-white light imaging capsule endoscopy.

Capsule endoscopy (CE) has proved to be a powerful tool in the diagnosis and management of small bowel disorders since its introduction in 2001. However, white light imaging (WLI) is the principal technology used in clinical CE at present, and therefore, CE is limited to mucosal inspection, with diagnosis remaining reliant on visible manifestations of disease. The introduction of WLI CE has motivated a wide range of research to improve its diagnostic capabilities through integration with other sensing modalities. These developments have the potential to overcome the limitations of WLI through enhanced detection of subtle mucosal microlesions and submucosal and/or transmural pathology, providing novel diagnostic avenues. Other research aims to utilize a range of sensors to measure physiological parameters or to discover new biomarkers to improve the sensitivity, specificity and thus the clinical utility of CE. This multidisciplinary Review summarizes research into non-WLI CE devices by organizing them into a taxonomic structure on the basis of their sensing modality. The potential of these capsules to realize clinically useful virtual biopsy and computer-aided diagnosis (CADx) is also reported.

Light sheet microscopy with acoustic sample confinement.

Contactless sample confinement would enable a whole host of new studies in developmental biology and neuroscience, in particular, when combined with long-term, wide-field optical imaging. To achieve this goal, we demonstrate a contactless acoustic gradient force trap for sample confinement in light sheet microscopy. Our approach allows the integration of real-time environmentally controlled experiments with wide-field low photo-toxic imaging, which we demonstrate on a variety of marine animal embryos and larvae. To illustrate the key advantages of our approach, we provide quantitative data for the dynamic response of the heartbeat of zebrafish larvae to verapamil and norepinephrine, which are known to affect cardiovascular function. Optical flow analysis allows us to explore the cardiac cycle of the zebrafish and determine the changes in contractile volume within the heart. Overcoming the restrictions of sample immobilisation and mounting can open up a broad range of studies, with real-time drug-based assays and biomechanical analyses.

In-Vivo Evaluation of Microultrasound and Thermometric Capsule Endoscopes.

Clinical endoscopy and colonoscopy are commonly used to investigate and diagnose disorders in the upper gastrointestinal tract and colon, respectively. However, examination of the anatomically remote small bowel with conventional endoscopy is challenging. This and advances in miniaturization led to the development of video capsule endoscopy (VCE) to allow small bowel examination in a noninvasive manner. Available since 2001, current capsule endoscopes are limited to viewing the mucosal surface only due to their reliance on optical imaging. To overcome this limitation with submucosal imaging, work is under way to implement microultrasound (µUS) imaging in the same form as VCE devices. This paper describes two prototype capsules, termed Sonocap and Thermocap, which were developed respectively to assess the quality of µUS imaging and the maximum power consumption that can be tolerated for such a system. The capsules were tested in vivo in the oesophagus and small bowel of porcine models. Results are presented in the form of µUS B-scans as well as safe temperature readings observed up to 100 mW in both biological regions. These results demonstrate that acoustic coupling and µUS imaging can be achieved in vivo in the lumen of the bowel and the maximum power consumption that is possible for miniature µUS systems.

Improved Performance of -Mode Needle-Actuating Transducer With PMN-PT Piezocrystal.

Prototypes of a PZT-based ultrasound needle-actuating device have shown the ability to reduce needle penetration force and enhance needle visibility with color Doppler imaging during needle insertion for tissue biopsy and regional anesthesia. However, the demand for smaller, lighter devices and the need for high performance transducers have motivated investigation of a different configuration of needle-actuation transducer, utilizing the -mode of PZT4 piezoceramic, and exploration of further improvement in its performance using relaxor-type piezocrystal. This paper outlines the development of the -mode needle actuation transducer design from simulation to fabrication and demonstration. Full characterization was performed on transducers for performance comparison. The performance of the proposed smaller, lighter -mode transducer is comparable with that of previous -mode transducers. Furthermore, it has been found to be much more efficient when using PMN-PT piezocrystal rather than piezoceramic.

Design and Simulation of a Ring-Shaped Linear Array for Microultrasound Capsule Endoscopy.

Video capsule endoscopy (VCE) has significantly advanced visualization of the gastrointestinal tract since its introduction in the last 20 years. Work is now under way to combine VCE with microultrasound imaging. However, small maximum capsule dimensions, coupled with the electronics required to integrate ultrasound imaging capabilities, pose significant design challenges. This paper describes a simulation process for testing transducer geometries and imaging methodologies to achieve satisfactory imaging performance within the physical limitations of the capsule size and outlines many of the tradeoffs needed in the design of this new class of ultrasound capsule endoscopy (USCE) device. A hybrid MATLAB model is described, incorporating Krimholtz-Leedom-Matthaei circuit elements and digitizing and beamforming elements to render a gray-scale B-mode. This model is combined with a model of acoustic propagation to generate images of point scatterers. The models are used to demonstrate the performance of a USCE transducer configuration comprising a single, unfocused transmit ring of radius 5 mm separated into eight segments for electrical impedance control and a 512-element receive linear array, also formed into a ring. The MATLAB model includes an ultrasonic pulser circuit connected to a piezocrystal composite transmit transducer with a center frequency of 25 MHz. B-scan images are simulated for wire target phantoms, multilayered phantoms, and a gut wall model. To demonstrate the USCE system's ability to image tissue, a digital phantom was created from single-element ultrasonic transducer scans of porcine small bowel ex vivo obtained at a frequency of 45 MHz.