Computer Vision and Augmented Reality for Human-Centered Fatigue Crack Inspection.

A significant percentage of bridges in the United States are serving beyond their 50-year design life, and many of them are in poor condition, making them vulnerable to fatigue cracks that can result in catastrophic failure. However, current fatigue crack inspection practice based on human vision is time-consuming, labor intensive, and prone to error. We present a novel human-centered bridge inspection methodology to enhance the efficiency and accuracy of fatigue crack detection by employing advanced technologies including computer vision and augmented reality (AR). In particular, a computer vision-based algorithm is developed to enable near-real-time fatigue crack detection by analyzing structural surface motion in a short video recorded by a moving camera of the AR headset. The approach monitors structural surfaces by tracking feature points and measuring variations in distances between feature point pairs to recognize the motion pattern associated with the crack opening and closing. Measuring distance changes between feature points, as opposed to their displacement changes before this improvement, eliminates the need of camera motion compensation and enables reliable and computationally efficient fatigue crack detection using the nonstationary AR headset. In addition, an AR environment is created and integrated with the computer vision algorithm. The crack detection results are transmitted to the AR headset worn by the bridge inspector, where they are converted into holograms and anchored on the bridge surface in the 3D real-world environment. The AR environment also provides virtual menus to support human-in-the-loop decision-making to determine optimal crack detection parameters. This human-centered approach with improved visualization and human-machine collaboration aids the inspector in making well-informed decisions in the field in a near-real-time fashion. The proposed crack detection method is comprehensively assessed using two laboratory test setups for both in-plane and out-of-plane fatigue cracks. Finally, using the integrated AR environment, a human-centered bridge inspection is conducted to demonstrate the efficacy and potential of the proposed methodology.

Sensor Equipped UAS for Non-Contact Bridge Inspections: Field Application.

In the future, sensors mounted on uncrewed aerial systems (UASs) will play a critical role in increasing both the speed and safety of structural inspections. Environmental and safety concerns make structural inspections and maintenance challenging when conducted using traditional methods, especially for large structures. The methods developed and tested in the laboratory need to be tested in the field on real-size structures to identify their potential for full implementation. This paper presents results from a full-scale field implementation of a novel sensor equipped with UAS to measure non-contact transverse displacement from a pedestrian bridge. To this end, the authors modified and upgraded a low-cost system that previously showed promise in laboratory and small-scale outdoor settings so that it could be tested on an in-service bridge. The upgraded UAS system uses a commodity drone platform, low-cost sensors including a laser range-finder, and a computer vision-based algorithm with the aim of measuring bridge displacements under load indicative of structural problems. The aim of this research is to alleviate the costs and challenges associated with sensor attachment in bridge inspections and deliver the first prototype of a UAS-based non-contact out-of-plane displacement measurement. This work helps to define the capabilities and limitations of the proposed low-cost system in obtaining non-contact transverse displacement in outdoor experiments.

Use of Remote Structural Tap Testing Devices Deployed via Ground Vehicle for Health Monitoring of Transportation Infrastructure.

Transportation infrastructure is an integral part of the world's overall functionality; however, current transportation infrastructure has aged since it was first developed and implemented. Consequently, given its condition, preservation has become a main priority for transportation agencies. Billions of dollars annually are required to maintain the United States' transportation system; however, with limited budgets the prioritization of maintenance and repairs is key. Structural Health Monitoring (SHM) methods can efficiently inform the prioritization of preservation efforts. This paper presents an acoustic monitoring SHM method, deemed tap testing, which is used to detect signs of deterioration in structural/mechanical surfaces through nondestructive means. This method is proposed as a tool to assist bridge inspectors, who already utilize a costly form of SHM methodology when conducting inspections in the field. Challenges arise when it comes to this method of testing, especially when SHM device deployment is done by hand, and when the results are based solely upon a given inspector's abilities. This type of monitoring solution is also, in general, only available to experts, and is associated with special cases that justify their cost. With the creation of a low-cost, cyber-physical system that interrogates and classifies the mechanical health of given surfaces, we lower the cost of SHM, decrease the challenges faced when conducting such tests, and enable communities with a revolutionary solution that is adaptable to their needs. The authors of this paper created and tested a low-cost, interrogating robot that informs users of structural/mechanical defects. This research describes the further development, validation of, and experimentation with, a tap testing device that utilizes remote technology.

Measuring Transverse Displacements Using Unmanned Aerial Systems Laser Doppler Vibrometer (UAS-LDV): Development and Field Validation.

Measurement of bridge displacements is important for ensuring the safe operation of railway bridges. Traditionally, contact sensors such as Linear Variable Displacement Transducers (LVDT) and accelerometers have been used to measure the displacement of the railway bridges. However, these sensors need significant effort in installation and maintenance. Therefore, railroad management agencies are interested in new means to measure bridge displacements. This research focuses on mounting Laser Doppler Vibrometer (LDV) on an Unmanned Aerial System (UAS) to enable contact-free transverse dynamic displacement of railroad bridges. Researchers conducted three field tests by flying the Unmanned Aerial Systems Laser Doppler Vibrometer (UAS-LDV) 1.5 m away from the ground and measured the displacement of a moving target at various distances. The accuracy of the UAS-LDV measurements was compared to the Linear Variable Differential Transducer (LVDT) measurements. The results of the three field tests showed that the proposed system could measure non-contact, reference-free dynamic displacement with an average peak and root mean square (RMS) error for the three experiments of 10% and 8% compared to LVDT, respectively. Such errors are acceptable for field measurements in railroads, as the interest prior to bridge monitoring implementation of a new approach is to demonstrate similar success for different flights, as reported in the three results. This study also identified barriers for industrial adoption of this technology and proposed operational development practices for both technical and cost-effective implementation.

Parametric study of 3D printed microneedle (MN) holders for interstitial fluid (ISF) extraction.

The need for novel, minimally invasive diagnostic, prognostic, and therapeutic biomedical devices has garnered increased interest in recent years. Microneedle (MN) technology has stood out as a promising new method for drug delivery, as well as extraction of interstitial fluid (ISF). ISF comprises a large portion of the extracellular fluid in living organisms yet remains inadequately characterized for clinical applications. Current MN research has focused on the fabrication of needles with different materials like silicone, carbon, and metals. However, little effort has been put forth into improving MN holders and patches that can be used with low cost MNs, which could effectively change how MNs are attached to the human body. Here, we describe different 3D-printed MN holders, printed using an MJP Pro 2500 3D printer, and compare the ISF extraction efficiencies in CD Hairless rats. We varied design parameters that may affect the skin-holder interface, such as throat thickness, tip curvature, and throat diameter. MN arrays, with insertion depths of 1500 µm, had extraction efficiencies of 0.44 ± 0.35, 0.85 ± 0.64, 0.32 ± 0.21, or 0.44 ± 0.46 µl/min when designed with flat, concave, convex, or bevel profile geometries, respectively. Our results suggest ISF extraction is influenced by MN holder design parameters and that a concave tip design is optimal for extracting ISF from animals. The future direction of this research aims to enable a paradigm in MN design that maximizes its efficiency and engineering performance in terms of volume, pressure, and wearability, thereby automatizing usage and reducing patient intervention to ultimately benefit remote telemedicine.

Quantifying Information without Entropy: Identifying Intermittent Disturbances in Dynamical Systems.

A system's response to disturbances in an internal or external driving signal can be characterized as performing an implicit computation, where the dynamics of the system are a manifestation of its new state holding some memory about those disturbances. Identifying small disturbances in the response signal requires detailed information about the dynamics of the inputs, which can be challenging. This paper presents a new method called the Information Impulse Function (IIF) for detecting and time-localizing small disturbances in system response data. The novelty of IIF is its ability to measure relative information content without using Boltzmann's equation by modeling signal transmission as a series of dissipative steps. Since a detailed expression of the informational structure in the signal is achieved with IIF, it is ideal for detecting disturbances in the response signal, i.e., the system dynamics. Those findings are based on numerical studies of the topological structure of the dynamics of a nonlinear system due to perturbated driving signals. The IIF is compared to both the Permutation entropy and Shannon entropy to demonstrate its entropy-like relationship with system state and its degree of sensitivity to perturbations in a driving signal.

Measuring Reference-Free Total Displacements of Piles and Columns Using Low-Cost, Battery-Powered, Efficient Wireless Intelligent Sensors (LEWIS2).

Currently, over half of the U.S.'s railroad bridges are more than 100 years old. Railroad managers ensure that the proper Maintenance, Repair, and Replacement (MRR) of rail infrastructure is prioritized to safely adapt to the increasing traffic demand. By 2035, the demand for U.S. railroad transportation will increase by 88%, which indicates that considerable expenditure is necessary to upgrade rail infrastructure. Railroad bridge managers need to use their limited funds for bridge MRR to make informed decisions about safety. Consequently, they require economical and reliable methods to receive objective data about bridge displacements under service loads. Current methods of measuring displacements are often expensive. Wired sensors, such as Linear Variable Differential Transformers (LVDTs), require time-consuming installation and involve high labor and maintenance costs. Wireless sensors (WS) are easier to install and maintain but are in general technologically complex and costly. This paper summarizes the development and validation of LEWIS2, the second version of the real-time, low-cost, efficient wireless intelligent sensor (LEWIS) for measuring and autonomously storing reference-free total transverse displacements. The new features of LEWIS2 include portability, accuracy, cost-effectiveness, and readiness for field application. This research evaluates the effectiveness of LEWIS2 for measuring displacements through a series of laboratory experiments. The experiments demonstrate that LEWIS2 can accurately estimate reference-free total displacements, with a maximum error of only 11% in comparison with the LVDT, while it costs less than 5% of the average price of commercial wireless sensors.