Background Registration-Based Adaptive Noise Filtering of LWIR/MWIR Imaging Sensors for UAV Applications.

Unmanned aerial vehicles (UAVs) are equipped with optical systems including an infrared (IR) camera such as electro-optical IR (EO/IR), target acquisition and designation sights (TADS), or forward looking IR (FLIR). However, images obtained from IR cameras are subject to noise such as dead pixels, lines, and fixed pattern noise. Nonuniformity correction (NUC) is a widely employed method to reduce noise in IR images, but it has limitations in removing noise that occurs during operation. Methods have been proposed to overcome the limitations of the NUC method, such as two-point correction (TPC) and scene-based NUC (SBNUC). However, these methods still suffer from unfixed pattern noise. In this paper, a background registration-based adaptive noise filtering (BRANF) method is proposed to overcome the limitations of conventional methods. The proposed BRANF method utilizes background registration processing and robust principle component analysis (RPCA). In addition, image quality verification methods are proposed that can measure the noise filtering performance quantitatively without ground truth images. Experiments were performed for performance verification with middle wave infrared (MWIR) and long wave infrared (LWIR) images obtained from practical military optical systems. As a result, it is found that the image quality improvement rate of BRANF is 30% higher than that of conventional NUC.

X-ray and optical stereo-based 3D sensor fusion system for image-guided neurosurgery.

PURPOSE: In neurosurgery, an image-guided operation is performed to confirm that the surgical instruments reach the exact lesion position. Among the multiple imaging modalities, an X-ray fluoroscope mounted on C- or O-arm is widely used for monitoring the position of surgical instruments and the target position of the patient. However, frequently used fluoroscopy can result in relatively high radiation doses, particularly for complex interventional procedures. The proposed system can reduce radiation exposure and provide the accurate three-dimensional (3D) position information of surgical instruments and the target position. METHODS: X-ray and optical stereo vision systems have been proposed for the C- or O-arm. Two subsystems have same optical axis and are calibrated simultaneously. This provides easy augmentation of the camera image and the X-ray image. Further, the 3D measurement of both systems can be defined in a common coordinate space. RESULTS: The proposed dual stereoscopic imaging system is designed and implemented for mounting on an O-arm. The calibration error of the 3D coordinates of the optical stereo and X-ray stereo is within 0.1 mm in terms of the mean and the standard deviation. Further, image augmentation with the camera image and the X-ray image using an artificial skull phantom is achieved. CONCLUSION: As the developed dual stereoscopic imaging system provides 3D coordinates of the point of interest in both optical images and fluoroscopic images, it can be used by surgeons to confirm the position of surgical instruments in a 3D space with minimum radiation exposure and to verify whether the instruments reach the surgical target observed in fluoroscopic images.

Optical coordinate tracking system using afocal optics for image-guided surgery.

PURPOSE: Image-guided surgery using medical robots supports surgeons by providing critical real-time feedback information, such as surgical instrument tracking, patient-specific models, and the use of surgery robots. An image-guided surgery system based on afocal optics was developed to overcome the problems associated with conventional optical tracking systems. METHOD: An optical tracking system was developed that utilizes afocal optics. Instead of using geometrically specified marker spheres as tracking targets, the proposed system uses a marker with a lens and a micro-engraved data-coded pattern. A position and orientation-tracking algorithm was developed to utilize the observed afocal images of the marker patterns. The marker used in this tracking system can be manufactured in a smaller size than traditional optical tracker markers, and the accuracy of the proposed tracking system has significant potential for improvement due to its focused and highly magnified image. The system was tested in vitro on an optical bench with position and orientation measurement experiments using a commercial optical tracker, Polaris Vicra (NDI Corp.) for comparison. RESULTS: The afocal optical system provided accuracy in position and orientation that was equal or better than a commercial optical tracker system, and provided a high degree of consistency during in vitro testing. The position error was 21µ m, and the orientation error was 0.093°. CONCLUSION: An afocal optical tracker is feasible and potentially advantageous for surgical navigation, as it is expected to have fewer occlusions and provide greater efficiency for coordinate matching and tracking of patient-specific models, surgical instruments, and surgery robots. This promising new system requires in vivo testing.