Fusion of Multimodal Imaging and 3D Digitization Using Photogrammetry.

Multimodal sensors capture and integrate diverse characteristics of a scene to maximize information gain. In optics, this may involve capturing intensity in specific spectra or polarization states to determine factors such as material properties or an individual's health conditions. Combining multimodal camera data with shape data from 3D sensors is a challenging issue. Multimodal cameras, e.g., hyperspectral cameras, or cameras outside the visible light spectrum, e.g., thermal cameras, lack strongly in terms of resolution and image quality compared with state-of-the-art photo cameras. In this article, a new method is demonstrated to superimpose multimodal image data onto a 3D model created by multi-view photogrammetry. While a high-resolution photo camera captures a set of images from varying view angles to reconstruct a detailed 3D model of the scene, low-resolution multimodal camera(s) simultaneously record the scene. All cameras are pre-calibrated and rigidly mounted on a rig, i.e., their imaging properties and relative positions are known. The method was realized in a laboratory setup consisting of a professional photo camera, a thermal camera, and a 12-channel multispectral camera. In our experiments, an accuracy better than one pixel was achieved for the data fusion using multimodal superimposition. Finally, application examples of multimodal 3D digitization are demonstrated, and further steps to system realization are discussed.

Standardized analysis of syndesmosis stability in ankle trauma with an innovative syndesmosis-test-tool: a biomechanical study.

When treating ankle fractures, the question of syndesmosis complex involvement often arises. So far, there is no standardized method to reliably detect syndesmosis injuries in the surgical treatment of ankle fractures. For this reason, an intraoperative syndesmosis-test-tool (STT) was developed and compared to the recommended and established hook-test (HT). Tests were performed on cadaveric lower legs (n = 20) and the diastasis was visualized by 3D camera. Tests were performed at 50, 80, and 100 N in native conditions and four instability levels. Instability was induced from anterior to posterior and the reverse on the opposite side. The impact on diastasis regarding the direction, the force level, the instability level, and the device used was checked using a general linear model for repeated measurement. The direction of the induced instability showed no influence on the diastasis during the stability tests. The diastasis measured with the STT increased from 0.5 to 3.0 mm depending on the instability, while the range was lower with the HT (1.1 to 2.3 mm). The results showed that the differentiation between the instability levels was statistically significantly better for the developed STT. The last level of maximum instability was significantly better differentiable with the STT compared to the HT. An average visualizable diastasis of more than 2 mm could only be achieved at maximum instability. In conclusion, the newly developed STT was superior to the commonly used HT to detect instability.

BMP-2 (and partially GDF-5) coating significantly accelerates and augments bone formation close to hydroxyapatite/tricalcium-phosphate/brushite implant cylinders for tibial bone defects in senile, osteopenic sheep.

Bilateral defects (diameter 8 mm) in the medial tibial head of senile, osteopenic female sheep (n = 48; 9.63 ± 0.10 years; mean ± SEM) were treated with hydroxyapatite (HA)/beta-tricalcium phosphate (ß-TCP)/dicalcium phosphate dihydrate (DCPD; brushite) cylinders coated with BMP-2 (25 or 250 micrograms) or growth differentiation factor (GDF)-5 (125 or 1250 micrograms; left side); cylinders without BMP served as controls (right side). Three, 6, and 9 months post-operation (n = 6 each group), bone structure and formation were analyzed in vivo by X-ray and ex vivo by osteodensitometry, histomorphometry, and micro-computed tomography (micro-CT) at 3 and 9 months. Semi-quantitative X-ray evaluation showed significantly increasing bone densities around all implant cylinders over time. High-dose BMP-2-coated cylinders (3 and 9 months) and low-dose GDF-5-coated cylinders (3 and 6 months) demonstrated significantly higher densities than controls (dose-dependent for BMP-2 at 3 months). This was confirmed by osteodensitometry at 9 months for high-dose BMP-2-coated cylinders (and selected GDF-5 groups), and was again dose-dependent for BMP-2. Osteoinduction by BMP-2 was most pronounced in the adjacent bone marrow (dynamic histomorphometry/micro-CT). BMP-2 (and partially GDF-5) significantly increased the bone formation in the vicinity of HA/TCP/DCPD cylinders used to fill tibial bone defects in senile osteopenic sheep and may be suitable for surgical therapy of critical size, non-load-bearing bone defects in cases of failed tibial head fracture or defect healing.

Fibula Nail versus Locking Plate Fixation-A Biomechanical Study.

In the treatment of ankle fractures, complications such as wound healing problems following open reduction and internal fixation are a major problem. An innovative alternative to this procedure offers a more minimally invasive nail stabilization. The purpose of this biomechanical study was to clarify whether this method was biomechanically comparable to the established method. First, the stability (range of motion, diastasis) and rotational stiffness of the native upper ankle were evaluated in eight pairs of native geriatric specimens. Subsequently, an unstable ankle fracture was created and fixed with a locking plate or a nail in a pairwise manner. The ankles showed significantly less stability and rotational stiffness properties after nail and plate fixations than the corresponding native ankles (p < 0.001 for all parameters). When comparing the two methods, both showed no differences in their range of motion (p = 0.694) and diastasis (p = 0.166). The nail also presented significantly greater rotational stiffness compared to the plate (p = 0.001). However, both fixations remained behind the native stability and rotational stiffness. Due to the comparable biomechanical properties of the nail and plate fixations, an early weight-bearing following nail fixation should be assessed on a case-by-case basis considering the severity of fractures.

The Duality of Ray-Based and Pinhole-Camera Modeling and 3D Measurement Improvements Using the Ray-Based Model.

Geometrical camera modeling is the precondition for 3D-reconstruction tasks using photogrammetric sensor systems. The purpose of this study is to describe an approach for possible accuracy improvements by using the ray-based-camera model. The relations between the common pinhole and the generally valid ray-based-camera model are shown. A new approach to the implementation and calibration of the ray-based-camera model is introduced. Using a simple laboratory setup consisting of two cameras and a projector, experimental measurements were performed. The experiments and results showed the possibility of easily transforming the common pinhole model into a ray-based model and of performing calibration using the ray-based model. These initial results show the model's potential for considerable accuracy improvements, especially for sensor systems using wide-angle lenses or with deep 3D measurements. This study presents several approaches for further improvements to and the practical usage of high-precision optical 3D measurements.

High-resolution 3D shape measurement with extended depth of field using fast chromatic focus stacking.

Close-range 3D sensors based on the structured light principle have a constrained measuring range due to their depth of field (DOF). Focus stacking is a method to extend the DOF. The additional time to change the focus is a drawback in high-speed measurements. In our research, the method of chromatic focus stacking was applied to a high-speed 3D sensor with 180 fps frame rate. The extended DOF was evaluated by the distance-dependent 3D resolution derived from the 3D-MTF of a tilted edge. The conventional DOF of 14 mm was extended to 21 mm by stacking two foci at 455 and 520 nm wavelength. The 3D sensor allowed shape measurements with extended DOF within 44 ms.