Automatic segmentation of orbital wall from CT images via a thin wall region supervision-based multi-scale feature search network.

PURPOSE: Orbital wall segmentation is critical for orbital measurement and reconstruction. However, the orbital floor and medial wall are made up of thin walls (TW) with low gradient values, making it difficult to segment the blurred areas of the CT images. Clinically, doctors have to manually repair the missing parts of TW, which is time-consuming and laborious. METHODS: To address these issues, this paper proposes an automatic orbital wall segmentation method based on TW region supervision using a multi-scale feature search network. First of all, in the encoding branch, the densely connected atrous spatial pyramid pooling based on the residual connection is adopted to achieve a multi-scale feature search. Then, for feature enhancement, multi-scale up-sampling and residual connection are applied to perform skip connection of features in multi-scale convolution. Finally, we explore a strategy for improving the loss function based on the TW region supervision, which effectively increases the TW region segmentation accuracy. RESULTS: The test results show that the proposed network performs well in terms of automatic segmentation. For the whole orbital wall region, the Dice coefficient (Dice) of segmentation accuracy reaches 96.086 ± 1.049%, the Intersection over Union (IOU) reaches 92.486 ± 1.924%, and the 95% Hausdorff distance (HD) reaches 0.509 ± 0.166 mm. For the TW region, the Dice reaches 91.470 ± 1.739%, the IOU reaches 84.327 ± 2.938%, and the 95% HD reaches 0.481 ± 0.082 mm. Compared with other segmentation networks, the proposed network improves the segmentation accuracy while filling the missing parts in the TW region. CONCLUSION: In the proposed network, the average segmentation time of each orbital wall is only 4.05 s, obviously improving the segmentation efficiency of doctors. In the future, it may have a practical significance in clinical applications such as preoperative planning for orbital reconstruction, orbital modeling, orbital implant design, and so on.

A novel technique to quantify bone-to-implant contact of zygomatic implants: a radiographic analysis based on three-dimensional image registration and segmentation.

OBJECTIVES: The purpose of this study is to establish a novel, reproducible technique to obtain the BIC area (BICA) between zygomatic implants and zygomatic bone based on post-operative cone-beam computed tomography (CBCT) images. Three-dimensional (3D) image registration and segmentation were used to eliminate the effect of metal-induced artifacts of zygomatic implants. METHODS: An ex-vivo study was included to verify the feasibility of the new method. Then, the radiographic bone-to-implant contact (rBIC) of 143 implants was measured in a total of 50 patients. To obtain the BICA of zygomatic implants and the zygomatic bone, several steps were necessary, including image preprocessing of CBCT scans, identification of the position of zygomatic implants, registration, and segmentation of pre- and post-operative CBCT images, and 3D reconstruction of models. The conventional two-dimensional (2D) linear rBIC (rBICc) measurement method with post-operative CBCT images was chosen as a comparison. RESULTS: The mean values of rBIC and rBICc were 15.08 ± 5.92 mm and 14.77 ± 5.14 mm, respectively. A statistically significant correlation was observed between rBIC and rBICc values ([Formula: see text]=0.86, p < 0.0001). CONCLUSIONS: This study proposed a standardized, repeatable, noninvasive technique to quantify the rBIC of post-operative zygomatic implants in 3D terms. This technique is comparable to conventional 2D linear measurements and seems to be more reliable than these conventional measurements; thus, this method could serve as a valuable tool in the performance of clinical research protocols.

Automatic surgical planning based on bone density assessment and path integral in cone space for reverse shoulder arthroplasty.

PURPOSE: Reverse shoulder arthroplasty (RSA) is an effective surgery for severe shoulder joint diseases. Traditionally, the preoperative planning procedure of RSA is manually conducted by experienced surgeons, resulting in prolonged operating time and unreliable drilling paths of the prosthetic fixation screws. In this study, an automatic surgical planning algorithm for RSA was proposed to compute the optimal path of screw implantation. METHODS: Firstly, a cone-shaped space containing alternative paths for each screw is generated using geometric parameters. Then, the volume constraint is applied to automatically remove inappropriate paths outside the bone boundary. Subsequently, the integral of grayscale value of the CT is used to evaluate the bone density and to compute the optimal solution. An automatic surgical planning software for RSA was also developed with the aforementioned algorithms. RESULTS: Twenty-four clinical cases were used for preoperative planning to evaluate the accuracy and efficiency of the system. Results demonstrated that the angles among the prosthetic fixation screws were all within constraint angle(45°), and the stability rate of the planned prosthesis was 94.92%. The average time for the automatic planning algorithm was 4.39 s, and 83.96 s for the whole procedure. Repetitive experiments were also conducted to demonstrate the robustness of our system, and the variance of the stability coefficient was 0.027%. CONCLUSIONS: In contrast to the cumbersome manual planning of the existing methods for RSA, our method requires only simple interaction operations. It enables efficient and precise automatic preoperative planning to simulate the ideal placement of the long prosthetic screws for the long-term stability of the prosthesis. In the future, it will have great clinical application prospects in RSA.

Development and model form assessment of an automatic subject-specific vertebra reconstruction method.

BACKGROUND: Current spine models for analog bench models, surgical navigation and training platforms are conventionally based on 3D models from anatomical human body polygon database or from time-consuming manual-labelled data. This work proposed a workflow of quick and accurate subject-specific vertebra reconstruction method and quantified the reconstructed model accuracy and model form errors. METHODS: Four different neural networks were customized for vertebra segmentation. To validate the workflow in clinical applications, an excised human lumbar vertebra was scanned via CT and reconstructed into 3D CAD models using four refined networks. A reverse engineering solution was proposed to obtain the high-precision geometry of the excised vertebra as gold standard. The 3D model evaluation metrics and a finite element analysis (FEA) method were designed to reflect the model accuracy and model form errors. RESULTS: The automatic segmentation networks achieved the best Dice score of 94.20% in validation datasets. The accuracy of reconstructed models was quantified with the best 3D Dice index of 92.80%, 3D IoU of 86.56%, Hausdorff distance of 1.60 mm, and the heatmaps and histograms were used for error visualization. The FEA results showed the impact of different geometries and reflected partial surface accuracy of the reconstructed vertebra under biomechanical loads with the closest percentage error of 4.2710% compared to the gold standard model. CONCLUSIONS: In this work, a workflow of automatic subject-specific vertebra reconstruction method was proposed while the errors in geometry and FEA were quantified. Such errors should be considered when leveraging subject-specific modelling towards the development and improvement of treatments.

A 3D segmentation network of mandible from CT scan with combination of multiple convolutional modules and edge supervision in mandibular reconstruction.

Mandibular reconstruction is a very complex surgery that demands removing the tumor, which is followed by reconstruction of the defective mandible. Accurate segmentation of the mandible plays an important role in its preoperative planning. However, there are many segmentation challenges including the connected boundaries of upper and lower teeth, blurred condyle edges, metal artifact interference, and different shapes of the mandibles with tumor invasion (MTI). Those manual or semi-automatic segmentation methods commonly used in clinical practice are time-consuming and have poor effects. The automatic segmentation methods are mainly developed for the mandible without tumor invasion (Non-MTI) rather than MTI and have problems such as under-segmentation. Given these problems, this paper proposed a 3D automatic segmentation network of the mandible with a combination of multiple convolutional modules and edge supervision. Firstly, the squeeze-and-excitation residual module is used for feature optimization to make the network focused more on the mandibular segmentation region. Secondly, the multi atrous convolution cascade module is adapted to implement a multi-scale feature search to extract more detailed features. Considering that most mandibular segmentation networks ignore the boundary information, the loss function combining region loss and edge loss is applied to further improve the segmentation performance. The final experiment shows that the proposed network can segment Non-MTI and MTI quickly and automatically with an average segmentation time of 7.41s for a CT scan. In the meantime, it also has a good segmentation accuracy. For Non-MTI segmentation, the dice coefficient (Dice) reaches 97.98 ± 0.36%, average surface distance (ASD) reaches 0.061 ± 0.016 mm, and 95% Hausdorff distance (95HD) reaches 0.484 ± 0.027 mm. For Non-MTI segmentation, the Dice reaches 96.90 ± 1.59%, ASD reaches 0.162 ± 0.107 mm, and 95HD reaches 1.161 ± 1.034 mm. Compared with other methods, the proposed method has better segmentation performance, effectively improving segmentation accuracy and reducing under-segmentation. It can greatly improve doctor's segmentation efficiency and will have a promising application prospect in mandibular reconstruction surgery in the future.

Automatic mandible segmentation from CT image using 3D fully convolutional neural network based on DenseASPP and attention gates.

PURPOSE: In cranio-maxillofacial surgery, it is of great clinical significance to segment mandible accurately and automatically from CT images. However, the connected region and blurred boundary in teeth and condyles make the process challenging. At present, the mandible is commonly segmented by experienced doctors using manually or semi-automatic methods, which is time-consuming and has poor segmentation consistency. In addition, existing automatic segmentation methods still have problems such as region misjudgment, low accuracy, and time-consuming. METHODS: For these issues, an automatic mandibular segmentation method using 3d fully convolutional neural network based on densely connected atrous spatial pyramid pooling (DenseASPP) and attention gates (AG) was proposed in this paper. Firstly, the DenseASPP module was added to the network for extracting dense features at multiple scales. Thereafter, the AG module was applied in each skip connection to diminish irrelevant background information and make the network focus on segmentation regions. Finally, a loss function combining dice coefficient and focal loss was used to solve the imbalance among sample categories. RESULTS: Test results showed that the proposed network obtained a relatively good segmentation result, with a Dice score of 97.588 ± 0.425%, Intersection over Union of 95.293 ± 0.812%, sensitivity of 96.252 ± 1.106%, average surface distance of 0.065 ± 0.020 mm and 95% Hausdorff distance of 0.491 ± 0.021 mm in segmentation accuracy. The comparison with other segmentation networks showed that our network not only had a relatively high segmentation accuracy but also effectively reduced the network's misjudgment. Meantime, the surface distance error also showed that our segmentation results were relatively close to the ground truth. CONCLUSION: The proposed network has better segmentation performance and realizes accurate and automatic segmentation of the mandible. Furthermore, its segmentation time is 50.43 s for one CT scan, which greatly improves the doctor's work efficiency. It will have practical significance in cranio-maxillofacial surgery in the future.

The development of computer-aided patient-specific template design software for 3D printing in cranio-maxillofacial surgery.

BACKGROUND: The patient-specific templates for osteotomy often have complex surface features. Using current commercial software to design such templates is quite complicated, tedious and unrepeatable. AIMS: In this study, a novel surgical planning system for oral and maxillofacial surgery named EasyTemplate is developed, aiming to help doctors shorten the modelling time and assure the reliability in template design. MATERIALS & METHODS: In the simplified design process of an osteotomy guide, the main template can be formed efficiently using a surface offsetting algorithm, which is based on isosurface extraction and oriented bounding box. Thereafter, the cutting grooves can be generated automatically. RESULTS: A complicated surgical guide could be built accurately in about 10 min. Clinical orthognathic cases were conducted successfully using osteotomy and repositioning templates designed by EasyTemplate. DISCUSSION: Compared with commercially available softwares, higher efficiency and simpler design process were achieved, moreover, the time cost is one-third or even less. CONCLUSION: EasyTemplate can be a useful alternative to traditional softwares. This software allows the auto-generation algorithm which helps avoid a tedious modeling process while providing basic shapes for designers.