Use of semi-synthetic data for catheter segmentation improvement.

In the era of data-driven machine learning algorithms, data is the new oil. For the most optimal results, datasets should be large, heterogeneous and, crucially, correctly labeled. However, data collection and labeling are time-consuming and labor-intensive processes. In the field of medical device segmentation, present during minimally invasive surgery, this leads to a lack of informative data. Motivated by this drawback, we developed an algorithm generating semi-synthetic images based on real ones. The concept of this algorithm is to place a randomly shaped catheter in an empty heart cavity, where the shape of the catheter is generated by forward kinematics of continuum robots. Having implemented the proposed algorithm, we generated new images of heart cavities with various artificial catheters. We compared the results of deep neural networks trained purely on real datasets with respect to networks trained on both real and semi-synthetic datasets, highlighting that semi-synthetic data improves catheter segmentation accuracy. A modified U-Net trained on combined datasets performed the segmentation with a Dice similarity coefficient of 92.6 ± 2.2%, while the same model trained only on real images achieved a Dice similarity coefficient of 86.5 ± 3.6%. Therefore, using semi-synthetic data allows for the decrease of accuracy spread, improves model generalization, reduces subjectivity, shortens the labeling routine, increases the number of samples, and improves the heterogeneity.

Efficient workflow for automatic segmentation of the right heart based on 2D echocardiography.

The present study aimed to present a workflow algorithm for automatic processing of 2D echocardiography images. The workflow was based on several sequential steps. For each step, we compared different approaches. Epicardial 2D echocardiography datasets were acquired during various open-chest beating-heart surgical procedures in three porcine hearts. We proposed a metric called the global index that is a weighted average of several accuracy coefficients, indices and the mean processing time. This metric allows the estimation of the speed and accuracy for processing each image. The global index ranges from 0 to 1, which facilitates comparison between different approaches. The second step involved comparison among filtering, sharpening and segmentation techniques. During the noise reduction step, we compared the median filter, total variation filter, bilateral filter, curvature flow filter, non-local means filter and mean shift filter. To clarify the endocardium borders of the right heart, we used the linear sharpen. Lastly, we applied watershed segmentation, clusterisation, region-growing, morphological segmentation, image foresting segmentation and isoline delineation. We assessed all the techniques and identified the most appropriate workflow for echocardiography image segmentation of the right heart. For successful processing and segmentation of echocardiography images with minimal error, we found that the workflow should include the total variation filter/bilateral filter, linear sharpen technique, isoline delineation/region-growing segmentation and morphological post-processing. We presented an efficient and accurate workflow for the precise diagnosis of cardiovascular diseases. We introduced the global index metric for image pre-processing and segmentation estimation.