Optical flow estimation of coronary angiography sequences based on semi-supervised learning.

ABSTRACT

Optical flow is widely used in medical image processing, such as image registration, segmentation, 3D reconstruction, and temporal super-resolution. However, high-precision optical flow training datasets for medical images are challenging to produce. The current optical flow estimation models trained on these non-medical datasets, such as KITTI, Sintel, and FlyingChairs are unsuitable for medical images. In this work, we propose a semi-supervised learning mechanism to estimate the optical flow of coronary angiography. Our proposed method only needs the original medical images, segmentation results of regions of interest, and pre-trained models based on other optical flow datasets to train a new optical flow estimation model suitable for medical images. First, we use the coronary segmentation results to perform image enhancement processing on the coronary vascular region to improve the image contrast between the vascular region and the surrounding tissues. Then, we extract the high-precision optical flow of coronary arteries based on the coronary-enhanced images and the pre-trained optical flow estimation model. After estimating the optical flow, we take it and its corresponding original coronary angiography images as the training dataset to train the optical flow estimation network. Furthermore, we generate a large-scale synthetic Flying-artery dataset based on coronary artery segmentation results and original coronary angiography images, which is used to improve and evaluate the accuracy of optical flow estimation for coronary angiography. The experimental results on the coronary angiography datasets demonstrate that our proposed method can significantly improve the optical flow estimation accuracy of coronary angiography sequences compared with other methods.