Real-time segmentation and tracking of excised corneal contour by deep neural networks for DALK surgical navigation.
Comput Methods Programs Biomed
; 197: 105679, 2020 Dec.
Article
en En
| MEDLINE
| ID: mdl-32814253
ABSTRACT
OBJECTIVE:
Corneal disease is one of the main causes of blindness for humans globally nowadays, and deep anterior lamellar keratoplasty (DALK) is a widely applied technique for corneal transplantation. However, the position of stitch points highly influences the success rate of such surgery, which would require accurate control and manipulation of surgical instruments.METHODS:
In this paper, we present a deep learning framework for augmented reality (AR) based surgery navigation to guide the suturing in DALK. It can robustly track the excised corneal contour by semantic segmentation and the reconstruction of occlusion. We propose a novel optical flow inpainting network to recover the missing motion caused by occlusion. The occluded regions are detected by weakly supervised segmentation of surgical instruments and reconstructed by key frame warping along the completed optical flow. Then we introduce two types of loss function to adapt the inpainting network in the optical flow space.RESULTS:
Our techniques are tested and evaluated by a number of real surgery videos from Shandong Eye Hospital in China. We compare our approaches with other typical methods in the corneal contour segmentation, optical flow inpainting and occlusion regions reconstruction. The tracking accuracy reachs 99.2% in average and PSNR reaches 25.52 for the reconstruction of the occluded frames.CONCLUSION:
From the experimental evaluations and user study, both the qualitative and quantitative results indicate that our techniques can achieve accurate detection and tracking of corneal contour under complex disturbance in real-time surgical scenes. Our prototype AR navigation system would be highly useful in clinical practice.Palabras clave
Texto completo:
1
Colección:
01-internacional
Base de datos:
MEDLINE
Asunto principal:
Trasplante de Córnea
/
Córnea
/
Cirugía Asistida por Computador
Tipo de estudio:
Qualitative_research
Límite:
Humans
País/Región como asunto:
Asia
Idioma:
En
Revista:
Comput Methods Programs Biomed
Asunto de la revista:
INFORMATICA MEDICA
Año:
2020
Tipo del documento:
Article