Comparing regularized Kelvinlet functions and the finite element method for registration of medical images to sparse organ data.

Image-guided surgery collocates patient-specific data with the physical environment to facilitate surgical decision making. Unfortunately, these guidance systems commonly become compromised by intraoperative soft-tissue deformations. Nonrigid image-to-physical registration methods have been proposed to compensate for deformations, but clinical utility requires compatibility of these techniques with data sparsity and temporal constraints in the operating room. While finite element models can be effective in sparse data scenarios, computation time remains a limitation to widespread deployment. This paper proposes a registration algorithm that uses regularized Kelvinlets, which are analytical solutions to linear elasticity in an infinite domain, to overcome these barriers. This algorithm is demonstrated and compared to finite element-based registration on two datasets: a phantom liver deformation dataset and an in vivo breast deformation dataset. The regularized Kelvinlets algorithm resulted in a significant reduction in computation time compared to the finite element method. Accuracy as evaluated by target registration error was comparable between methods. Average target registration errors were 4.6 ± 1.0 and 3.2 ± 0.8 mm on the liver dataset and 5.4 ± 1.4 and 6.4 ± 1.5 mm on the breast dataset for the regularized Kelvinlets and finite element method, respectively. Limitations of regularized Kelvinlets include the lack of organ-specific geometry and the assumptions of linear elasticity and infinitesimal strain. Despite limitations, this work demonstrates the generalizability of regularized Kelvinlets registration on two soft-tissue elastic organs. This method may improve and accelerate registration for image-guided surgery, and it shows the potential of using regularized Kelvinlets on medical imaging data.

Comparison study of intraoperative surface acquisition methods on registration accuracy for soft-tissue surgical navigation.

Purpose: To study the difference between rigid registration and nonrigid registration using two forms of digitization (contact and noncontact) in human in vivo liver surgery. Approach: A Conoprobe device attachment and sterilization process was developed to enable prospective noncontact intraoperative acquisition of organ surface data in the operating room (OR). The noncontact Conoprobe digitization method was compared against stylus-based acquisition in the context of image-to-physical registration for image-guided surgical navigation. Data from n=10 patients undergoing liver resection were analyzed under an Institutional Review Board-approved study at Memorial Sloan Kettering Cancer Center. Organ surface coverage of each surface acquisition method was compared. Registration accuracies resulting from the acquisition techniques were compared for (1) rigid registration method (RRM), (2) model-based nonrigid registration method (NRM) using surface data only, and (3) NRM with one subsurface feature (vena cava) from tracked intraoperative ultrasound (NRM-VC). Novel vessel centerline and tumor targets were segmented and compared to their registered preoperative counterparts for accuracy validation. Results: Surface data coverage collected by stylus and Conoprobe were 24.6%±6.4% and 19.6%±5.0%, respectively. The average difference between stylus data and Conoprobe data using NRM was -1.05 mm and using NRM-VC was -1.42 mm, indicating the registrations to Conoprobe data performed worse than to stylus data with both NRM approaches. However, using the stylus and Conoprobe acquisition methods led to significant improvement of NRM-VC over RRM by average differences of 4.48 and 3.66 mm, respectively. Conclusion: The first use of a sterile-field amenable Conoprobe surface acquisition strategy in the OR is reported for open liver surgery. Under clinical conditions, the nonrigid registration significantly outperformed standard-of-care rigid registration, and acquisition by contact-based stylus and noncontact-based Conoprobe produced similar registration results. The accuracy benefits of noncontact surface acquisition with a Conoprobe are likely obscured by inferior data coverage and intrinsic noise within acquisition systems.

Simulation of Image-Guided Microwave Ablation Therapy Using a Digital Twin Computational Model.

Emerging computational tools such as healthcare digital twin modeling are enabling the creation of patient-specific surgical planning, including microwave ablation to treat primary and secondary liver cancers. Healthcare digital twins (DTs) are anatomically one-to-one biophysical models constructed from structural, functional, and biomarker-based imaging data to simulate patient-specific therapies and guide clinical decision-making. In microwave ablation (MWA), tissue-specific factors including tissue perfusion, hepatic steatosis, and fibrosis affect therapeutic extent, but current thermal dosing guidelines do not account for these parameters. This study establishes an MR imaging framework to construct three-dimensional biophysical digital twins to predict ablation delivery in livers with 5 levels of fat content in the presence of a tumor. Four microwave antenna placement strategies were considered, and simulated microwave ablations were then performed using 915 MHz and 2450 MHz antennae in Tumor Naïve DTs (control), and Tumor Informed DTs at five grades of steatosis. Across the range of fatty liver steatosis grades, fat content was found to significantly increase ablation volumes by approximately 29-l42% in the Tumor Naïve and 55-60% in the Tumor Informed DTs in 915 MHz and 2450 MHz antenna simulations. The presence of tumor did not significantly affect ablation volumes within the same steatosis grade in 915 MHz simulations, but did significantly increase ablation volumes within mild-, moderate-, and high-fat steatosis grades in 2450 MHz simulations. An analysis of signed distance to agreement for placement strategies suggests that accounting for patient-specific tumor tissue properties significantly impacts ablation forecasting for the preoperative evaluation of ablation zone coverage.

A Pilot Study on Patient-specific Computational Forecasting of Prostate Cancer Growth during Active Surveillance Using an Imaging-informed Biomechanistic Model.

Active surveillance (AS) is a suitable management option for newly diagnosed prostate cancer, which usually presents low to intermediate clinical risk. Patients enrolled in AS have their tumor monitored via longitudinal multiparametric MRI (mpMRI), PSA tests, and biopsies. Hence, treatment is prescribed when these tests identify progression to higher-risk prostate cancer. However, current AS protocols rely on detecting tumor progression through direct observation according to population-based monitoring strategies. This approach limits the design of patient-specific AS plans and may delay the detection of tumor progression. Here, we present a pilot study to address these issues by leveraging personalized computational predictions of prostate cancer growth. Our forecasts are obtained with a spatiotemporal biomechanistic model informed by patient-specific longitudinal mpMRI data (T2-weighted MRI and apparent diffusion coefficient maps from diffusion-weighted MRI). Our results show that our technology can represent and forecast the global tumor burden for individual patients, achieving concordance correlation coefficients from 0.93 to 0.99 across our cohort (n = 7). In addition, we identify a model-based biomarker of higher-risk prostate cancer: the mean proliferation activity of the tumor (P = 0.041). Using logistic regression, we construct a prostate cancer risk classifier based on this biomarker that achieves an area under the ROC curve of 0.83. We further show that coupling our tumor forecasts with this prostate cancer risk classifier enables the early identification of prostate cancer progression to higher-risk disease by more than 1 year. Thus, we posit that our predictive technology constitutes a promising clinical decision-making tool to design personalized AS plans for patients with prostate cancer. SIGNIFICANCE: Personalization of a biomechanistic model of prostate cancer with mpMRI data enables the prediction of tumor progression, thereby showing promise to guide clinical decision-making during AS for each individual patient.

Registration-based biomarkers for neoadjuvant treatment response of pancreatic cancer via longitudinal image registration.

Purpose: Pancreatic ductal adenocarcinoma (PDAC) frequently presents as hypo- or iso-dense masses with poor contrast delineation from surrounding parenchyma, which decreases reproducibility of manual dimensional measurements obtained during conventional radiographic assessment of treatment response. Longitudinal registration between pre- and post-treatment images may produce imaging biomarkers that more reliably quantify treatment response across serial imaging. Approach: Thirty patients who prospectively underwent a neoadjuvant chemotherapy regimen as part of a clinical trial were retrospectively analyzed in this study. Two image registration methods were applied to quantitatively assess longitudinal changes in tumor volume and tumor burden across the neoadjuvant treatment interval. Longitudinal registration errors of the pancreas were characterized, and registration-based treatment response measures were correlated to overall survival (OS) and recurrence-free survival (RFS) outcomes over 5-year follow-up. Corresponding biomarker assessments via manual tumor segmentation, the standardized response evaluation criteria in solid tumors (RECIST), and pathological examination of post-resection tissue samples were analyzed as clinical comparators. Results: Average target registration errors were 2.56±2.45 mm for a biomechanical image registration algorithm and 4.15±3.63 mm for a diffeomorphic intensity-based algorithm, corresponding to 1-2 times voxel resolution. Cox proportional hazards analysis showed that registration-derived changes in tumor burden were significant predictors of OS and RFS, while none of the alternative comparators, including manual tumor segmentation, RECIST, or pathological variables were associated with consequential hazard ratios. Additional ROC analysis at 1-, 2-, 3-, and 5-year follow-up revealed that registration-derived changes in tumor burden between pre- and post-treatment imaging were better long-term predictors for OS and RFS than the clinical comparators. Conclusions: Volumetric changes measured by longitudinal deformable image registration may yield imaging biomarkers to discriminate neoadjuvant treatment response in ill-defined tumors characteristic of PDAC. Registration-based biomarkers may help to overcome visual limits of radiographic evaluation to improve clinical outcome prediction and inform treatment selection.

Soft Tissue Monitoring of the Surgical Field: Detection and Tracking of Breast Surface Deformations.

OBJECTIVE: Deformable object tracking is common in the computer vision field, with applications typically focusing on nonrigid shape detection and usually not requiring specific three-dimensional point localization. In surgical guidance however, accurate navigation is intrinsically linked to precise correspondence of tissue structure. This work presents a contactless, automated fiducial acquisition method using stereo video of the operating field to provide reliable three-dimensional fiducial localization for an image guidance framework in breast conserving surgery. METHODS: On n = 8 breasts from healthy volunteers, the breast surface was measured throughout the full range of arm motion in a supine mock-surgical position. Using hand-drawn inked fiducials, adaptive thresholding, and KAZE feature matching, precise three-dimensional fiducial locations were detected and tracked through tool interference, partial and complete marker occlusions, significant displacements and nonrigid shape distortions. RESULTS: Compared to digitization with a conventional optically tracked stylus, fiducials were automatically localized with 1.6 ± 0.5 mm accuracy and the two measurement methods did not significantly differ. The algorithm provided an average false discovery rate <0.1% with all cases' rates below 0.2%. On average, 85.6 ± 5.9% of visible fiducials were automatically detected and tracked, and 99.1 ± 1.1% of frames provided only true positive fiducial measurements, which indicates the algorithm achieves a data stream that can be used for reliable on-line registration. CONCLUSIONS: Tracking is robust to occlusions, displacements, and most shape distortions. SIGNIFICANCE: This work-flow friendly data collection method provides highly accurate and precise three-dimensional surface data to drive an image guidance system for breast conserving surgery.

Incorporating heterogeneity and anisotropy for surgical applications in breast deformation modeling.

BACKGROUND: Simulating soft-tissue breast deformations is of interest for many applications including image fusion, longitudinal registration, and image-guided surgery. For the surgical use case, positional changes cause breast deformations that compromise the use of preoperative imaging to inform tumor excision. Even when acquiring imaging in the supine position, which better reflects surgical presentation, deformations still occur due to arm motion and orientation changes. A biomechanical modeling approach to simulate supine breast deformations for surgical applications must be both accurate and compatible with the clinical workflow. METHODS: A supine MR breast imaging dataset from n = 11 healthy volunteers was used to simulate surgical deformations by acquiring images in arm-down and arm-up positions. Three linear-elastic modeling approaches with varying levels of complexity were used to predict deformations caused by this arm motion: a homogeneous isotropic model, a heterogeneous isotropic model, and a heterogeneous anisotropic model using a transverse-isotropic constitutive model. FINDINGS: The average target registration errors for subsurface anatomical features were 5.4 ± 1.5 mm for the homogeneous isotropic model, 5.3 ± 1.5 mm for the heterogeneous isotropic model, and 4.7 ± 1.4 mm for the heterogeneous anisotropic model. A statistically significant improvement in target registration error was observed between the heterogeneous anisotropic model and both the homogeneous and the heterogeneous isotropic models (P < 0.01). INTERPRETATION: While a model that fully incorporates all constitutive complexities of anatomical structure likely achieves the best accuracy, a computationally tractable heterogeneous anisotropic model provided significant improvement and may be applicable for image-guided breast surgeries.

Supine magnetic resonance image registration for breast surgery: insights on material mechanics.

Purpose: Breast conserving surgery (BCS) is a common procedure for early-stage breast cancer patients. Supine preoperative magnetic resonance (MR) breast imaging for visualizing tumor location and extent, while not standard for procedural guidance, is being explored since it more closely represents the surgical presentation compared to conventional diagnostic imaging positions. Despite this preoperative imaging position, deformation is still present between the supine imaging and surgical state. As a result, a fast and accurate image-to-physical registration approach is needed to realize image-guided breast surgery. Approach: In this study, three registration methods were investigated on healthy volunteers' breasts ( n = 11 ) with the supine arm-down position simulating preoperative imaging and supine arm-up position simulating intraoperative presentation. The registration methods included (1) point-based rigid registration using synthetic fiducials, (2) nonrigid biomechanical model-based registration using sparse data, and (3) a data-dense three-dimensional diffeomorphic image-based registration from the Advanced Normalization Tools (ANTs) repository. Additionally, deformation metrics (volume change and anisotropy) were calculated from the ANTs deformation field to better understand breast material mechanics. Results: The average target registration errors (TRE) were 10.4 ± 2.3 , 6.4 ± 1.5 , and 2.8 ± 1.3 mm (mean ± standard deviation) and the average fiducial registration errors (FRE) were 7.8 ± 1.7 , 2.5 ± 1.1 , and 3.1 ± 1.1 mm for the point-based rigid, nonrigid biomechanical, and ANTs registrations, respectively. The mechanics-based deformation metrics revealed an overall anisotropic tissue behavior and a statistically significant difference in volume change between glandular and adipose tissue, suggesting that nonrigid modeling methods may be improved by incorporating material heterogeneity and anisotropy. Conclusions: Overall, registration accuracy significantly improved with increasingly flexible and data-dense registration methods. Analysis of these outcomes may inform the future development of image guidance systems for lumpectomy procedures.

Tumor deformation correction for an image guidance system in breast conserving surgery.

Breast cancer is the most common cancer in women, and surgical resection is standard of care for the majority of breast cancer patients. Unfortunately, current reoperation rates are 10-29%. Uncertainty in lesion localization is one of the main factors contributing to these high reoperation rates. This work uses the linearized iterative boundary reconstruction approach to model patient breast deformation due to abduction of the ipsilateral arm. A preoperative supine magnetic resonance (MR) image was obtained with the patient's arms down near the torso. A mock intraoperative breast shape was measured from a supine MR image obtained with the patient's arm up near the head. Sparse data was subsampled from the full volumetric image to represent realistic intraoperative data collection: surface fiducial points, the intra-fiducial skin surface, and the chest wall as measured with 7 tracked ultrasound images. The deformed preoperative arm-down data was compared to the ground truth arm-up data. From rigid registration to model correction the tumor centroid distance improves from 7.3 mm to 3.3 mm, average surface fiducial error across 9 synthetic fiducials and the nipple improves from 7.4 ± 2.2 to 1.3 ± 0.7, and average subsurface error across 14 corresponding features improves from 6.2 ± 1.4 mm to 3.5 ± 1.1 mm. Using preoperative supine MR imaging and sparse data in the deformed position, this modeling framework can correct for breast shape changes between imaging and surgery to more accurately predict intraoperative position of the tumor as well as 10 surface fiducials and 14 subsurface features.

Breast image registration for surgery: Insights on material mechanics modeling.

Breast conserving surgery (BCS) is a common procedure for early-stage breast cancer patients. Supine preoperative magnetic resonance (MR) breast imaging for visualizing tumor location and extent, while not standard for procedural guidance, more closely represents the surgical presentation compared to conventional diagnostic pendant positioning. Optimal utilization for surgical guidance, however, requires a fast and accurate image-to-physical registration from preoperative imaging to intraoperative surgical presentation. In this study, three registration methods were investigated on healthy volunteers' breasts (n=11) with the arm-down position simulating preoperative imaging and arm-up position simulating intraoperative data. The registration methods included: (1) point-based rigid registration using synthetic fiducials, (2) non-rigid biomechanical model-based registration using sparse data, and (3) a data-dense 3D diffeomorphic image-based registration from the Advanced Normalization Tools (ANTs) repository. The average target registration errors (TRE) were 10.4 ± 2.3, 6.4 ± 1.5, and 2.8 ± 1.3 mm (mean ± standard deviation) and the average fiducial registration errors (FRE) were 7.8 ± 1.7, 2.5 ± 1.1, and 3.1 ± 1.1 mm (mean ± standard deviation) for the point-based rigid, nonrigid biomechanical, and ANTs registrations, respectively. Additionally, common mechanics-based deformation metrics (volume change and anisotropy) were calculated from the ANTs deformation field. The average metrics revealed anisotropic tissue behavior and a statistical difference in volume change between glandular and adipose tissue, suggesting that nonrigid modeling methods may be improved by incorporating material heterogeneity and anisotropy. Overall, registration accuracy significantly improved with increasingly flexible registration methods, which may inform future development of image guidance systems for lumpectomy procedures.

Computational Imaging to Compensate for Soft-Tissue Deformations in Image-Guided Breast Conserving Surgery.

OBJECTIVE: During breast conserving surgery (BCS), magnetic resonance (MR) images aligned to accurately display intraoperative lesion locations can offer improved understanding of tumor extent and position relative to breast anatomy. Unfortunately, even under consistent supine conditions, soft tissue deformation compromises image-to-physical alignment and results in positional errors. METHODS: A finite element inverse modeling technique has been developed to nonrigidly register preoperative supine MR imaging data to the surgical scene for improved localization accuracy during surgery. Registration is driven using sparse data compatible with acquisition during BCS, including corresponding surface fiducials, sparse chest wall contours, and the intra-fiducial skin surface. Deformation predictions were evaluated at surface fiducial locations and subsurface tissue features that were expertly identified and tracked. Among n = 7 different human subjects, an average of 22 ± 3 distributed subsurface targets were analyzed in each breast volume. RESULTS: The average target registration error (TRE) decreased significantly when comparing rigid registration to this nonrigid approach (10.4 ± 2.3 mm vs 6.3 ± 1.4 mm TRE, respectively). When including a single subsurface feature as additional input data, the TRE significantly improved further (4.2 ± 1.0 mm TRE), and in a region of interest within 15 mm of a mock biopsy clip TRE was 3.9 ± 0.9 mm. CONCLUSION: These results demonstrate accurate breast deformation estimates based on sparse-data-driven model predictions. SIGNIFICANCE: The data suggest that a computational imaging approach can account for image-to-surgery shape changes to enhance surgical guidance during BCS.

Impact of deformation on a supine-positioned image-guided breast surgery approach.

PURPOSE: To reduce reoperation rates for image-guided breast-conserving surgery, the enhanced sensitivity of magnetic resonance (MR) supine imaging may be leveraged. However, accurate tissue correspondence between images and their physical counterpart in the surgical presentation is challenging due to breast deformations (e.g., from patient/arm position changes, and operating room table rotation differences). In this study, standard rigid registration methods are employed and tissue deformation is characterized. METHODS: On n = 10 healthy breasts, surface displacements were measured by comparing intraoperative fiducial locations as the arm was moved from conventional MR scanning positions (arm-down and arm-up) to the laterally extended surgical configuration. Supine MR images in the arm-down and arm-up positions were registered to mock intraoperative presentations. RESULTS: Breast displacements from a supine MR imaging configuration to a mock surgical presentation were 28.9 ± 9.2 mm with shifts occurring primarily in the inferior/superior direction. With respect to supine MR to surgical alignment, the average fiducial, target, and maximum target registration errors were 9.0 ± 1.7 mm, 9.3 ± 1.7 mm, and 20.0 ± 7.6 mm, respectively. Even when maintaining similar arm positions in the MR image and mock surgery, the respective averages were 6.0 ± 1.0 mm, 6.5 ± 1.1 mm, and 12.5 ± 2.8 mm. CONCLUSION: From supine MR positioning to surgical presentation, the breast undergoes large displacements (9.9-70.1 mm). The data also suggest that significant nonrigid deformations (9.3 ± 1.7 mm with 20.0 mm average maximum) exist that need to be considered in image guidance and modeling applications.

Clinical assessment of a biophysical model for distinguishing tumor progression from radiation necrosis.

PURPOSE: The efficacy of an imaging-driven mechanistic biophysical model of tumor growth for distinguishing radiation necrosis from tumor progression in patients with enhancing lesions following stereotactic radiosurgery (SRS) for brain metastasis is validated. METHODS: We retrospectively assessed the model using 73 patients with 78 lesions and histologically confirmed radiation necrosis or tumor progression. Postcontrast T1-weighted MRI images were used to extract parameters for a mechanistic reaction-diffusion logistic growth model mechanically coupled to the surrounding tissue. The resulting model was then used to estimate mechanical stress fields, which were then compared with edema visualized on FLAIR imaging using DICE similarity coefficients. DICE, model, and standard radiographic morphometric analysis parameters were evaluated using a receiver operating characteristic (ROC) curve for prediction of radiation necrosis or tumor progression. Multivariate logistic regression models were then constructed using mechanistic model parameters or advanced radiomic features. An independent validation was performed to evaluate predictive performance. RESULTS: Tumor cell proliferation rate resulted in ROC AUC = 0.86, 95% CI: 0.76-0.95, P < 0.0001, 74% sensitivity and 95% specificity) and DICE similarity coefficient associated with high stresses demonstrated an ROC AUC = 0.93, 95% CI: 0.86-0.99, P < 0.0001, 81% sensitivity and 95% specificity. In a multivariate logistic regression model using an independent validation dataset, mechanistic modeling parameters had an ROC AUC of 0.95, with 94% sensitivity and 96% specificity. CONCLUSIONS: Imaging-driven biophysical modeling of tumor growth represents a novel method for accurately predicting clinically significant tumor behavior.

Impact of brain shift on neural pathways in deep brain stimulation: a preliminary analysis via multi-physics finite element models.

Objective.The effectiveness of deep brain stimulation (DBS) depends on electrode placement accuracy, which can be compromised by brain shift during surgery. While there have been efforts in assessing the impact of electrode misplacement due to brain shift using preop- and postop-imaging data, such analysis using preop- and intraop-imaging data via biophysical modeling has not been conducted. This work presents a preliminary study that applies a multi-physics analysis framework using finite element biomechanical and bioelectric models to examine the impact of realistic intraoperative shift on neural pathways determined by tractography.Approach.The study examined six patients who had undergone interventional magnetic resonance-guided DBS surgery. The modeling framework utilized a biomechanical approach to update preoperative MR to reflect shift-induced anatomical changes. Using this anatomically deformed image and its undeformed counterpart, bioelectric effects from shifting electrode leads could be simulated and neural activation differences were approximated. Specifically, for each configuration, volume of tissue activation was computed and subsequently used for tractography estimation. Total tract volume and overlapping volume with motor regions as well as connectivity profile were compared. In addition, volumetric overlap between different fiber bundles among configurations was computed and correlated to estimated shift.Main results.The study found deformation-induced differences in tract volume, motor region overlap, and connectivity behavior, suggesting the impact of shift. There is a strong correlation (R= -0.83) between shift from intended target and intended neural pathway recruitment, where at threshold of ∼2.94 mm, intended recruitment completely degrades. The determined threshold is consistent with and provides quantitative support to prior observations and literature that deviations of 2-3 mm are detrimental.Significance.The findings support and advance prior studies and understanding to illustrate the need to account for shift in DBS and the potentiality of computational modeling for estimating influence of shift on neural activation.

A hybrid, image-based and biomechanics-based registration approach to markerless intraoperative nodule localization during video-assisted thoracoscopic surgery.

The resection of small, low-dense or deep lung nodules during video-assisted thoracoscopic surgery (VATS) is surgically challenging. Nodule localization methods in clinical practice typically rely on the preoperative placement of markers, which may lead to clinical complications. We propose a markerless lung nodule localization framework for VATS based on a hybrid method combining intraoperative cone-beam CT (CBCT) imaging, free-form deformation image registration, and a poroelastic lung model with allowance for air evacuation. The difficult problem of estimating intraoperative lung deformations is decomposed into two more tractable sub-problems: (i) estimating the deformation due the change of patient pose from preoperative CT (supine) to intraoperative CBCT (lateral decubitus); and (ii) estimating the pneumothorax deformation, i.e. a collapse of the lung within the thoracic cage. We were able to demonstrate the feasibility of our localization framework with a retrospective validation study on 5 VATS clinical cases. Average initial errors in the range of 22 to 38 mm were reduced to the range of 4 to 14 mm, corresponding to an error correction in the range of 63 to 85%. To our knowledge, this is the first markerless lung deformation compensation method dedicated to VATS and validated on actual clinical data.

A Novel Clinically Immersive Pre-doctoral Training Program for Engineering in Surgery and Intervention: Initial Realization and Preliminary Results.

A novel pre-doctoral program is presented that combines (1) immersive observation in the surgical/interventional theatre and (2) thought-provoking exposition activities focused on answering clinically provocative questions. While the long-term goal is to train engineers to conduct clinical translational research in human systems, in this paper, perceived trainee improvements are assessed in: (1) their ability to pose important questions in surgery and intervention, (2) their knowledge of surgical technologies, and (3) their understanding of procedural medicine. The program combines constructivist and constructionist learning approaches through a dual-course suite consisting of: (1) a scaffold lecture design with ten physicians presenting their procedural specialties interleaved with lectures relating engineering principles, and (2) a second course with clinically mentored immersion experiences in the operating room/interventional suite, clinical conferences, and patient rounds. Details of the complementing technical core and learning environment are also provided. Preliminary data reports on the quantitative experiential clinical involvement and on a self-reported survey over 5 cohorts of trainees (n = 18). With respect to immersion, the average surgeries/interventions observed, number of different types, and clinical contact time per student was on average 15.6 ± 7.9 surgeries/interventions, 8.2 ± 3.6 types, and 48.2 ± 14.7 contact hours, respectively. With respect to trainee understanding of procedural medicine, surgical technologies, and value of clinical observation, an average perceived improvement of 41%, 38%, and 41% over the course series was detected, respectively (p < 0.001). Equally impressive, when rating ability to pose important questions affecting human health, an average perceived improvement of 34% was detected (p < 0.001). The preliminary realization of a novel pre-doctoral clinically immersive training program for engineering trainees is described and demonstrates extensive levels of clinical contact and strong evidence that the provided immersion experiences result in significant improvements in understanding of procedural medicine.

Fat Quantification Imaging and Biophysical Modeling for Patient-Specific Forecasting of Microwave Ablation Therapy.

Computational tools are beginning to enable patient-specific surgical planning to localize and prescribe thermal dosing for liver cancer ablation therapy. Tissue-specific factors (e.g., tissue perfusion, material properties, disease state, etc.) have been found to affect ablative therapies, but current thermal dosing guidance practices do not account for these differences. Computational modeling of ablation procedures can integrate these sources of patient specificity to guide therapy planning and delivery. This paper establishes an imaging-data-driven framework for patient-specific biophysical modeling to predict ablation extents in livers with varying fat content in the context of microwave ablation (MWA) therapy. Patient anatomic scans were segmented to develop customized three-dimensional computational biophysical models and mDIXON fat-quantification images were acquired and analyzed to establish fat content and determine biophysical properties. Simulated patient-specific microwave ablations of tumor and healthy tissue were performed at four levels of fatty liver disease. Ablation models with greater fat content demonstrated significantly larger treatment volumes compared to livers with less severe disease states. More specifically, the results indicated an eightfold larger difference in necrotic volumes with fatty livers vs. the effects from the presence of more conductive tumor tissue. Additionally, the evolution of necrotic volume formation as a function of the thermal dose was influenced by the presence of a tumor. Fat quantification imaging showed multi-valued spatially heterogeneous distributions of fat deposition, even within their respective disease classifications (e.g., low, mild, moderate, high-fat). Altogether, the results suggest that clinical fatty liver disease levels can affect MWA, and that fat-quantitative imaging data may improve patient specificity for this treatment modality.

Accounting for intraoperative brain shift ascribable to cavity collapse during intracranial tumor resection.

Purpose: For many patients with intracranial tumors, accurate surgical resection is a mainstay of their treatment paradigm. During surgical resection, image guidance is used to aid in localization and resection. Intraoperative brain shift can invalidate these guidance systems. One cause of intraoperative brain shift is cavity collapse due to tumor resection, which will be referred to as "debulking." We developed an imaging-driven finite element model of debulking to create a comprehensive simulation data set to reflect possible intraoperative changes. The objective was to create a method to account for brain shift due to debulking for applications in image-guided neurosurgery. We hypothesized that accounting for tumor debulking in a deformation atlas data framework would improve brain shift predictions, which would enhance image-based surgical guidance. Approach: This was evaluated in a six-patient intracranial tumor resection intraoperative data set. The brain shift deformation atlas data framework consisted of n = 756 simulated deformations to account for effects due to gravity-induced and hyperosmotic drug-induced brain shift, which reflects previous developments. An additional complement of n = 84 deformations involving simulated tumor growth followed by debulking was created to capture observed intraoperative effects not previously included. Results: In five of six patient cases evaluated, inclusion of debulking mechanics improved brain shift correction by capturing global mass effects resulting from the resected tumor. Conclusions: These findings suggest imaging-driven brain shift models used to create a deformation simulation data framework of observed intraoperative events can be used to assist in more accurate image-guided surgical navigation in the brain.

Accounting for Deformation in Deep Brain Stimulation Surgery With Models: Comparison to Interventional Magnetic Resonance Imaging.

The efficacy of deep brain stimulation (DBS) depends on electrode placement accuracy, which can be jeopardized by brain shift due to burr hole and dura opening during surgery. Brain shift violates assumed rigid alignment between preoperative image and intraoperative anatomy, negatively impacting therapy. OBJECTIVE: This study presents a deformation-atlas biomechanical model-based approach to address shift. METHODS: Six patients, who underwent interventional magnetic resonance (iMR) image-guided DBS burr hole surgery, were studied. A patient-specific model was employed under varying surgical conditions, generating a collection of possible intraoperative shift estimations or a 'deformation atlas.' An inverse problem was driven by sparse measurements derived from iMR to determine an optimal fit of solutions of the atlas. This fit was then used to obtain a volumetric deformation field, which was utilized to update preoperative MR and estimate shift at surgical target region localized on iMR. Model performance was examined by quantitatively comparing intraoperative subsurface measurements to their model-predicted counterparts, and qualitatively comparing iMR, preoperative MR, and model updated MR. A nonrigid image registration was introduced as a comparator. RESULTS: Model-based approach reduced general parenchyma shift from 8.2 ± 2.2 to 2.7 ± 1.1 mm (∼66.8% correction), and produced updated MR with better agreement to iMR than that of preoperative MR. The average model estimated shift at target region was 1.2 mm. CONCLUSIONS: This study demonstrates the feasibility of a model-based shift correction strategy in DBS surgery with only sparse data. SIGNIFICANCE: The developed strategy has the potential to complement and/or enhance current clinical approaches in addressing shift.

Intraoperative Correction of Liver Deformation Using Sparse Surface and Vascular Features via Linearized Iterative Boundary Reconstruction.

During image guided liver surgery, soft tissue deformation can cause considerable error when attempting to achieve accurate localization of the surgical anatomy through image-to-physical registration. In this paper, a linearized iterative boundary reconstruction technique is proposed to account for these deformations. The approach leverages a superposed formulation of boundary conditions to rapidly and accurately estimate the deformation applied to a preoperative model of the organ given sparse intraoperative data of surface and subsurface features. With this method, tracked intraoperative ultrasound (iUS) is investigated as a potential data source for augmenting registration accuracy beyond the capacity of conventional organ surface registration. In an expansive simulated dataset, features including vessel contours, vessel centerlines, and the posterior liver surface are extracted from iUS planes. Registration accuracy is compared across increasing data density to establish how iUS can be best employed to improve target registration error (TRE). From a baseline average TRE of 11.4 ± 2.2 mm using sparse surface data only, incorporating additional sparse features from three iUS planes improved average TRE to 6.4 ± 1.0 mm. Furthermore, increasing the sparse coverage to 16 tracked iUS planes improved average TRE to 3.9 ± 0.7 mm, exceeding the accuracy of registration based on complete surface data available with more cumbersome intraoperative CT without contrast. Additionally, the approach was applied to three clinical cases where on average error improved 67% over rigid registration and 56% over deformable surface registration when incorporating additional features from one independent tracked iUS plane.