Best practice considerations on the assessment of robotic assisted surgical systems: results from an international consensus expert panel.

BACKGROUND: Health technology assessments (HTAs) of robotic assisted surgery (RAS) face several challenges in assessing the value of robotic surgical platforms. As a result of using different assessment methods, previous HTAs have reached different conclusions when evaluating RAS. While the number of available systems and surgical procedures is rapidly growing, existing frameworks for assessing MedTech provide a starting point, but specific considerations are needed for HTAs of RAS to ensure consistent results. This work aimed to discuss different approaches and produce guidance on evaluating RAS. METHODS: A consensus conference research methodology was adopted. A panel of 14 experts was assembled with international experience and representing relevant stakeholders: clinicians, health economists, HTA practitioners, policy makers, and industry. A review of previous HTAs was performed and seven key themes were extracted from the literature for consideration. Over five meetings, the panel discussed the key themes and formulated consensus statements. RESULTS: A total of ninety-eight previous HTAs were identified from twenty-five total countries. The seven key themes were evidence inclusion and exclusion, patient- and clinician-reported outcomes, the learning curve, allocation of costs, appropriate time horizons, economic analysis methods, and robotic ecosystem/wider benefits. CONCLUSIONS: Robotic surgical platforms are tools, not therapies. Their value varies according to context and should be considered across therapeutic areas and stakeholders. The principles set out in this paper should help HTA bodies at all levels to evaluate RAS. This work may serve as a case study for rapidly developing areas in MedTech that require particular consideration for HTAs.

Recommendations for the development and use of imaging test sets to investigate the test performance of artificial intelligence in health screening.

Rigorous evaluation of artificial intelligence (AI) systems for image classification is essential before deployment into health-care settings, such as screening programmes, so that adoption is effective and safe. A key step in the evaluation process is the external validation of diagnostic performance using a test set of images. We conducted a rapid literature review on methods to develop test sets, published from 2012 to 2020, in English. Using thematic analysis, we mapped themes and coded the principles using the Population, Intervention, and Comparator or Reference standard, Outcome, and Study design framework. A group of screening and AI experts assessed the evidence-based principles for completeness and provided further considerations. From the final 15 principles recommended here, five affect population, one intervention, two comparator, one reference standard, and one both reference standard and comparator. Finally, four are appliable to outcome and one to study design. Principles from the literature were useful to address biases from AI; however, they did not account for screening specific biases, which we now incorporate. The principles set out here should be used to support the development and use of test sets for studies that assess the accuracy of AI within screening programmes, to ensure they are fit for purpose and minimise bias.

Stereotactic ablative body radiotherapy in patients with oligometastatic cancers: a prospective, registry-based, single-arm, observational, evaluation study.

BACKGROUND: Stereotactic ablative body radiotherapy (SABR) is increasingly being used to treat oligometastatic cancers, but high-level evidence to provide a basis for policy making is scarce. Additional evidence from a real-world setting is required. We present the results of a national study of patients with extracranial oligometastases undergoing SABR, representing the largest dataset, to our knowledge, on outcomes in this population so far. METHODS: In 2015, National Health Service (NHS) England launched a Commissioning through Evaluation scheme that funded a prospective, registry-based, single-arm, observational, evaluation study of patients with solid cancer and extracranial oligometastases treated with SABR. Prescribed doses ranged from 24-60 Gy administered in three to eight fractions. The study was done at 17 NHS radiotherapy centres in England. Patients were eligible for the scheme if aged 18 years or older with confirmed primary carcinoma (excluding haematological malignancies), one to three extracranial metastatic lesions, a disease-free interval from primary tumour development to metastases of longer than 6 months (with the exception of synchronous colorectal liver metastases), a WHO performance status of 2 or lower, and a life expectancy of at least 6 months. The primary outcome was overall survival at 1 year and 2 years from the start of SABR treatment. The study is now completed. FINDINGS: Between June 15, 2015, and Jan 30, 2019, 1422 patients were recruited from 17 hospitals in England. The median age of the patients was 69 years (IQR 62-76), and the most common primary tumour was prostate cancer (406 [28·6%] patients). Median follow-up was 13 months (IQR 6-23). Overall survival was 92·3% (95% CI 90·5-93·9) at 1 year and 79·2% (76·0-82·1) at 2 years. The most common grade 3 adverse event was fatigue (28 [2·0%] of 1422 patients) and the most common serious (grade 4) event was increased liver enzymes (nine [0·6%]). Notreatment-related deaths were reported. INTERPRETATION: In patients with extracranial oligometastatic cancer, use of SABR was associated with high overall survival and low toxicity. 'The study findings complement existing evidence from a randomised, phase 2 trial, and represent high-level, real-world evidence supporting the use of SABR in this patient cohort, with a phase 3 randomised, controlled trial to confirm these findings underway. Based on the selection criteria in this study, SABR was commissioned by NHS England in March, 2020, as a treatment option for patients with oligometastatic disease. FUNDING: NHS England Commissioning through Evaluation scheme.

Evaluating the Diagnostic Accuracy of Reflectance Confocal Microscopy to Diagnose Skin Cancer: Protocol for a Prospective, Multicenter Study.

BACKGROUND: In the United Kingdom, 350,000 patients per year are referred to hospital clinics with suspicious moles, and approximately half undergo a biopsy to identify the 5%-10% who require further treatment. If cancer cannot be ruled out clinically and on the basis of biopsy results, the lesion is surgically removed. One type of precancerous mole, called lentigo maligna, is particularly challenging to delineate and treat. Reflectance confocal microscopy (VivaScope, Caliber Imaging & Diagnostics) is an imaging technique that can supplement dermoscopy in identifying whether a clinically suspicious mole is malignant and can better assess lentigo maligna margins for excision. It allows clinicians to visualize the skin lesion to a depth of 200 microns with subcellular resolution, described as quasi-histological, and therefore better guide more accurate diagnoses. OBJECTIVE: The aim of this paper is to describe a prospective, single blinded, multicenter study to examine patients with clinically suspicious moles or lentigo maligna to determine whether confocal microscopy can both reduce the number of unnecessary biopsies of moles and more accurately guide the surgical excision margins of lentigo maligna. METHODS: This study will prospectively recruit adults into the following two cohorts: diagnostic accuracy and margin delineation. The diagnostic accuracy cohort will assess people with clinically suspicious lesions suspected of being diagnosed with melanoma and having an equivocal finding on dermoscopy or persistent clinical suspicion despite normal dermoscopy. Diagnostic accuracy will include the sensitivity and specificity of VivaScope in comparison with the histological diagnosis as the gold standard for patients. The margin delineation cohort will assess the ability of VivaScope to accurately delineate the margins of lentigo maligna compared with that of dermoscopy alone using margins taken during Mohs micrographic surgery as the gold standard. The primary study outcomes will be the diagnostic accuracy of VivaScope for the first cohort of patients and margin agreement between VivaScope and the final pathology report for the second cohort of patients. RESULTS: Funding for this proposed research is being secured. CONCLUSIONS: The outcomes of the proposed study will indicate how many biopsies of nonmelanoma lesions, which are potentially unnecessary, could be prevented. This would reduce patient anxiety and cost to the National Health Service (NHS) in the United Kingdom. Improved margin delineation of lentigo maligna could also improve the surgical clearance rates and decrease overall cost. The results would demonstrate whether the adoption of VivaScope would potentially benefit patients and the NHS. REGISTERED REPORT IDENTIFIER: RR1-10.2196/9296.

Identification of catheter misplacement in early port CVC dysfunction.

The use of port central venous catheters (CVCs) for chemotherapeutical use has seen exponential growth over the last decades. However, port CVC misplacement may lead to catheter malfunction (such as partial or total catheter blockade), which might be complicated by thrombosis and catheter superinfections, and these in turn may lead to pulmonary embolism and bloodstream infections. The overall occurrence of port CVC misplacement is up to 6%; nonetheless, port CVC misplacement may occur in up to 67% of patients with early CVC dysfunction (occurring within three months of catheter insertion). Thereafter, the prompt evaluation of catheter position among patients with first-trimester CVC dysfunction is extremely important. The aim of the present manuscript is to support medical oncologists, haematologists, and clinicians in timely suspicion and recognition of port CVC misplacement among patients with early CVC dysfunction. Radiological educational iconographic materials that will assist a prompt estimate of port-CVC dislocation are provided.

Virtual Touch™ Quantification to Diagnose and Monitor Liver Fibrosis in Hepatitis B and Hepatitis C: A NICE Medical Technology Guidance.

Virtual Touch™ Quantification (VTq) is a software application used with Siemens Acuson ultrasound scanners to assess the stiffness of liver tissue. The National Institute for Health and Care Excellence (NICE) Medical Technologies Advisory Committee (MTAC) selected VTq for evaluation and invited the company to submit clinical and economic evidence. King's Technology Evaluation Centre, an External Assessment Centre (EAC) commissioned by NICE, independently assessed the evidence submitted. The EAC conducted its own systematic review, meta-analysis and economic analysis to supplement the company's submitted evidence. The meta-analyses comparing VTq and transient elastography (TE) with liver biopsy (LB) provided pooled estimates of liver stiffness and stage of fibrosis for the study populations (hepatitis B, hepatitis C or combined populations). When comparing significant fibrosis (Metavir score F ≥ 2) for both hepatitis B and C, VTq had slightly higher values for both sensitivity and specificity (77 and 81 %) than TE (76 and 71 %). The overall prevalence of cirrhosis (F4, combined populations) was similar with VTq and TE (23 vs. 23 %), and significant fibrosis (F ≥ 2) was lower for VTq than for TE (55 vs. 62 %). The EAC revised the company's de novo cost model, which resulted in a cost saving of £53 (against TE) and £434 (against LB). Following public consultation, taking into account submitted comments, NICE Medical Technology Guidance MTG27 was published in September 2015. This recommended the adoption of the VTq software to diagnose and monitor liver fibrosis in patients with hepatitis B or hepatitis C.

A method for accurate spatial registration of PET images and histopathology slices.

BACKGROUND: Accurate alignment between histopathology slices and positron emission tomography (PET) images is important for radiopharmaceutical validation studies. Limited data is available on the registration accuracy that can be achieved between PET and histopathology slices acquired under routine pathology conditions where slices may be non-parallel, non-contiguously cut and of standard block size. The purpose of this study was to demonstrate a method for aligning PET images and histopathology slices acquired from patients with laryngeal cancer and to assess the registration accuracy obtained under these conditions. METHODS: Six subjects with laryngeal cancer underwent a (64)Cu-copper-II-diacetyl-bis(N4-methylthiosemicarbazone) ((64)Cu-ATSM) PET computed tomography (CT) scan prior to total laryngectomy. Sea urchin spines were inserted into the pathology specimen to act as fiducial markers. The specimen was fixed in formalin, as per standard histopathology operating procedures, and was then CT scanned and cut into millimetre-thick tissue slices. A subset of the tissue slices that included both tumour and fiducial markers was taken and embedded in paraffin blocks. Subsequently, microtome sectioning and haematoxylin and eosin staining were performed to produce 5-µm-thick tissue sections for microscopic digitisation. A series of rigid registration procedures was performed between the different imaging modalities (PET; in vivo CT-i.e. the CT component of the PET-CT; ex vivo CT; histology slices) with the ex vivo CT serving as the reference image. In vivo and ex vivo CTs were registered using landmark-based registration. Histopathology and ex vivo CT images were aligned using the sea urchin spines with additional anatomical landmarks where available. Registration errors were estimated using a leave-one-out strategy for in vivo to ex vivo CT and were estimated from the RMS landmark accuracy for histopathology to ex vivo CT. RESULTS: The mean ± SD accuracy for registration of the in vivo to ex vivo CT images was 2.66 ± 0.66 mm, and the accuracy for registration of histopathology to ex vivo CT was 0.86 ± 0.41 mm. Estimating the PET to in vivo CT registration accuracy to equal the PET-CT alignment accuracy of 1 mm resulted in an overall average registration error between PET and histopathology slices of 3.0 ± 0.7 mm. CONCLUSIONS: We have developed a registration method to align PET images and histopathology slices with an accuracy comparable to the spatial resolution of the PET images.

False Discovery Rates in PET and CT Studies with Texture Features: A Systematic Review.

PURPOSE: A number of recent publications have proposed that a family of image-derived indices, called texture features, can predict clinical outcome in patients with cancer. However, the investigation of multiple indices on a single data set can lead to significant inflation of type-I errors. We report a systematic review of the type-I error inflation in such studies and review the evidence regarding associations between patient outcome and texture features derived from positron emission tomography (PET) or computed tomography (CT) images. METHODS: For study identification PubMed and Scopus were searched (1/2000-9/2013) using combinations of the keywords texture, prognostic, predictive and cancer. Studies were divided into three categories according to the sources of the type-I error inflation and the use or not of an independent validation dataset. For each study, the true type-I error probability and the adjusted level of significance were estimated using the optimum cut-off approach correction, and the Benjamini-Hochberg method. To demonstrate explicitly the variable selection bias in these studies, we re-analyzed data from one of the published studies, but using 100 random variables substituted for the original image-derived indices. The significance of the random variables as potential predictors of outcome was examined using the analysis methods used in the identified studies. RESULTS: Fifteen studies were identified. After applying appropriate statistical corrections, an average type-I error probability of 76% (range: 34-99%) was estimated with the majority of published results not reaching statistical significance. Only 3/15 studies used a validation dataset. For the 100 random variables examined, 10% proved to be significant predictors of survival when subjected to ROC and multiple hypothesis testing analysis. CONCLUSIONS: We found insufficient evidence to support a relationship between PET or CT texture features and patient survival. Further fit for purpose validation of these image-derived biomarkers should be supported by appropriate biological and statistical evidence before their association with patient outcome is investigated in prospective studies.

Interstitial diffusion and the relationship between compartment modelling and multi-scale spatial-temporal modelling of (18)F-FLT tumour uptake dynamics.

Tumour cell proliferation can be imaged via positron emission tomography of the radiotracer 3'-deoxy-3'-18F-fluorothymidine (18F-FLT). Conceptually, the number of proliferating cells might be expected to correlate more closely with the kinetics of 18F-FLT uptake than with uptake at a fixed time. Radiotracer uptake kinetics are standardly visualized using parametric maps of compartment model fits to time-activity-curves (TACs) of individual voxels. However the relationship between the underlying spatiotemporal accumulation of FLT and the kinetics described by compartment models has not yet been explored. In this work tumour tracer uptake is simulated using a mechanistic spatial-temporal model based on a convection-diffusion-reaction equation solved via the finite difference method. The model describes a chain of processes: the flow of FLT between the spatially heterogeneous tumour vasculature and interstitium; diffusion and convection of FLT within the interstitium; transport of FLT into cells; and intracellular phosphorylation. Using values of model parameters estimated from the biological literature, simulated FLT TACs are generated with shapes and magnitudes similar to those seen clinically. Results show that the kinetics of the spatial-temporal model can be recovered accurately by fitting a 3-tissue compartment model to FLT TACs simulated for those tumours or tumour sub-volumes that can be viewed as approximately closed, for which tracer diffusion throughout the interstitium makes only a small fractional change to the quantity of FLT they contain. For a single PET voxel of width 2.5-5 mm we show that this condition is roughly equivalent to requiring that the relative difference in tracer uptake between the voxel and its neighbours is much less than one.

18F-FLT uptake kinetics in head and neck squamous cell carcinoma: a PET imaging study.

PURPOSE: To analyze the kinetics of 3(')-deoxy-3(')-[F-18]-fluorothymidine (18F-FLT) uptake by head and neck squamous cell carcinomas and involved nodes imaged using positron emission tomography (PET). METHODS: Two- and three-tissue compartment models were fitted to 12 tumor time-activity-curves (TACs) obtained for 6 structures (tumors or involved nodes) imaged in ten dynamic PET studies of 1 h duration, carried out for five patients. The ability of the models to describe the data was assessed using a runs test, the Akaike information criterion (AIC) and leave-one-out cross-validation. To generate parametric maps the models were also fitted to TACs of individual voxels. Correlations between maps of different parameters were characterized using Pearson'sr coefficient; in particular the phosphorylation rate-constants k3-2tiss and k5 of the two- and three-tissue models were studied alongside the flux parameters KFLT- 2tiss and KFLT of these models, and standardized uptake values (SUV). A methodology based on expectation-maximization clustering and the Bayesian information criterion ("EM-BIC clustering") was used to distil the information from noisy parametric images. RESULTS: Fits of two-tissue models 2C3K and 2C4K and three-tissue models 3C5K and 3C6K comprising three, four, five, and six rate-constants, respectively, pass the runs test for 4, 8, 10, and 11 of 12 tumor TACs. The three-tissue models have lower AIC and cross-validation scores for nine of the 12 tumors. Overall the 3C6K model has the lowest AIC and cross-validation scores and its fitted parameter values are of the same orders of magnitude as literature estimates. Maps of KFLT and KFLT- 2tiss are strongly correlated (r = 0.85) and also correlate closely with SUV maps (r = 0.72 for KFLT- 2tiss, 0.64 for KFLT). Phosphorylation rate-constant maps are moderately correlated with flux maps (r = 0.48 for k3-2tiss vs KFLT- 2tiss and r = 0.68 for k5 vs KFLT); however, neither phosphorylation rate-constant correlates significantly with SUV. EM-BIC clustering reduces the parametric maps to a small number of levels--on average 5.8, 3.5, 3.4, and 1.4 for KFLT- 2tiss, KFLT, k3-2tiss, and k5. This large simplification is potentially useful for radiotherapy dose-painting, but demonstrates the high noise in some maps. Statistical simulations show that voxel level noise degrades TACs generated from the 3C6K model sufficiently that the average AIC score, parameter bias, and total uncertainty of 2C4K model fits are similar to those of 3C6K fits, whereas at the whole tumor level the scores are lower for 3C6K fits. CONCLUSIONS: For the patients studied here, whole tumor FLT uptake time-courses are represented better overall by a three-tissue than by a two-tissue model. EM-BIC clustering simplifies noisy parametric maps, providing the best description of the underlying information they contain and is potentially useful for radiotherapy dose-painting. However, the clustering highlights the large degree of noise present in maps of the phosphorylation rate-constantsk5 and k3-2tiss, which are conceptually tightly linked to cellular proliferation. Methods must be found to make these maps more robust-either by constraining other model parameters or modifying dynamic imaging protocols.

Estimation of input functions from dynamic [18F]FLT PET studies of the head and neck with correction for partial volume effects.

BACKGROUND: We present a method for extracting arterial input functions from dynamic [18F]FLT PET images of the head and neck, directly accounting for the partial volume effect. The method uses two blood samples, for which the optimum collection times are assessed. METHODS: Six datasets comprising dynamic PET images, co-registered computed tomography (CT) scans and blood-sampled input functions were collected from four patients with head and neck tumours. In each PET image set, a region was identified that comprised the carotid artery (outlined on CT images) and surrounding tissue within the voxels containing the artery. The time course of activity in the region was modelled as the sum of the blood-sampled input function and a compartmental model of tracer uptake in the surrounding tissue.The time course of arterial activity was described by a mathematical function with seven parameters. The parameters of the function and the compartmental model were simultaneously estimated, aiming to achieve the best match between the modelled and imaged time course of regional activity and the best match of the estimated blood activity to between 0 and 3 samples. The normalised root-mean-square (RMSnorm) differences and errors in areas under the curves (AUCs) between the measured and estimated input functions were assessed. RESULTS: A one-compartment model of tracer movement to and from the artery best described uptake in the tissue surrounding the artery, so the final model of the input function and tissue kinetics has nine parameters to be estimated. The estimated and blood-sampled input functions agreed well when two blood samples, obtained at times between 2 and 8 min and between 8 and 60 min, were used in the estimation process (RMSnorm values of 1.1 ± 0.5 and AUC errors for the peak and tail region of the curves of 15% ± 9% and 10% ± 8%, respectively). A third blood sample did not significantly improve the accuracy of the estimated input functions. CONCLUSIONS: Input functions for FLT-PET studies of the head and neck can be estimated well using a one-compartment model of tracer movement and TWO blood samples obtained after the peak in arterial activity.

Management of a Solitary Bone Metastasis to the Tibia from Colorectal Cancer.

The onset of osseous metastases during the course of colorectal cancer is not common. When they appear they are usually combined with visceral metastases to the liver, lungs and brain. In our report we refer to the case of a 78-year-old patient who presented a solitary bone metastasis from rectal carcinoma in the middle of his right tibia. A year before he had been operated for a Dukes stage B1 adenocarcinoma of the rectum. The rest of the check was negative for other metastases. He received external radiotherapy and capecitabine with bisphosphonates as palliative treatment. 19 months after the original diagnosis of bone metastasis the patient has stable disease.