Fluorescence and reflectance device variability throughout the progression of a phase II clinical trial to detect and screen for cervical neoplasia using a fiber optic probe.

Large phase II trials of fluorescence and reflectance spectroscopy using a fiber optic probe in the screening and diagnostic settings for detecting cervical neoplasia have been conducted. We present accrual and histopathology data, instrumentation, data processing, and the preliminary results of interdevice consistencies throughout the progression of a trial. Patients were recruited for either a screening trial (no history of abnormal Papanicolaou smears) or a diagnostic trial (a history of abnormal Papanicolaou smears). Colposcopy identified normal and abnormal squamous, columnar, and transformation zone areas that were subsequently measured with the fiber probe and biopsied. In the course of the clinical trial, two generations of spectrometers (FastEEM2 and FastEEM3) were designed and utilized as optical instrumentation for in vivo spectroscopic fluorescence and reflectance measurements. Data processing of fluorescence and reflectance data is explained in detail and a preliminary analysis of the variability across each device and probe combination is explored. One thousand patients were recruited in the screening trial and 850 patients were recruited in the diagnostic trial. Three clinical sites attracted a diverse range of patients of different ages, ethnicities, and menopausal status. The fully processed results clearly show that consistencies exist across all device and probe combinations throughout the diagnostic trial. Based on the stratification of the data, the results also show identifiable differences in mean intensity between normal and high-grade tissue diagnosis, pre- and postmenopausal status, and squamous and columnar tissue type. The mean intensity values of stratified data show consistent separation across each of the device and probe combinations. By analyzing trial spectra, we provide more evidence that biographical variables such as menopausal status as well as tissue type and diagnosis significantly affect the data. Understanding these effects will lead to better modeling parameters when analyzing the performance of fluorescence and reflectance spectroscopy.

Instrumentation as a source of variability in the application of fluorescence spectroscopic devices for detecting cervical neoplasia.

We report on a study designed to assess variability among three different fluorescence spectroscopy devices, four fiber optic probes, and three sets of optical calibration standards to better understand the reproducibility of measurements and interdevice comparisons of fluorescence spectroscopic data intended for clinical diagnostic use. Multiple measurements are acquired from all sets of standards using each combination of spectrometer, fiber optic probe, and optical standard. Data are processed using standard calibration methods to remove instrument-dependant responses. Processed spectra are analyzed using an analysis of variance to assess the percent variance explained by each factor that was statistically significant. Analysis of processed data confirms statistically significant differences among the spectrometers and fiber optic probes. However, no differences are found when varying calibration standards or measurement date and time. The spectrometers and fiber optic probes are significant sources of variability, but appropriate data processing substantially reduces these effects. Studies of inter- and intradevice variability are important methodological issues for optical device trials and must be included in the quality assurance studies for the clinical trial design.

Optical technologies and molecular imaging for cervical neoplasia: a program project update.

There is an urgent global need for effective and affordable approaches to cervical cancer screening and diagnosis. In developing nations, cervical malignancies remain the leading cause of cancer-related deaths in women. This reality may be difficult to accept given that these deaths are largely preventable; where cervical screening programs have been implemented, cervical cancer-related deaths have decreased dramatically. In developed countries, the challenges of cervical disease stem from high costs and overtreatment. The National Cancer Institute-funded Program Project is evaluating the applicability of optical technologies in cervical cancer. The mandate of the project is to create tools for disease detection and diagnosis that are inexpensive, require minimal expertise, are more accurate than existing modalities, and can be feasibly implemented in a variety of clinical settings. This article presents the status and long-term goals of the project.

Repeatability of tissue fluorescence measurements for the detection of cervical intraepithelial neoplasia.

We examined intensity and shape differences in 378 repeated spectroscopic measures of the cervix. We examined causes of variability such as presence of precancer or cancer, pathologic tissue type, menopausal status, hormone or oral contraceptive use, and age; as well as technology related variables like generation of device and provider making exam. Age, device generation, and provider were statistically significantly related to intensity differences. Provider and device generation were related to shape differences. We examined the order of measurements and found a decreased intensity in the second measurement due to hemoglobin absorption. 96% of repeat measurements had classification concordance of cervical intraepithelial neoplasia.

Sources of variability in fluorescence spectroscopic measurements in a Phase II clinical trial of 850 patients.

BACKGROUND: Devices using fluorescence spectroscopy to differentiate high grade squamous intraepithelial lesions from normal tissue in the cervix have shown some diagnostic efficacy. Measurements from these devices produce large amounts of complex, multi-factored data. The purpose of this study is to isolate the effects of the particular care providers and equipment operators who are involved in taking measurements. METHODS: Data from spectroscopic measurements of the Phase II study of 850 patients with abnormal Papancicolau smears were used. The data were subject to a Principal Components Analysis and to MANOVA to control for variables that are known to affect outcomes. RESULTS: The analysis showed significant provider effects from both devices and significant operator effects from one device. CONCLUSION: We will repeat a similar analysis on data from a screening trial, on the combined diagnostic and screening study, and on the reflectance data. In the future, we hope to be able to design devices that address provider and operator effects.

Methodology of a real-time quality control for the multispectral digital colposcope (MDC).

BACKGROUND: The diagnostic ability of algorithms developed for the Multispectral Digital Colposcope (MDC) is highly dependent on the quality of the image. The field of objective medical image quality analysis has great potential but has not been well exploited. Various researchers have reported different measures of image quality but with an existence of a reference image. The quality of an image can be attributed to several sources of errors, a few of which would be inclusion of presence of extraneous components, improper illumination, or an image out of focus. This can be due to motion artifact or the region of interest out of the focal plane. METHODS: With spectroscopic measurements, assessment of data quality has been used by our group in the past to avoid hardware errors at the time of acquisition. We are currently developing algorithms that will help identify hardware and acquisition errors to the clinician in under a few seconds. RESULTS: Minimizing these errors not only provides quality images for a diagnostic algorithm, but reduces the necessity for complex and time intensive post-processing software for enhancing the images. CONCLUSION: We propose a no reference image quality system specifically designed for MDC that can be modified to similar spectroscopic imaging applications.

Design and preliminary analysis of a study to assess intra-device and inter-device variability of fluorescence spectroscopy instruments for detecting cervical neoplasia.

INTRODUCTION: A study was designed to assess variability between different fluorescence spectroscopy devices. Measurements were made with all combinations of three devices, four probes, and three sets of standards trays. Additionally, we made three measurements on the same day over 2 days for the same combination of device, probe, and standards tray to assess reproducibility over a day and across days. MATERIALS AND METHODS: The devices consisted of light sources, fiber-optics, and cameras. We measured thirteen standards and present the data from the frosted cuvette, water, and rhodamine standards. A preliminary analysis was performed with the data that were wavelength calibrated and background subtracted; however, the system has not been corrected for systematic intensity variations caused by the devices. Two analyses were performed on the rhodamine, water, and frosted cuvette standards data. The first one is based on first clustering the measurements and then looking for association between the 5 factors (device, probe, standards tray, day, measurement number) using chi-squared tests on the cross-tabulation of cluster and factor level. This showed that only device and probe were significant. We then did an analysis of variance to assess the percent variance explained by each factor that was significant from the chi-squared analysis. RESULTS: The data were remarkably similar across the different combinations of factors. The analysis based on the clusters showed that sometimes devices alone, probes alone, but most often combinations of device and probe caused significant differences in measurements. The analysis showed that time of day, location of device, and standards trays do not vary significantly; whereas the devices and probes account for differences in measurement. We expected this type of significance using unprocessed data since the processing corrects for differences in devices. However, this analysis on raw data is useful to explore what combination of device and probe measurements should be targeted for further investigation. This experiment affirms that online quality control is necessary to obtain the best excitation-emission matrices from optical spectroscopy devices. CONCLUSION: The fact that the device and probe are the primary sources of variability indicates that proper correction for the transfer function of the individual devices should make the measurements essentially equivalent.