Sources of variability in fluorescence spectroscopic measurements in a Phase II clinical trial of 850 patients.

BACKGROUND: Devices using fluorescence spectroscopy to differentiate high grade squamous intraepithelial lesions from normal tissue in the cervix have shown some diagnostic efficacy. Measurements from these devices produce large amounts of complex, multi-factored data. The purpose of this study is to isolate the effects of the particular care providers and equipment operators who are involved in taking measurements. METHODS: Data from spectroscopic measurements of the Phase II study of 850 patients with abnormal Papancicolau smears were used. The data were subject to a Principal Components Analysis and to MANOVA to control for variables that are known to affect outcomes. RESULTS: The analysis showed significant provider effects from both devices and significant operator effects from one device. CONCLUSION: We will repeat a similar analysis on data from a screening trial, on the combined diagnostic and screening study, and on the reflectance data. In the future, we hope to be able to design devices that address provider and operator effects.

Methodology of a real-time quality control for the multispectral digital colposcope (MDC).

BACKGROUND: The diagnostic ability of algorithms developed for the Multispectral Digital Colposcope (MDC) is highly dependent on the quality of the image. The field of objective medical image quality analysis has great potential but has not been well exploited. Various researchers have reported different measures of image quality but with an existence of a reference image. The quality of an image can be attributed to several sources of errors, a few of which would be inclusion of presence of extraneous components, improper illumination, or an image out of focus. This can be due to motion artifact or the region of interest out of the focal plane. METHODS: With spectroscopic measurements, assessment of data quality has been used by our group in the past to avoid hardware errors at the time of acquisition. We are currently developing algorithms that will help identify hardware and acquisition errors to the clinician in under a few seconds. RESULTS: Minimizing these errors not only provides quality images for a diagnostic algorithm, but reduces the necessity for complex and time intensive post-processing software for enhancing the images. CONCLUSION: We propose a no reference image quality system specifically designed for MDC that can be modified to similar spectroscopic imaging applications.

Fluorescence and reflectance device variability throughout the progression of a phase II clinical trial to detect and screen for cervical neoplasia using a fiber optic probe.

Large phase II trials of fluorescence and reflectance spectroscopy using a fiber optic probe in the screening and diagnostic settings for detecting cervical neoplasia have been conducted. We present accrual and histopathology data, instrumentation, data processing, and the preliminary results of interdevice consistencies throughout the progression of a trial. Patients were recruited for either a screening trial (no history of abnormal Papanicolaou smears) or a diagnostic trial (a history of abnormal Papanicolaou smears). Colposcopy identified normal and abnormal squamous, columnar, and transformation zone areas that were subsequently measured with the fiber probe and biopsied. In the course of the clinical trial, two generations of spectrometers (FastEEM2 and FastEEM3) were designed and utilized as optical instrumentation for in vivo spectroscopic fluorescence and reflectance measurements. Data processing of fluorescence and reflectance data is explained in detail and a preliminary analysis of the variability across each device and probe combination is explored. One thousand patients were recruited in the screening trial and 850 patients were recruited in the diagnostic trial. Three clinical sites attracted a diverse range of patients of different ages, ethnicities, and menopausal status. The fully processed results clearly show that consistencies exist across all device and probe combinations throughout the diagnostic trial. Based on the stratification of the data, the results also show identifiable differences in mean intensity between normal and high-grade tissue diagnosis, pre- and postmenopausal status, and squamous and columnar tissue type. The mean intensity values of stratified data show consistent separation across each of the device and probe combinations. By analyzing trial spectra, we provide more evidence that biographical variables such as menopausal status as well as tissue type and diagnosis significantly affect the data. Understanding these effects will lead to better modeling parameters when analyzing the performance of fluorescence and reflectance spectroscopy.

Instrumentation as a source of variability in the application of fluorescence spectroscopic devices for detecting cervical neoplasia.

We report on a study designed to assess variability among three different fluorescence spectroscopy devices, four fiber optic probes, and three sets of optical calibration standards to better understand the reproducibility of measurements and interdevice comparisons of fluorescence spectroscopic data intended for clinical diagnostic use. Multiple measurements are acquired from all sets of standards using each combination of spectrometer, fiber optic probe, and optical standard. Data are processed using standard calibration methods to remove instrument-dependant responses. Processed spectra are analyzed using an analysis of variance to assess the percent variance explained by each factor that was statistically significant. Analysis of processed data confirms statistically significant differences among the spectrometers and fiber optic probes. However, no differences are found when varying calibration standards or measurement date and time. The spectrometers and fiber optic probes are significant sources of variability, but appropriate data processing substantially reduces these effects. Studies of inter- and intradevice variability are important methodological issues for optical device trials and must be included in the quality assurance studies for the clinical trial design.

Calibration standards for multicenter clinical trials of fluorescence spectroscopy for in vivo diagnosis.

In the context of clinical trials, calibration protocols for optical instruments that ensure measurement accuracy and the ability to carry out meaningful comparisons of data acquired from multiple instruments are required. A series of calibration standards and procedures are presented to assess technical feasibility of optical devices for cervical precancer detection. Measurements of positive and negative standards, and tissue are made with two generations of research grade spectrometers. Calibration accuracy, ability of standards to correct and account for changes in experimental conditions, and device components are analyzed. The relative frequency of measured calibration standards is investigated retrospectively using statistical analysis of trends in instrument performance. Fluorescence measurements of standards and tissue made with completely different spectrometers show good agreement in intensity and lineshape. Frequency of wavelength calibration standards is increased to every 2 h to compensate for thermal drifts in grating mount. Variations in illumination energy detected between standards and patient measurements require probe redesign to allow for simultaneous acquisition of illumination power with every patient measurement. The use of frequent and well-characterized standards enables meaningful comparison of data from multiple devices and unambiguous interpretation of experiments among the biomedical optics community.