Physician satisfaction with clinical laboratory services: a College of American Pathologists Q-probes study of 138 institutions.

CONTEXT: Monitoring customer satisfaction is a valuable component of a laboratory quality improvement program. OBJECTIVE: To survey the level of physician satisfaction with hospital clinical laboratory services. DESIGN: Participating institutions provided demographic and practice information and survey results of physician satisfaction with defined aspects of clinical laboratory services, rated on a scale of 1 (poor) to 5 (excellent). RESULTS: One hundred thirty-eight institutions participated in this study and submitted a total of 4329 physician surveys. The overall satisfaction score for all institutions ranged from 2.9 to 5.0. The median overall score for all participants was 4.1 (10th percentile, 3.6; 90th percentile, 4.5). Physicians were most satisfied with the quality/reliability of results and staff courtesy, with median values of excellent or good ratings of 89.9%. Of the 5 service categories that received the lowest percentage values of excellent/good ratings (combined scores of 4 and 5), 4 were related to turnaround time for inpatient stat, outpatient stat, routine, and esoteric tests. Surveys from half of the participating laboratories reported that 96% to 100% of physicians would recommend the laboratory to other physicians. The category most frequently selected as the most important category of laboratory services was quality/reliability of results (31.7%). CONCLUSIONS: There continues to be a high level of physician satisfaction and loyalty with clinical laboratory services. Test turnaround times are persistent categories of dissatisfaction and present opportunities for improvement.

Notification of critical results: a College of American Pathologists Q-Probes study of 121 institutions.

CONTEXT: Hospital accreditors are placing increased emphasis on the timeliness with which critical laboratory results are reported to caregivers. OBJECTIVE: To measure the speed of critical result notification at a group of laboratories, identify factors associated with faster reporting, and place findings in the context of the time required to transport and test specimens and to correct critical abnormalities. DESIGN: Contemporaneous review of 3545 inpatient and emergency department critical result notifications in 121 laboratories enrolled in the College of American Pathologists Q-Probes program. RESULTS: The median laboratory required a median of 5 minutes for staff to notify someone about a critical result once testing was complete. Laboratories affiliated with smaller institutions (P = .01), rural laboratories (P = .001), and sites that called results before releasing them from the laboratory computer (P = .02) were able to notify caregivers more quickly. There was variation among institutions in the time it took to notify caregivers (interquartile range, 1.5-8 minutes). At the median facility, notification took place 56.5 minutes after the specimen had been collected. CONCLUSIONS: The time required to notify caregivers of a critical laboratory result is a small proportion of the time taken to collect and test specimens or the time that has been reported for caregivers to correct abnormalities. Although failure to notify caregivers of critical results may represent an important patient safety vulnerability, the timeliness of laboratory notification is a minor contributor to total test turnaround time at most institutions.

The rate of manual microscopic examination of urine sediment: a College of American Pathologists Q-Probes study of 11,243 urinalysis tests from 88 institutions.

CONTEXT: The manual microscopic examination (MME) of the urine sediment is an imprecise and labor-intensive procedure. Many laboratories have developed rules from clinical parameters or urinalysis results to limit the number of these examinations. OBJECTIVE: To determine the rate of urinalysis specimens on which an MME of the urine sediment was performed, document how various rules influence this rate, and determine whether any new information was learned from the MME. DESIGN: Participants selected 10 random urinalysis tests received during each traditional shift and determined if an MME was performed until a total of 50 urinalysis tests with an MME were reviewed. Participants recorded the rules that elicited an MME and any new information learned from such an examination. RESULTS: The MME rate for the median institution was 62.5%. An MME of urine was most frequently done for an abnormal urinalysis result and often resulted in new information being learned, irrespective of the rule that elicited the MME. The median institution learned new information as a result of the manual examination 66% of the time. The use of an automated microscopic analyzer was associated with fewer manual examinations (P = .005), whereas the ability of a clinician to order a manual examination was associated with more manual examinations (P = .004). CONCLUSIONS: The use of an automated microscopic analyzer may decrease the number of MMEs. An MME when triggered by an abnormal macroscopic appearance of urine, a physician request, or virtually any positive urinalysis result often resulted in new information.

Specimen labeling errors: a Q-probes analysis of 147 clinical laboratories.

CONTEXT: Accurate specimen identification is critical for quality patient care. Improperly identified specimens can result in delayed diagnosis, additional laboratory testing, treatment of the wrong patient for the wrong disease, and severe transfusion reactions. Specimen identification errors have been reported to occur at rates of 0.1% to 5%. OBJECTIVE: To determine the frequency of labeling errors in a multi-institutional survey. DESIGN: Labeling errors were categorized as: (1) mislabeled, (2) unlabeled, (3) partially labeled, (4) incompletely labeled, and (5) illegible label. Blood specimens for routine or stat chemistry, hematology, and coagulation testing were included. Labeling error rates were calculated for each participant and tested for associations with institutional demographic and practice variable information. RESULTS: More than 3.3 million specimen labels were reviewed by 147 laboratories. Labeling errors were identified at a rate of 0.92 per 1000 labels. Two variables were statistically associated with lower labeling error rates: (1) laboratories with current, ongoing quality monitors for specimen identification (P = .008) and (2) institutions with 24/7 phlebotomy services for inpatients (P = .02). Most institutions had written policies for specimen labeling at the bedside or in outpatient phlebotomy areas (96% and 98%, respectively). Allowance of relabeling of blood specimens by primary collecting personnel was reported by 42% of institutions. CONCLUSIONS: Laboratories actively engaged in ongoing specimen labeling quality monitors had fewer specimen labeling errors. Also, 24/7 phlebotomy services were associated with lower specimen error rates. Establishing quality metrics for specimen labeling and deploying 24/7 phlebotomy operations may contribute to improving the accuracy of specimen labeling for the clinical laboratory.

Urine culture contamination: a College of American Pathologists Q-Probes study of 127 laboratories.

CONTEXT: While urine culture contamination may not be completely avoidable, some laboratories have lower contamination rates than others. A College of American Pathologists (CAP) 1998 Q-Probes study showed that many interventions commonly assumed to reduce contamination were not demonstrably effective. This article revisits the issue. OBJECTIVE: To examine the frequency of urine culture contamination, review current laboratory practices in the collection of urine culture specimens, and determine practice characteristics that may be associated with the contamination rate. DESIGN: Laboratories participating in a CAP Q-Probes study were required to prospectively collect data on 120 consecutive urine culture specimens and provide information on the patient's demographics (age and sex), the location where the specimen was collected, how the specimen was handled, the number of isolates in quantities greater than or equal to 10,000 colony-forming units (CFU)/mL, and whether the laboratory considered the specimen to be contaminated. Specific inclusion and exclusion criteria were provided to the participants. Each laboratory completed a supplemental questionnaire that probed for specific laboratory urine culture collection practices. RESULTS: One hundred twenty-seven laboratories participated in the study. Results from a total of 14,739 urine specimens were received. For the purpose of this study, a urine specimen was determined to be contaminated if the culture yielded more than 2 isolates in quantities greater than or equal to 10,000 CFU/mL. Using these criteria the median institution had a contamination rate of 15.0%. Laboratories in the 10th percentile (low performance) had an average contamination rate of 41.7%, while laboratories in the 90th percentile had an average rate of 0.8%. The collection site had no influence on the contamination rate, but postcollection processing, especially refrigeration of the specimen, had a substantial effect. Providing instruction to patients produced a statistically significant lowering of contamination rates for specimens from male patients (P = .006) but not for female patients, except when written instructions were provided in the emergency room, in which case specimen contamination rates for both male and female patients dropped (P = .01). CONCLUSIONS: The median contamination rates remain at a level comparable to the results seen in a previous Q-Probes study, and some laboratories have very high contamination rates. Specimen refrigeration is associated with lower overall urine culture specimen contamination rate. Providing patient instruction is also associated with lower contamination rates under specific circumstances.

Accuracy of send-out test ordering: a College of American Pathologists Q-Probes study of ordering accuracy in 97 clinical laboratories.

CONTEXT: Errors entering orders for send-out laboratory tests into computer systems waste health care resources and can delay patient evaluation and management. OBJECTIVES: To determine (1) the accuracy of send-out test order entry under "real world" conditions and (2) whether any of several practices are associated with improved order accuracy. DESIGN: Representatives from 97 clinical laboratories provided information about the processes they use to send tests to reference facilities and their order entry and specimen routing error rates. RESULTS: In aggregate, 98% of send-out tests were correctly ordered and 99.4% of send-out tests were routed to the proper reference laboratory. There was wide variation among laboratories in the rate of send-out test order entry errors. In the bottom fourth of laboratories, more than 5% of send-out tests were ordered incorrectly, while in the top fourth of laboratories fewer than 0.3% of tests were ordered incorrectly. Order entry errors were less frequent when a miscellaneous test code was used than when a specific test code was used (3.9% vs 5.6%; P = .003). CONCLUSIONS: Computer order entry errors for send-out tests occur approximately twice as frequently as order entry errors for other types of tests. Filing more specific test codes in a referring institution's information system is unlikely to reduce order entry errors and may make error rates worse.

The value of monitoring human papillomavirus DNA results for Papanicolaou tests diagnosed as atypical squamous cells of undetermined significance: a College of American Pathologists Q-Probes study of 68 institutions.

CONTEXT: Papanicolaou (Pap) tests are often diagnosed as atypical squamous cells of undetermined significance (ASC-US). Human papillomavirus (HPV) DNA testing has been proposed as a quality metric for this diagnosis. OBJECTIVE: To measure the frequency of HPV positivity in Pap tests diagnosed as ASC-US and to examine laboratory variables that are associated with institutional deviation from the mean percent of HPV positivity. DESIGN: As part of a College of American Pathologist Q-Probes program, 68 participating laboratories retrospectively identified approximately 50 consecutive ASC-US Pap tests that had HPV testing results. RESULTS: The mean percentage of HPV positivity for ASC-US was 43.74% among institutions surveyed, but it had a broad distribution, with an SD of 17.77%. Associations were found for lower difference of the institutional mean from the surveyed interinstitutional mean percentage of positive HPV with (1) higher numbers of Pap tests in the past year that had HPV testing, (2) in-house HPV testing, and (3) teaching hospitals. All 3 factors correlated with a larger volume of Pap tests per institution. An association was found between patient age and the probability of a positive HPV result, indicating a dependence upon prevalence of HPV. CONCLUSIONS: Larger volumes of Pap tests may offer an opportunity to gain greater comfort in interpreting Pap tests. While there is significant variability in interinstitutional HPV-positive rates in ASC-US Pap tests, monitoring the HPV-positive rate in ASC-US Pap tests is a valuable broad measure of quality. Performance beyond 2 SDs of the mean should prompt reassessment of diagnostic criteria used in the evaluation of Pap tests and/or investigation of the prevalence of HPV positivity in the population from which the Pap tests are obtained.

Hospital nursing satisfaction with clinical laboratory services: a College of American Pathologists Q-Probes study of 162 institutions.

CONTEXT: Monitoring customer satisfaction is an important and useful quality improvement tool and is required of most clinical laboratories in the United States. OBJECTIVE: To survey the level of nursing satisfaction with hospital clinical laboratory services. DESIGN: Participating laboratories provided information regarding laboratory demographics and practices. These laboratories then surveyed hospital nursing personnel regarding their level of satisfaction with defined aspects of laboratory service. SETTING: College of American Pathologists Q-Probes laboratory quality improvement study in 162 hospital laboratories. MAIN OUTCOME MEASURES: Nursing overall satisfaction score (ranging from 1, not satisfied, to 5, very satisfied) and satisfaction scores for 13 specific aspects of clinical laboratory services. RESULTS: One hundred sixty-two institutions submitted data from a total of 7033 nursing surveys. The overall satisfaction score for all institutions ranged from 2.5 to 4.6. The median overall score for all participants was 3.9 (10th percentile, 3.2; 90th percentile, 4.2). Nursing personnel were most satisfied with the accuracy of test results, phlebotomy courtesy toward patients and nursing staff, and notification of abnormal results. They were least satisfied with stat test turnaround time, laboratory management responsiveness and accessibility, phlebotomy responsiveness to service requests, and routine test turnaround time. The most important aspect of laboratory service reported by nursing personnel was stat test turnaround time. CONCLUSIONS: Most nursing personnel are satisfied with the clinical laboratory services that are provided to the patients in their care. Although test result accuracy is very highly regarded, there is room for improvement in several aspects of service, particularly in test turnaround time and laboratory management accessibility and responsiveness.

Identification errors involving clinical laboratories: a College of American Pathologists Q-Probes study of patient and specimen identification errors at 120 institutions.

CONTEXT: Misidentified laboratory specimens may cause patient injury, but their frequency in general laboratory practice is unknown. OBJECTIVES: To determine (1) the frequency of identification errors detected before and after result verification, (2) the frequency of adverse patient events due to specimen misidentification, and (3) factors associated with lower error rates and better detection of errors. DESIGN: One hundred twenty clinical laboratories provided information about identification errors during 5 weeks. RESULTS: In aggregate, 85% of errors were detected before results were released; one quarter of laboratories identified more than 95% of errors before result verification. The overall rate of patient identification errors involving released results was 55 errors per 1,000,000 billable tests. A total of 345 adverse events were reported. Most of the adverse events caused material inconvenience to the patients but did not result in any permanent harm. On average, adverse events resulted from 1 of every 18 identification errors. Extrapolating the adverse event rate observed in this study to all United States hospital-based laboratories suggests that more than 160,000 adverse events per year result from misidentification of patients' laboratory specimens. CONCLUSIONS: Identification errors are common in laboratory medicine, but most are detected before results are released, and only a fraction are associated with adverse patient events. Even when taking into consideration the design of this study, which used imperfect case finding, institutions that did a better job of detecting errors within the laboratory released a smaller proportion of results that involved specimen misidentification.

The potential for failure in gynecologic regulatory proficiency testing with current slide validation criteria: results from the College of American Pathologists Interlaboratory Comparison in Gynecologic Cytology Program.

CONTEXT: Current regulatory proficiency testing scoring results in an automatic failure for identifying high-grade squamous intraepithelial lesion (HSIL) as negative. OBJECTIVE: The College of American Pathologists Interlaboratory Comparison Program in Cervicovaginal Cytology data from January 2004 to April 2005 were analyzed to estimate the percentage of failure based on negative responses for HSIL and validation criteria. DESIGN: More than 15,000 participants received field-validated and educational slide sets for conventional, ThinPrep, and SurePath modules. Educational sets fulfilled the validation criteria of the Center for Medicare and Medicaid Services, which required the consensus diagnosis of biopsy-proven HSIL (not field-validated) after review by 3 pathologists. The College of American Pathologists field validation required at least 20 responses to the HSIL+ series, with 70% matched to HSIL+ (standard error < or = 0.05). Minimum regulatory proficiency testing failure estimates were based on incorrect negative responses for the reference category of HSIL. RESULTS: For both cytotechnologists and pathologists, there was a statistically significant higher failure rate for slides that were not field-validated versus those that were field-validated. In conventional modules, 5.3% of the slides that were not field-validated were called negative, versus 1.2% of the field-validated slides. In all liquid-based preparations, 4.0% of the non-field-validated versus 2.2% field-validated slides were called negative. Pathologists would have failed more often than cytotechnologists for the slides that were not field-validated, whereas there was no statistical difference in failure performance with field-validated slides. CONCLUSIONS: Failures were significantly greater with the slides that were not field-validated for both conventional and liquid-based preparations (ThinPrep only) and have implications for both regulatory proficiency testing and expert legal review. Poor performance of pathologists relative to that of cytotechnologists may reflect a lack of prescreening of slides or scope of practice issues.

Robustness of validation criteria in the College of American Pathologists Interlaboratory Comparison Program in Cervicovaginal Cytology.

CONTEXT: Field validation of slides used in gynecologic cytology proficiency testing has surfaced as an important issue. Although the precision of diagnoses in peer-reviewed educational programs has been examined, the robustness of the validation criteria for specific types of interpretations used in proficiency testing has not been previously studied. OBJECTIVE: To evaluate the robustness of validation criteria for slides entering an educational slide program. DESIGN: We reviewed the results of the College of American Pathologists Interlaboratory Comparison Program in Cervicovaginal Cytology and compared the robustness of validation criteria for different reference diagnoses, using a total of 16,948 circulating slides. RESULTS: Validation criteria could be divided into 2 significantly different groups. The criteria for herpes, Trichomonas, squamous cell carcinoma, and adenocarcinoma were significantly more robust than the diagnoses of unsatisfactory; negative for intraepithelial lesion and malignancy, not otherwise specified; low-grade squamous intraepithelial lesion; and high-grade squamous intraepithelial lesion (P < .001). CONCLUSIONS: The validation criteria used in the College of American Pathologists Interlaboratory Comparison Program in Cervicovaginal Cytology show 2 different levels of robustness or redundancy. These results have implications for the design of fair proficiency tests. Proficiency testing can be designed with the necessary number of reviews needed for slide validation.

Trends in blood culture contamination: a College of American Pathologists Q-Tracks study of 356 institutions.

CONTEXT: Blood culture contamination extends hospital stays and increases the cost of care. OBJECTIVES: To measure blood culture contamination rates in a large number of institutions over time and to elucidate practice patterns and demographic factors associated with sustained reduction in contamination rates. DESIGN: Longitudinal cohort study of 356 clinical laboratories that provided quarterly data about blood culture results, using a uniform definition of contamination. Mixed linear model analysis of the 1999 through 2003 data set. RESULTS: Blood culture contamination was significantly higher in institutions that used nonlaboratory personnel to collect blood (P = .03) and significantly lower in facilities that used a dedicated phlebotomy team (P < .001). Higher volume of blood collection was significantly associated with lower contamination rates (P < .001). Continued participation in the Q-Tracks monitoring program was associated with significant and progressive reduction in contamination rates. By the fifth year of participation, the median institution had reduced its blood culture contamination rate by 0.67% (P < .001). CONCLUSIONS: Institutions that use decentralized patient-centered personnel rather than dedicated phlebotomy teams to collect blood cultures experience significantly higher contamination rates. Long-term monitoring of contamination is associated with sustained improvement in performance.

Continuous monitoring of stat and routine outlier turnaround times: two College of American Pathologists Q-Tracks monitors in 291 hospitals.

CONTEXT: The laboratory test turnaround times (TATs) that exceed the expectations of clinicians who order those tests, the so-called outlier test reporting rates, may be responsible for perceptions of inadequate laboratory service. OBJECTIVE: To monitor outlier test reporting rates for emergency department stat potassium results and routine inpatient morning blood tests. DESIGN: In 2 different monitors, each conducted for 2 years, laboratory personnel in institutions enrolled in the College of American Pathologists (CAP) Q-Tracks program tracked the percentages of emergency department stat potassium results and/or the percentages of morning rounds routine test results that were reported later than self-imposed reporting deadlines. SETTING: A total of 291 hospitals participating in 2 CAP Q-Tracks monitors. RESULTS: Participants monitored 225,140 stat emergency department potassium TATs, of which 33,402 (14.8%) were outliers, and 1,055040 routine morning test reporting times, of which 123,554 (11.7%) were outliers. For both monitors, there was a significant (P <.05) downward trend in the outlier rates as the number of quarters in which participants submitted data increased. CONCLUSION: Outlier reporting rates for emergency department stat potassium and routine morning test results decreased during the 2-year period of continuous monitoring. The CAP Q-Tracks program provides an effective vehicle by which providers of laboratory services may improve the timeliness with which they deliver the results of laboratory tests.

Heparin monitoring and patient safety: a College of American Pathologists Q-Probes study of 3431 patients at 140 institutions.

CONTEXT: Appropriate laboratory monitoring of unfractionated heparin therapy promotes effective anticoagulation while minimizing hemorrhagic complications. OBJECTIVES: To measure heparin therapy monitoring in a "real-world" setting and to assess the degree of anticoagulation achieved. DESIGN: One hundred forty institutions abstracted laboratory and pharmacy data from up to 30 inpatients receiving standard-dose unfractionated heparin therapy for 72 hours. Institutions also reported their therapeutic ranges and described heparin prescribing and monitoring policies. RESULTS: Activated partial thromboplastin times or anti-factor Xa levels were measured at least once within the first 12 hours of administration for 95% of 3431 heparinized inpatients. Eighty-seven percent of patients had a platelet count performed within 72 hours of heparin administration. Seventy-eight percent of heparinized inpatients achieved therapeutic anticoagulation within 24 hours, but more than one third of patients entered the supratherapeutic range on at least 2 occasions during the first 72 hours. We found moderate variation in performance among the 140 institutions participating in the study, with more consistency in monitoring patients but less consistency in achieving therapeutic levels of anticoagulation. In one fourth of hospitals, more than half of the heparinized patients entered the supratherapeutic range on 2 or more occasions during the first 72 hours of therapy. None of 20 institutional practices we examined were meaningfully associated with more thorough monitoring of patients or with a higher percentage of patients achieving therapeutic anticoagulation. There was moderately wide variation in therapeutic ranges among the 140 sites. CONCLUSIONS: The prevention of heparin over-anticoagulation represents an important opportunity for improving patient safety in a significant number of institutions.

Biochemical markers of myocardial injury test turnaround time: a College of American Pathologists Q-Probes study of 7020 troponin and 4368 creatine kinase-MB determinations in 159 institutions.

CONTEXT: Rapid diagnosis of acute myocardial infarction in patients presenting to emergency departments (EDs) with chest pain may determine the types, and predict the outcomes of, the therapy those patients receive. The amount of time consumed in establishing diagnoses of acute myocardial infarction may depend in part on that consumed in the generation of the blood test results measuring myocardial injury. OBJECTIVE: To determine the normative rates of turnaround time (TAT) for biochemical markers of myocardial injury and to examine hospital and laboratory practices associated with faster TATs. DESIGN: Laboratory personnel in institutions enrolled in the College of American Pathologists Q-Probes Program measured the order-to-report TATs for serum creatine kinase-MB and/or serum troponin (I or T) for patients presenting to their hospital EDs with symptoms of acute myocardial infarction. Laboratory personnel also completed detailed questionnaires characterizing their laboratories' and hospitals' practices related to testing for biochemical markers of myocardial injury. ED physicians completed questionnaires indicating their satisfaction with testing for biochemical markers of myocardial injury in their hospitals. SETTING: A total of 159 hospitals, predominantly located in the United States, participating in the College of American Pathologists Q-Probes Program. RESULTS: Most (82%) laboratory participants indicated that they believed a reasonable order-to-report TATs for biochemical markers of myocardial injury to be 60 minutes or less. Most (75%) of the 1352 ED physicians who completed satisfaction questionnaires believed that the results of tests measuring myocardial injury should be reported back to them in 45 minutes or less, measured from the time that they ordered those tests. Participants submitted TAT data for 7020 troponin and 4368 creatine kinase-MB determinations. On average, they reported 90% of myocardial injury marker results in slightly more than 90 minutes measured from the time that those tests were ordered. Among the fastest performing 25% of participants (75th percentile and above), median order-to-report troponin and creatine kinase-MB TATs were equal to 50 and 48.3 minutes or less, respectively. Shorter troponin TATs were associated with performing cardiac marker studies in EDs or other peripheral laboratories compared to (1) performing tests in central hospital laboratories, and (2) having cardiac marker specimens obtained by laboratory rather than by nonlaboratory personnel. CONCLUSION: The TAT expectations of the ED physicians using the results of laboratory tests measuring myocardial injury exceed those of the laboratory personnel providing the results of those tests. The actual TATs of myocardial injury testing meet the expectations of neither the providers of those tests nor the users of those test results. Improving TAT performance will require that the providers and users of laboratory services work together to develop standards that meet the needs of the medical staff and that are reasonably achievable by laboratory personnel.

Detection of adenocarcinoma in situ of the cervix in Papanicolaou tests: comparison of diagnostic accuracy with other high-grade lesions.

CONTEXT: Adenocarcinoma in situ of the cervix is a recently recognized interpretation in the Bethesda 2001 system. Although specific morphologic criteria have been published, recognizing this entity is still difficult. OBJECTIVE: To compare pathologists' ability to correctly identify and categorize adenocarcinoma in situ with their ability to identify and categorize adenocarcinoma, high-grade squamous intraepithelial lesion, and squamous cell carcinoma. DESIGN: Pathologists' reviews in the 2001 and 2002 College of American Pathologists Interlaboratory Comparison Program in Cervicovaginal Cytology Program, an interlaboratory comparison program for gynecologic cytology, were examined. Cases were usually reviewed by multiple pathologists. False-negative rates, the percentage of reviews with exact agreement with reference interpretations, and the percentage of cases in which all reviews were in exact agreement with the reference interpretation for adenocarcinoma in situ, adenocarcinoma, high-grade squamous intraepithelial lesion, and squamous cell carcinoma were compared. RESULTS: A total of 213 reviews of cases categorized as adenocarcinoma in situ were compared with 2821 reviews of adenocarcinoma, 7535 reviews of high-grade squamous intraepithelial lesion, and 1886 reviews of squamous cell carcinoma. The false-negative rate for adenocarcinoma in situ (11.7%) was significantly higher than that for high-grade squamous intraepithelial lesion (4.6%, P <.001) and squamous cell carcinoma (3.3%, P <.001) but not for adenocarcinoma (8.9%, P =.16). Of all the reviews of adenocarcinoma in situ cases, 46.5% were interpreted specifically as adenocarcinoma in situ, compared to 72.2% of reviews of adenocarcinoma, 73.2% of high-grade squamous intraepithelial lesion, and 75.1% of squamous cell carcinoma. No individual case of adenocarcinoma in situ was always specifically recognized as adenocarcinoma in situ; 26.5% of cases of adenocarcinoma were specifically recognized as such in all reviews. Findings were similar with and without the inclusion of high-grade squamous intraepithelial lesion/carcinoma, not otherwise specified, as an acceptable review interpretation for cases of adenocarcinoma, squamous cell carcinoma, and high-grade squamous intraepithelial lesion. CONCLUSION: These data from expert-referenced and biopsy-proven cases suggest that adenocarcinoma in situ is not as easily recognized or categorized as other serious diagnoses.

Type and screen completion for scheduled surgical procedures. A College of American Pathologists Q-Probes study of 8941 type and screen tests in 108 institutions.

CONTEXT: Market-driven changes in the timing of elective surgeries and admissions have introduced barriers to completing pretransfusion testing in a timely manner. Consequently, blood bank personnel may not have adequate time to identify appropriate blood products for scheduled surgeries. Incomplete pretransfusion testing can delay surgery and significantly compromise patient safety. OBJECTIVES: To identify the incidence of avoidable problems associated with obtaining timely samples for adequate pretransfusion type and screen (T&S) testing, to identify the practices and characteristics associated with improved rates of pretransfusion testing completed prior to surgery, and to determine the likelihood of antibody identification problems that affect the availability of blood. DESIGN: Participants in the College of American Pathologists (CAP) Q-Probes laboratory quality improvement program were asked to collect data on when a T&S was collected in anticipation of elective scheduled surgery, when the T&S was completed, when the surgery started, and the results of those T&S tests. Participants also completed questionnaires describing their facilities, procedures, and practices. SETTING AND PARTICIPANTS: One hundred eight public and private institutions participated in this Q-Probes Study, 97% of which were located in the United States. MAIN OUTCOMES MEASURES: Type and screen collection and completion relative to the start of surgery, and the results of those tests. RESULTS: Of the 8941 T&Ss, 64.6% were collected prior to the day of surgery. The median laboratory completed approximately 69% of their T&S testing for scheduled surgeries at least 1 day prior to the surgery. Of those T&S tests that were collected on the day of surgery, the median laboratory completed almost 23% after the start of surgery. For 10% of participants, more than 75% of all T&Ss collected on the same day as surgery were not complete until after the start of surgery. When red blood cell-directed antibodies were identified, 78.7% were considered clinically significant, and 95.2% were alloantibodies. Positive antibody screens were significantly associated with delayed surgery and special efforts needed to obtain blood. Of those institutions with a specific protocol in place to collect T&S samples prior to hospital admission, the median laboratory completed the T&S at least 1 day prior to surgery 74% of the time. When the institution coupled the T&S collection protocol with T&S collection earlier than 3 days prior to surgery, the median laboratory completed the T&S at least 1 day prior to surgery almost 87% of the time. Type and screen collection less than 3 days prior to surgery resulted in special efforts needed to obtain blood more than 1% of the time. Type and screen collected on the same day as surgery directly resulted in a surgery delay 0.8% of the time. CONCLUSIONS: Patients are unnecessarily being placed at risk by inadequate mechanisms to ensure available blood for surgery. All T&Ss were collected for scheduled surgeries with adequate opportunity for a T&S to be completed in advance of the surgery. Specific protocols helped improve the performance in terms of completing the T&S prior to surgery, as did mechanisms that permitted T&S collections in advance of the admission. Type and screen collection time relative to surgery was significantly associated with the incidence of surgery delay due to unavailable blood; the less time between collection and surgery, the less likely blood was available.

Audit of transfusion procedures in 660 hospitals. A College of American Pathologists Q-Probes study of patient identification and vital sign monitoring frequencies in 16494 transfusions.

CONTEXT: Hemolytic transfusion reactions are often the result of failure to follow established identification and monitoring procedures. OBJECTIVE: To measure the frequencies with which health care workers completed specific transfusion procedures required for laboratory and blood bank accreditation. DESIGN: In 2 separate studies, participants in the College of American Pathologists Q-Probes laboratory quality improvement program audited nonemergent red blood cell transfusions prospectively and completed questionnaires profiling their institutions' transfusion policies. SETTING AND PARTICIPANTS: A total of 660 institutions, predominantly in the United States, at which transfusion medicine services are provided. MAIN OUTCOMES MEASURES: The percentages of transfusions for which participants completed 4 specific components of patient and blood unit identifications, and for which participants monitored vital signs at 3 specific intervals during transfusions. RESULTS: In the first study, all components of patient identification procedures were performed in 62.3%, and all required patient vital sign monitoring was performed in 81.6% of 12 448 transfusions audited. The median frequencies with which institutions participating in the first study performed all patient identification and monitoring procedures were 69.0% and 90.2%, respectively. In the second study, all components of patient identification were performed in 25.4% and all patient vital sign monitoring was performed in 88.3% of 4046 transfusions audited. The median frequencies with which institutions participating in the second study performed all patient identification and monitoring procedures were 10.0% and 95.0%, respectively. Individual practices and/or institutional policies associated with greater frequencies of patient identification and/or vital sign monitoring included transporting units of blood directly to patient bedsides, having no more than 1 individual handle blood units in route, checking unit labels against physicians' orders, having patients wear identification tags (wristbands), reading identification information aloud when 2 or more transfusionists participated, using written checklists to guide the administration of blood, instructing health care personnel in transfusion practices, and routinely auditing the administration of transfusions. CONCLUSIONS: In many hospitals, the functions of identification and vital sign monitoring of patients receiving blood transfusions do not meet laboratory and blood bank accreditation standards. Differences in hospital transfusion policies influence how well health care workers comply with standard practices. We would expect that efforts designed to perfect transfusion policies might also improve performance in those hospitals in which practice compliance is substandard.

Q-tracks: a College of American Pathologists program of continuous laboratory monitoring and longitudinal tracking.

CONTEXT: Continuous monitoring of key laboratory indicators of quality by hundreds of laboratories in a standardized measurement program affords an opportunity to document the influence of longitudinal tracking on performance improvement by participants focused on that outcome. OBJECTIVE: To describe the results of the first 2 years of participation in a unique continuous performance assessment program for pathology and laboratory medicine. DESIGN: Participants in any of 6 modules in the 1999 and 2000 College of American Pathologists (CAP) Q-Tracks program collected data according to defined methods and sampling intervals on standardized input forms. Data were submitted quarterly to CAP for statistical analysis. Interinstitutional comparison reports returned in 6 weeks provided each laboratory with its performance profile of key indicators and its percentile ranking compared with all participants in that quarter. This also included longitudinal comparisons of performance during previous cumulative quarters. Control charts graphically displayed data with flags identifying performance points that were out of statistical control. SETTING: Hospital-based laboratories in the United States (98%), Canada, and Australia. PARTICIPANTS: Voluntary subscriber laboratories in the CAP Q-Tracks performance measurement program: roughly 70% from hospitals of 300 occupied beds or fewer, 65% from private, nonprofit institutions, slightly more than half located in cities, one third from teaching hospitals, and 20% with pathology residency training programs. MAIN OUTCOME MEASURES: Each module measured several major and additional minor quality indicators and unbenchmarked individualized data for internal use. RESULTS: Participants in 4 of 6 Q-Tracks continuous monitors demonstrated statistically significant performance improvement trends in 1999 and 2000, which were most marked for laboratories that continued participation throughout both years. These monitors were wristband patient identification, laboratory specimen acceptability, blood product wastage, and intraoperative frozen section consultation. CONCLUSIONS: Key continuous indicators chosen on the basis of a decade's experience in the CAP Q-Probes quality improvement program are useful measurement and benchmarking tools for laboratories to improve performance. In general, measures in which there is a broad range of demonstrable performance initially are most optimal for subsequent improvement using continuous monitoring. These studies have shown that quality is not static, but rather is a moving benchmark of performance as seen in the redefinition of benchmarks over time by participants in the first 2 years of the CAP Q-Tracks program.

Operating room blood delivery turnaround time: a College of American Pathologists Q-Probe Study of 12647 units of blood components in 466 institutions.

OBJECTIVES: To determine the normative distribution of time elapsed for blood bank personnel to fill nonscheduled operating room (OR) blood component orders in hospital communities throughout the United States, and to examine hospital blood bank practices associated with faster blood component delivery times. DESIGN: Participants in the College of American Pathologists Q-Probes laboratory quality improvement program collected data prospectively on the times elapsed for blood bank personnel to fill nonscheduled emergent orders from hospital ORs for red blood cell (RBC) products, fresh frozen plasma (FFP), and platelets (PLTs). Participants also completed questionnaires describing their hospitals' and blood banks' laboratory and transfusion practices. SETTING AND PARTICIPANTS: Four hundred sixty-six public and private institutions located in 48 states in the United States (n = 444), Canada (n = 9), Australia (n = 8), the United Kingdom (n = 4), and Spain (n = 1). MAIN OUTCOME MEASURES: The median time elapsed between requests for blood components by OR personnel and the retrieval of those components by blood component transport personnel, and the median time elapsed between requests for blood components by OR personnel and the arrival of those components in ORs. RESULTS: Participants submitted data on 12 647 units of RBCs, FFP, and PLTs. The median aggregate request-to-retrieval turnaround times (TATs) for RBCs, FFP, and PLTs ranged from 30 to 35 minutes, and the median aggregate request-to-arrival TATs for RBCs, FFP, and PLTs ranged from 33 to 39 minutes. Most of the TAT was consumed by events occurring prior to, rather than after release of components from blood banks. Shorter prerelease TATs were associated with having surgical schedules that listed patients' names and procedures available to blood bank personnel prior to surgeries, and having adequate clotted specimens in the blood bank and completed type-and-screen procedures performed before requests for blood components were submitted to blood banks. Among the fastest-performing 10% of participants (90th percentile and above), request-to-retrieval TATs ranged from 12 to 24 minutes for the 3 blood components, whereas among the slowest-performing 10% of participants (10th percentile and below), request-to-retrieval TATs ranged from 63 to 115 minutes for the 3 components. Median TATs ranged from 33 to 37 minutes for the 3 components. Institutions with TATs in the fastest-performing 25th percentile more frequently stored cross-matched RBCs in the OR daily, stocked PLTs for unexpected surgical use, stored PLTs in or near the OR, and had laboratory rather than nonlaboratory personnel deliver components to the OR than did those institutions with TATs in the slowest-performing 25th percentile. CONCLUSIONS: Hospital blood bank personnel can deliver blood components to the OR in slightly longer than 30 minutes, measured from the time that those units are requested by OR personnel. Practices aimed at saving time before components are released from blood banks will be more efficient in reducing overall TAT than those practices aimed at saving time after components are released from blood banks. Specific practices associated with shorter blood delivery TATs included providing blood bank personnel with access to the names of surgical patients potentially requiring blood components, having pretransfusion testing completed on those patients prior to surgery, having ample blood products on hand, and having laboratory personnel control blood product delivery.