The Use and Effectiveness of an Online Diagnostic Support System for Blood Film Interpretation: Comparative Observational Study.

BACKGROUND: The recognition and interpretation of abnormal blood cell morphology is often the first step in diagnosing underlying serious systemic illness or leukemia. Supporting the staff who interpret blood film morphology is therefore essential for a safe laboratory service. This paper describes an open-access, web-based decision support tool, developed by the authors to support morphological diagnosis, arising from earlier studies identifying mechanisms of error in blood film reporting. The effectiveness of this intervention was assessed using the unique resource offered by the online digital morphology Continuing Professional Development scheme (DM scheme) offered by the UK National External Quality Assessment Service for Haematology, with more than 3000 registered users. This allowed the effectiveness of decision support to be tested within a defined user group, each of whom viewed and interpreted the morphology of identical digital blood films. OBJECTIVE: The primary objective of the study was to test the effectiveness of the decision support system in supporting users to identify and interpret abnormal morphological features. The secondary objective was to determine the pattern and frequency of use of the system for different case types, and to determine how users perceived the support in terms of their confidence in decision-making. METHODS: This was a comparative study of identical blood films evaluated either with or without decision support. Selected earlier cases from the DM scheme were rereleased as new cases but with decision support made available; this allowed a comparison of data sets for identical cases with or without decision support. To address the primary objectives, the study used quantitative evaluation and statistical comparisons of the identification and interpretation of morphological features between the two different case releases. To address the secondary objective, the use of decision support was assessed using web analytical tools, while a questionnaire was used to assess user perceptions of the system. RESULTS: Cases evaluated with the aid of decision support had significantly improved accuracy of identification for relevant morphological features (mean improvement 9.8%) and the interpretation of those features (mean improvement 11%). The improvement was particularly significant for cases with higher complexity or for rarer diagnoses. Analysis of website usage demonstrated a high frequency of access for web pages relevant to each case (mean 9298 for each case, range 2661-24,276). Users reported that the decision support website increased their confidence for feature identification (4.8/5) and interpretation (4.3/5), both within the context of training (4.6/5) and also in their wider laboratory practice (4.4/5). CONCLUSIONS: The findings of this study demonstrate that directed online decision support for blood morphology evaluation improves accuracy and confidence in the context of educational evaluation of digital films, with effectiveness potentially extending to wider laboratory use.

Web-Based Virtual Microscopy of Digitized Blood Slides for Malaria Diagnosis: An Effective Tool for Skills Assessment in Different Countries and Environments.

BACKGROUND: Morphological examination of blood films remains the reference standard for malaria diagnosis. Supporting the skills required to make an accurate morphological diagnosis is therefore essential. However, providing support across different countries and environments is a substantial challenge. OBJECTIVE: This paper reports a scheme supplying digital slides of malaria-infected blood within an Internet-based virtual microscope environment to users with different access to training and computing facilities. The feasibility of the approach was established, allowing users to test, record, and compare their own performance with that of other users. METHODS: From Giemsa stained thick and thin blood films, 56 large high-resolution digital slides were prepared, using high-quality image capture and 63x oil-immersion objective lens. The individual images were combined using the photomerge function of Adobe Photoshop and then adjusted to ensure resolution and reproduction of essential diagnostic features. Web delivery employed the Digital Slidebox platform allowing digital microscope viewing facilities and image annotation with data gathering from participants. RESULTS: Engagement was high with images viewed by 38 participants in five countries in a range of environments and a mean completion rate of 42/56 cases. The rate of parasite detection was 78% and accuracy of species identification was 53%, which was comparable with results of similar studies using glass slides. Data collection allowed users to compare performance with other users over time or for each individual case. CONCLUSIONS: Overall, these results demonstrate that users worldwide can effectively engage with the system in a range of environments, with the potential to enhance personal performance through education, external quality assessment, and personal professional development, especially in regions where educational resources are difficult to access.

A diagnostic evaluation of single screen testing for malaria in the returning traveler: A large retrospective cohort study.

BACKGROUND: Screening for malaria in the returning traveler has often required repeat testing; however, audit data suggest that patients have not been reattending. We sought to ascertain if this was safe by examining the diagnostic efficacy of a single screen consisting of a rapid diagnostic test (RDT) and a thin film. METHODS: We conducted a retrospective cohort study of patients with suspected malaria who attended in the past 5 years from two large teaching hospitals. We assessed the diagnostic accuracy of a single screen, reporting measures of sensitivity and specificity. To establish a reference standard, we cross-linked data with the national malaria registry held at Public Health England and regional centers. RESULTS: The cohort consisted of 1365 patients, of whom 33 opted out of the research and one did not have a complete initial screen. Of those 1331 screens there were 74 cases of Plasmodium falciparum (prevalence of 5.6%) and 104 of any malaria species (prevalence of 7.8%). Sensitivity for the detection of P. falciparum was 100.00% (95% confidence interval [CI] = 95.1 to 100), with a specificity of 99.4% (95% CI = 98.9 to 99.8). For the detection of any species of malaria the sensitivity was slightly lower due to the presence of one false negative; sensitivity was 99.0% (95% CI = 94.8 to 100) and specificity was 99.5% (95% CI = 98.9 to 99.8). CONCLUSIONS: A single thin film and RDT is likely to be sufficient as a first screen for falciparum malaria in the returning traveler with important caveats. For those sent home from emergency departments, appropriate safety netting must be provided. Further prospective study is required to investigate this approach.

Do We Know Why We Make Errors in Morphological Diagnosis? An Analysis of Approach and Decision-Making in Haematological Morphology.

BACKGROUND: The laboratory interpretation of blood film morphology is frequently a rapid, accurate, and cost-effective final-stage of blood count analysis. However, the interpretation of findings often rests with a single individual, and errors can carry significant impact. Cell identification and classification skills are well supported by existing resources, but the contribution and importance of other skills are less well understood. METHODS: The UK external quality assurance group in haematology (UK NEQAS(H)) runs a Continued Professional Development scheme where large digital-images of abnormal blood smears are presented using a web-based virtual microscope. Each case is answered by more than 800 individuals. Morphological feature selection and prioritisation, as well as diagnosis and proposed action, are recorded. We analysed the responses of participants, aiming to identify successful strategies as well as sources of error. FINDINGS: The approach to assessment by participants depended on the affected cell type, case complexity or skills of the morphologist. For cases with few morphological abnormalities, we found that accurate cell identification and classification were the principle requirements for success. For more complex films however, feature recognition and prioritisation had primary importance. Additionally however, we found that participants employed a range of heuristic techniques to support their assessment, leading to associated bias and error. INTERPRETATION: A wide range of skills together allow successful morphological assessment and the complexity of this process is not always understood or recognised. Heuristic techniques are widely employed to support or reinforce primary observations and to simplify complex findings. These approaches are effective and are integral to assessment; however they may also be a source of bias or error. Improving outcomes and supporting diagnosis require the development of decision-support mechanisms that identify and support the benefits of heuristic strategies while identifying or avoiding associated biases. FUNDING: The CPD scheme is funded by participant subscription.