Patterns of red blood cell utilization: Harnessing electronic health records data from the Information Standard for Blood and Transplant (ISBT) 128 system within the Biologics Effectiveness and Safety (BEST) initiative.

BACKGROUND: Current hemovigilance methods generally rely on survey data or administrative claims data utilizing billing and revenue codes, each of which has limitations. We used electronic health records (EHR) linked to blood bank data to comprehensively characterize red blood cell (RBC) utilization patterns and trends in three healthcare systems participating in the U.S. Food and Drug Administration Center for Biologics Evaluation and Research Biologics Effectiveness and Safety (BEST) initiative. METHODS: We used Information Standard for Blood and Transplant (ISBT) 128 codes linked to EHR from three healthcare systems data sources to identify and quantify RBC-transfused individuals, RBC transfusion episodes, transfused RBC units, and processing methods per year during 2012-2018. RESULTS: There were 577,822 RBC units transfused among 112,705 patients comprising 345,373 transfusion episodes between 2012 and 2018. Utilization in terms of RBC units and patients increased slightly in one and decreased slightly in the other two healthcare facilities. About 90% of RBC-transfused patients had 1 (~46%) or 2-5 (~42%)transfusion episodes in 2018. Among the small proportion of patients with ≥12 transfusion episodes per year, approximately 60% of episodes included only one RBC unit. All facilities used leukocyte-reduced RBCs during the study period whereas irradiated RBC utilization patterns differed across facilities. DISCUSSION: ISBT 128 codes and EHRs were used to observe patterns of RBC transfusion and modification methods at the unit level and patient level in three healthcare systems participating in the BEST initiative. This study shows that the ISBT 128 coding system in an EHR environment provides a feasible source for hemovigilance activities.

Keyphrase Identification Using Minimal Labeled Data with Hierarchical Context and Transfer Learning.

Interoperable clinical decision support system (CDSS) rules provide a pathway to interoperability, a well-recognized challenge in health information technology. Building an ontology facilitates creating interoperable CDSS rules, which can be achieved by identifying the keyphrases (KP) from the existing literature. However, KP identification for data labeling requires human expertise, consensus, and contextual understanding. This paper aims to present a semi-supervised KP identification framework using minimal labeled data based on hierarchical attention over the documents and domain adaptation. Our method outperforms the prior neural architectures by learning through synthetic labels for initial training, document-level contextual learning, language modeling, and fine-tuning with limited gold standard label data. To the best of our knowledge, this is the first functional framework for the CDSS sub-domain to identify KPs, which is trained on limited labeled data. It contributes to the general natural language processing (NLP) architectures in areas such as clinical NLP, where manual data labeling is challenging, and light-weighted deep learning models play a role in real-time KP identification as a complementary approach to human experts' effort.

Ontologies Applied in Clinical Decision Support System Rules: Systematic Review.

BACKGROUND: Clinical decision support systems (CDSSs) are important for the quality and safety of health care delivery. Although CDSS rules guide CDSS behavior, they are not routinely shared and reused. OBJECTIVE: Ontologies have the potential to promote the reuse of CDSS rules. Therefore, we systematically screened the literature to elaborate on the current status of ontologies applied in CDSS rules, such as rule management, which uses captured CDSS rule usage data and user feedback data to tailor CDSS services to be more accurate, and maintenance, which updates CDSS rules. Through this systematic literature review, we aim to identify the frontiers of ontologies used in CDSS rules. METHODS: The literature search was focused on the intersection of ontologies; clinical decision support; and rules in PubMed, the Association for Computing Machinery (ACM) Digital Library, and the Nursing & Allied Health Database. Grounded theory and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines were followed. One author initiated the screening and literature review, while 2 authors validated the processes and results independently. The inclusion and exclusion criteria were developed and refined iteratively. RESULTS: CDSSs were primarily used to manage chronic conditions, alerts for medication prescriptions, reminders for immunizations and preventive services, diagnoses, and treatment recommendations among 81 included publications. The CDSS rules were presented in Semantic Web Rule Language, Jess, or Jena formats. Despite the fact that ontologies have been used to provide medical knowledge, CDSS rules, and terminologies, they have not been used in CDSS rule management or to facilitate the reuse of CDSS rules. CONCLUSIONS: Ontologies have been used to organize and represent medical knowledge, controlled vocabularies, and the content of CDSS rules. So far, there has been little reuse of CDSS rules. More work is needed to improve the reusability and interoperability of CDSS rules. This review identified and described the ontologies that, despite their limitations, enable Semantic Web technologies and their applications in CDSS rules.

A Systematic Approach to Configuring MetaMap for Optimal Performance.

BACKGROUND: MetaMap is a valuable tool for processing biomedical texts to identify concepts. Although MetaMap is highly configurative, configuration decisions are not straightforward. OBJECTIVE: To develop a systematic, data-driven methodology for configuring MetaMap for optimal performance. METHODS: MetaMap, the word2vec model, and the phrase model were used to build a pipeline. For unsupervised training, the phrase and word2vec models used abstracts related to clinical decision support as input. During testing, MetaMap was configured with the default option, one behavior option, and two behavior options. For each configuration, cosine and soft cosine similarity scores between identified entities and gold-standard terms were computed for 40 annotated abstracts (422 sentences). The similarity scores were used to calculate and compare the overall percentages of exact matches, similar matches, and missing gold-standard terms among the abstracts for each configuration. The results were manually spot-checked. The precision, recall, and F-measure (ß =1) were calculated. RESULTS: The percentages of exact matches and missing gold-standard terms were 0.6-0.79 and 0.09-0.3 for one behavior option, and 0.56-0.8 and 0.09-0.3 for two behavior options, respectively. The percentages of exact matches and missing terms for soft cosine similarity scores exceeded those for cosine similarity scores. The average precision, recall, and F-measure were 0.59, 0.82, and 0.68 for exact matches, and 1.00, 0.53, and 0.69 for missing terms, respectively. CONCLUSION: We demonstrated a systematic approach that provides objective and accurate evidence guiding MetaMap configurations for optimizing performance. Combining objective evidence and the current practice of using principles, experience, and intuitions outperforms a single strategy in MetaMap configurations. Our methodology, reference codes, measurements, results, and workflow are valuable references for optimizing and configuring MetaMap.

Enhancing narrative clinical guidance with computer-readable artifacts: Authoring FHIR implementation guides based on WHO recommendations.

INTRODUCTION: Narrative clinical guidelines often contain assumptions, knowledge gaps, and ambiguities that make translation into an electronic computable format difficult. This can lead to divergence in electronic implementations, reducing the usefulness of collected data outside of that implementation setting. This work set out to evolve guidelines-based data dictionaries by mapping to HL7 Fast Health Interoperability Resources (FHIR) and semantic terminology, thus progressing toward machine-readable guidelines that define the minimum data set required to support family planning and sexually transmitted infections. MATERIAL AND METHODS: The data dictionaries were first structured to facilitate mapping to FHIR and semantic terminologies, including ICD-10, SNOMED-CT, LOINC, and RxNorm. FHIR resources and codes were assigned to data dictionary terms. The data dictionary and mappings were used as inputs for a newly developed tool to generate FHIR implementation guides. RESULTS: Implementation guides for core data requirements for family planning and sexually transmitted infections were created. These implementation guides display data dictionary content as FHIR resources and semantic terminology codes. Challenges included the use of a two-dimensional spreadsheet to facilitate mapping, the need to create FHIR profiles and resource extensions, and applying FHIR to a data dictionary that was created with a user interface in mind. CONCLUSIONS: Authoring FHIR implementation guides is a complex and evolving practice, and there are limited examples for this groundbreaking work. Moving toward machine-readable guidelines by mapping to FHIR and semantic terminologies requires a thorough understanding of the context and use of terminology, an applied information model, and other strategies for optimizing the creation and long-term management of implementation guides. Next steps for this work include validation and, eventually, real-world application. The process for creating the data dictionary and for generating implementation guides should also be improved to prepare for this expanding work. FUNDING: This work was supported by the World Health Organization, which also worked as a collaborative partner throughout the study.

Envisioning health equity for American Indian/Alaska Natives: a unique HIT opportunity.

The Indian Health Service provides care to remote and under-resourced communities in the United States. American Indian/Alaska Native patients have some of the highest morbidity and mortality among any ethnic group in the United States. Starting in the 1980s, the IHS implemented the Resource and Patient Management System health information technology (HIT) platform to improve efficiency and quality to address these disparities. The IHS is currently assessing the Resource and Patient Management System to ensure that changing health information needs are met. HIT assessments have traditionally focused on cost, reimbursement opportunities, infrastructure, required or desired functionality, and the ability to meet provider needs. Little information exists on frameworks that assess HIT legacy systems to determine solutions for an integrated rural healthcare system whose end goal is health equity. This search for a next-generation HIT solution for a historically underserved population presents a unique opportunity to envision and redefine HIT that supports health equity as its core mission.

Identification of Patients in Need of Advanced Care for Depression Using Data Extracted From a Statewide Health Information Exchange: A Machine Learning Approach.

BACKGROUND: As the most commonly occurring form of mental illness worldwide, depression poses significant health and economic burdens to both the individual and community. Different types of depression pose different levels of risk. Individuals who suffer from mild forms of depression may recover without any assistance or be effectively managed by primary care or family practitioners. However, other forms of depression are far more severe and require advanced care by certified mental health providers. However, identifying cases of depression that require advanced care may be challenging to primary care providers and health care team members whose skill sets run broad rather than deep. OBJECTIVE: This study aimed to leverage a comprehensive range of patient-level diagnostic, behavioral, and demographic data, as well as past visit history data from a statewide health information exchange to build decision models capable of predicting the need of advanced care for depression across patients presenting at Eskenazi Health, the public safety net health system for Marion County, Indianapolis, Indiana. METHODS: Patient-level diagnostic, behavioral, demographic, and past visit history data extracted from structured datasets were merged with outcome variables extracted from unstructured free-text datasets and were used to train random forest decision models that predicted the need of advanced care for depression across (1) the overall patient population and (2) various subsets of patients at higher risk for depression-related adverse events; patients with a past diagnosis of depression; patients with a Charlson comorbidity index of ≥1; patients with a Charlson comorbidity index of ≥2; and all unique patients identified across the 3 above-mentioned high-risk groups. RESULTS: The overall patient population consisted of 84,317 adult (aged ≥18 years) patients. A total of 6992 (8.29%) of these patients were in need of advanced care for depression. Decision models for high-risk patient groups yielded area under the curve (AUC) scores between 86.31% and 94.43%. The decision model for the overall patient population yielded a comparatively lower AUC score of 78.87%. The variance of optimal sensitivity and specificity for all decision models, as identified using Youden J Index, is as follows: sensitivity=68.79% to 83.91% and specificity=76.03% to 92.18%. CONCLUSIONS: This study demonstrates the ability to automate screening for patients in need of advanced care for depression across (1) an overall patient population or (2) various high-risk patient groups using structured datasets covering acute and chronic conditions, patient demographics, behaviors, and past visit history. Furthermore, these results show considerable potential to enable preventative care and can be easily integrated into existing clinical workflows to improve access to wraparound health care services.

Pediatric decision support using adapted Arden Syntax.

BACKGROUND: Pediatric guidelines based care is often overlooked because of the constraints of a typical office visit and the sheer number of guidelines that may exist for a patient's visit. In response to this problem, in 2004 we developed a pediatric computer based clinical decision support system using Arden Syntax medical logic modules (MLM). METHODS: The Child Health Improvement through Computer Automation system (CHICA) screens patient families in the waiting room and alerts the physician in the exam room. Here we describe adaptation of Arden Syntax to support production and consumption of patient specific tailored documents for every clinical encounter in CHICA and describe the experiments that demonstrate the effectiveness of this system. RESULTS: As of this writing CHICA has served over 44,000 patients at 7 pediatric clinics in our healthcare system in the last decade and its MLMs have been fired 6182,700 times in "produce" and 5334,021 times in "consume" mode. It has run continuously for over 10 years and has been used by 755 physicians, residents, fellows, nurse practitioners, nurses and clinical staff. There are 429 MLMs implemented in CHICA, using the Arden Syntax standard. Studies of CHICA's effectiveness include several published randomized controlled trials. CONCLUSIONS: Our results show that the Arden Syntax standard provided us with an effective way to represent pediatric guidelines for use in routine care. We only required minor modifications to the standard to support our clinical workflow. Additionally, Arden Syntax implementation in CHICA facilitated the study of many pediatric guidelines in real clinical environments.

An Incremental Adoption Pathway for Developing Precision Medicine Based Healthcare Infrastructure for Underserved Settings.

Recent focus on Precision medicine (PM) has led to a flurry of research activities across the developed world. But how can understaffed and underfunded health care systems in the US and elsewhere evolve to adapt PM to address pressing healthcare needs? We offer guidance on a wide range of sources of healthcare data / knowledge as well as other infrastructure / tools that could inform PM initiatives, and may serve as low hanging fruit easily adapted on the incremental pathway towards a PM based healthcare system. Using these resources and tools, we propose an incremental adoption pathway to inform implementers working in underserved communities around the world on how they should position themselves to gradually embrace the concepts of PM with minimal interruption to existing care delivery.

Enabling Better Interoperability for HealthCare: Lessons in Developing a Standards Based Application Programing Interface for Electronic Medical Record Systems.

We sought to enable better interoperability and easy adoption of healthcare applications by developing a standardized domain independent Application Programming Interface (API) for an Electronic Medical Record (EMR) system. We leveraged the modular architecture of the Open Medical Record System (OpenMRS) to build a Fast Healthcare Interoperability Resources (FHIR) based add-on module that could consume FHIR resources and requests made on OpenMRS. The OpenMRS FHIR module supports a subset of FHIR resources that could be used to interact with clinical data persisted in OpenMRS. We demonstrate the ease of connecting healthcare applications using the FHIR API by integrating a third party Substitutable Medical Apps & Reusable Technology (SMART) application with OpenMRS via FHIR. The OpenMRS FHIR module is an optional component of the OpenMRS platform. The FHIR API significantly reduces the effort required to implement OpenMRS by preventing developers from having to learn or work with a domain specific OpenMRS API. We propose an integration pathway where the domain specific legacy OpenMRS API is gradually retired in favor of the new FHIR API, which would be integrated into the core OpenMRS platform. Our efforts indicate that a domain independent API is a reality for any EMR system. These efforts demonstrate the adoption of an emerging FHIR standard that is seen as a replacement for both Health Level 7 (HL7) Version 2 and Version 3. We propose a gradual integration approach where our FHIR API becomes the preferred method for communicating with the OpenMRS platform.

Towards Standardized Patient Data Exchange: Integrating a FHIR Based API for the Open Medical Record System.

Interoperability is essential to address limitations caused by the ad hoc implementation of clinical information systems and the distributed nature of modern medical care. The HL7 V2 and V3 standards have played a significant role in ensuring interoperability for healthcare. FHIR is a next generation standard created to address fundamental limitations in HL7 V2 and V3. FHIR is particularly relevant to OpenMRS, an Open Source Medical Record System widely used across emerging economies. FHIR has the potential to allow OpenMRS to move away from a bespoke, application specific API to a standards based API. We describe efforts to design and implement a FHIR based API for the OpenMRS platform. Lessons learned from this effort were used to define long term plans to transition from the legacy OpenMRS API to a FHIR based API that greatly reduces the learning curve for developers and helps enhance adhernce to standards.

Do clinical decision-support reminders for medical providers improve isoniazid preventative therapy prescription rates among HIV-positive adults? Study protocol for a randomized controlled trial.

BACKGROUND: This document describes a research protocol for a study designed to estimate the impact of implementing a reminder system for medical providers on the use of isoniazid preventative therapy (IPT) for adults living with HIV in western Kenya. People living with HIV have a 5% to 10% annual risk of developing active tuberculosis (TB) once infected with TB bacilli, compared to a 5% lifetime risk in HIV-negative people with latent TB infection. Moreover, people living with HIV have a 20-fold higher risk of dying from TB. A growing body of literature suggests that IPT reduces overall TB incidence and is therefore of considerable benefit to patients and the larger community. However, in 2009, of the estimated 33 million people living with HIV, only 1.7 million (5%) were screened for TB, and about 85,000 (0.2%) were offered IPT. METHODS/DESIGN: This study will examine the use of clinical decision-support reminders to improve rates of initiation of preventative treatment in a TB/HIV co-morbid population living in a TB endemic area. This will be a pragmatic, parallel-group, cluster-randomized superiority trial with a 1:1 allocation to treatment ratio. For the trial, 20 public medical facilities that use clinical summary sheets generated from an electronic medical records system will participate as clusters. All HIV-positive adult patients who complete an initial encounter at a study cluster and at least one return encounter during the study period will be included in the study cohort. The primary endpoint will be IPT prescription at 3 months post the initial encounter. We will conduct both individual-level and cluster-level analyses. Due to the nature of the intervention, the trial will not be blinded. This study will contribute to the growing evidence base for the use of electronic health interventions in low-resource settings to promote high-quality clinical care, health system optimization and positive patient outcomes. Trial registration ClinicalTrials.gov NCT01934309, registered 29 August 2013.

A clinical decision support system for integrating tuberculosis and HIV care in Kenya: a human-centered design approach.

With the aim of integrating HIV and tuberculosis care in rural Kenya, a team of researchers, clinicians, and technologists used the human-centered design approach to facilitate design, development, and deployment processes of new patient-specific TB clinical decision support system for medical providers. In Kenya, approximately 1.6 million people are living with HIV and have a 20-times higher risk of dying of tuberculosis. Although tuberculosis prevention and treatment medication is widely available, proven to save lives, and prioritized by the World Health Organization, ensuring that it reaches the most vulnerable communities remains challenging. Human-centered design, used in the fields of industrial design and information technology for decades, is an approach to improving the effectiveness and impact of innovations that has been scarcely used in the health field. Using this approach, our team followed a 3-step process, involving mixed methods assessment to (1) understand the situation through the collection and analysis of site observation sessions and key informant interviews; (2) develop a new clinical decision support system through iterative prototyping, end-user engagement, and usability testing; and, (3) implement and evaluate the system across 24 clinics in rural West Kenya. Through the application of this approach, we found that human-centered design facilitated the process of digital innovation in a complex and resource-constrained context.

An Evaluation of Two Methods for Generating Synthetic HL7 Segments Reflecting Real-World Health Information Exchange Transactions.

Motivated by the need for readily available data for testing an open-source health information exchange platform, we developed and evaluated two methods for generating synthetic messages. The methods used HL7 version 2 messages obtained from the Indiana Network for Patient Care. Data from both methods were analyzed to assess how effectively the output reflected original 'real-world' data. The Markov Chain method (MCM) used an algorithm based on transitional probability matrix while the Music Box model (MBM) randomly selected messages of particular trigger type from the original data to generate new messages. The MBM was faster, generated shorter messages and exhibited less variation in message length. The MCM required more computational power, generated longer messages with more message length variability. Both methods exhibited adequate coverage, producing a high proportion of messages consistent with original messages. Both methods yielded similar rates of valid messages.

A randomized controlled trial of screening for maternal depression with a clinical decision support system.

OBJECTIVE: To determine if automated screening and just in time delivery of testing and referral materials at the point of care promotes universal screening referral rates for maternal depression. METHODS: The Child Health Improvement through Computer Automation (CHICA) system is a decision support and electronic medical record system used in our pediatric clinics. All families of patients up to 15 months of age seen between October 2007 and July 2009 were randomized to one of three groups: (1) screening questions printed on prescreener forms (PSF) completed by mothers in the waiting room with physician alerts for positive screens, (2) everything in (1) plus 'just in time' (JIT) printed materials to aid physicians, and (3) a control group where physicians were simply reminded to screen on printed physician worksheets. RESULTS: The main outcome of interest was whether physicians suspected a diagnosis of maternal depression and referred a mother for assistance. This occurred significantly more often in both the PSF (2.4%) and JIT groups (2.4%) than in the control group (1.2%) (OR 2.06, 95% CI 1.08 to 3.93). Compared to the control group, more mothers were noted to have depressed mood in the PSF (OR 7.93, 95% CI 4.51 to 13.96) and JIT groups (OR 8.10, 95% CI 4.61 to 14.25). Similarly, compared to the control group, more mothers had signs of anhedonia in the PSF (OR 12.58, 95% CI 5.03 to 31.46) and JIT groups (OR 13.03, 95% CI 5.21 to 32.54). CONCLUSIONS: Clinical decision support systems like CHICA can improve the screening of maternal depression.

The effect of electronic medical record-based clinical decision support on HIV care in resource-constrained settings: a systematic review.

BACKGROUND: It is estimated that one million people infected with HIV initiate anti-retroviral therapy (ART) in resource-constrained countries annually. This occurs against a background of overburdened health workers with limited skills to handle rapidly changing treatment standards and guidelines hence compromising quality of care. Electronic medical record (EMR)-based clinical decision support systems (CDSS) are considered a solution to improve quality of care. Little evidence, however, exists on the effectiveness of EMR-based CDSS on quality of HIV care and treatment in resource-constrained settings. OBJECTIVE: The aim of this systematic review was to identify original studies on EMR-based CDSS describing process and outcome measures as well as reported barriers to their implementation in resource-constrained settings. We characterized the studies by guideline adherence, data and process, and barriers to CDSS implementation. METHODS: Two reviewers independently assessed original articles from a search of the MEDLINE, EMBASE, CINAHL and Global Health Library databases until January 2012. The included articles were those that evaluated or described the implementation of EMR-based CDSS that were used in HIV care in low-income countries. RESULTS: A total of 12 studies met the inclusion criteria, 10 of which were conducted in sub-Saharan Africa and 2 in the Caribbean. None of the papers described a strong (randomized controlled) evaluation design. Guideline adherence: One study showed that ordering rates for CD4 tests were significantly higher when reminders were used. Data and process: Studies reported reduction in data errors, reduction in missed appointments, reduction in missed CD4 results and reduction in patient waiting time. Two studies showed a significant increase in time spent by clinicians on direct patient care. Barriers to CDSS implementation: Technical infrastructure problems such as unreliable electric power and erratic Internet connectivity, clinicians' limited computer skills and failure by providers to comply with the reminders are key impediments to the implementation and effective use of CDSS. CONCLUSION: The limited number of evaluation studies, the basic and heterogeneous study designs, and varied outcome measures make it difficult to meaningfully conclude on the effectiveness of CDSS on quality of HIV care and treatment in resource-limited settings. High quality evaluation studies are needed. Factors specific to implementation of EMR-based CDSS in resource-limited setting should be addressed before such countries can demonstrate its full benefits. More work needs to be done to overcome the barriers to EMR and CDSS implementation in developing countries such as technical infrastructure and care providers' computer illiteracy. However, simultaneously evaluating and describing CDSS implementation strategies that work can further guide wise investments in their wider rollout.

OpenMRS, a global medical records system collaborative: factors influencing successful implementation.

OpenMRS is an open-source, robust electronic health record (EHR) platform that is supported by a large global network and used in over forty countries. We explored what factors lead to successful implementation of OpenMRS in resource constrained settings. Data sources included in-person and telephone key informant interviews, focus groups and responses to an electronic survey from 10 sites in 7 countries. Qualitative data was coded through independent coding, discussion and consensus. The most common perceived benefits of implementation were for providing clinical care, reporting to funders, managing operations and research. Successful implementation factors include securing adequate infrastructure, and sociotechnical system factors, particularly adequate staffing, computers, and ability to use software. Strategic and tactical planning were successful strategies, including understanding and addressing the infrastructure and human costs involved, training or hiring personnel technically capable of modifying the software and integrating it into the daily work flow to meet clinicians' needs.

Targeted screening for pediatric conditions with the CHICA system.

OBJECTIVE: The Child Health Improvement through Computer Automation (CHICA) system is a decision-support and electronic-medical-record system for pediatric health maintenance and disease management. The purpose of this study was to explore CHICA's ability to screen patients for disorders that have validated screening criteria--specifically tuberculosis (TB) and iron-deficiency anemia. DESIGN: Children between 0 and 11 years were randomized by the CHICA system. In the intervention group, parents were asked about TB and iron-deficiency risk, and physicians received a tailored prompt. In the control group, no screens were performed, and the physician received a generic prompt about these disorders. RESULTS: 1123 participants were randomized to the control group and 1116 participants to the intervention group. Significantly more people reported positive risk factors for iron-deficiency anemia in the intervention group (17.5% vs 3.1%, OR 6.6, 95% CI 4.5 to 9.5). In general, far fewer parents reported risk factors for TB than for iron-deficiency anemia. Again, there were significantly higher detection rates of positive risk factors in the intervention group (1.8% vs 0.8%, OR 2.3, 95% CI 1.0 to 5.0). LIMITATIONS: It is possible that there may be more positive screens without improving outcomes. However, the guidelines are based on studies that have evaluated the questions the authors used as sensitive and specific, and there is no reason to believe that parents misunderstood them. CONCLUSIONS: Many screening tests are risk-based, not universal, leaving physicians to determine who should have a further workup. This can be a time-consuming process. The authors demonstrated that the CHICA system performs well in assessing risk automatically for TB and iron-deficiency anemia.

Evaluation of computer-generated reminders to improve CD4 laboratory monitoring in sub-Saharan Africa: a prospective comparative study.

OBJECTIVE: Little evidence exists on effective interventions to integrate HIV-care guidelines into practices within developing countries. This study tested the hypothesis that clinical summaries with computer-generated reminders could improve clinicians' compliance with CD4 testing guidelines in the resource-limited setting of sub-Saharan Africa. DESIGN: A prospective comparative study of two randomly selected outpatient adult HIV clinics in western Kenya. Printed summaries with reminders for overdue CD4 tests were made available to clinicians in the intervention clinic but not in the control clinic. MEASUREMENTS: Changes in order rates for overdue CD4 tests were compared between and within the two clinics. RESULTS: The computerized reminder system identified 717 encounters (21%) with overdue CD4 tests. Analysis by study assignment (regardless of summaries being printed or not) revealed that with computer-generated reminders, CD4 order rates were significantly higher in the intervention clinic compared to the control clinic (53% vs 38%, OR = 1.80, CI 1.34 to 2.42, p < 0.0001). When comparison was restricted to encounters where summaries with reminders were printed, order rates in intervention clinic were even higher (63%). The intervention clinic increased CD4 ordering from 42% before reminders to 63% with reminders (50% increase, OR = 2.32, CI 1.67 to 3.22, p < 0.0001), compared to control clinic with only 8% increase from prestudy baseline (CI 0.83 to 1.46, p = 0.51). Limitations Evaluation was conducted at two clinics in a single institution. CONCLUSIONS: Clinical summaries with computer-generated reminders significantly improved clinician compliance with CD4 testing guidelines in the resource-limited setting of sub-Saharan Africa. This technology can have broad applicability to improve quality of HIV care in these settings.