Human-Centered Design of a Clinical Decision Support for Anemia Screening in Children with Inflammatory Bowel Disease.

BACKGROUND: Inflammatory bowel disease (IBD) commonly leads to iron deficiency anemia (IDA). Rates of screening and treatment of IDA are often low. A clinical decision support system (CDSS) embedded in an electronic health record could improve adherence to evidence-based care. Rates of CDSS adoption are often low due to poor usability and fit with work processes. One solution is to use human-centered design (HCD), which designs CDSS based on identified user needs and context of use and evaluates prototypes for usefulness and usability. OBJECTIVES: this study aimed to use HCD to design a CDSS tool called the IBD Anemia Diagnosis Tool, IADx. METHODS: Interviews with IBD practitioners informed creation of a process map of anemia care that was used by an interdisciplinary team that used HCD principles to create a prototype CDSS. The prototype was iteratively tested with "Think Aloud" usability evaluation with clinicians as well as semi-structured interviews, a survey, and observations. Feedback was coded and informed redesign. RESULTS: Process mapping showed that IADx should function at in-person encounters and asynchronous laboratory review. Clinicians desired full automation of clinical information acquisition such as laboratory trends and analysis such as calculation of iron deficit, less automation of clinical decision selection such as laboratory ordering, and no automation of action implementation such as signing medication orders. Providers preferred an interruptive alert over a noninterruptive reminder. CONCLUSION: Providers preferred an interruptive alert, perhaps due to the low likelihood of noticing a noninterruptive advisory. High levels of desire for automation of information acquisition and analysis with less automation of decision selection and action may be generalizable to other CDSSs designed for chronic disease management. This underlines the ways in which CDSSs have the potential to augment rather than replace provider cognitive work.

Night eating, weight, and health behaviors in adults participating in the Daily24 study.

BACKGROUND: Night eating syndrome (NES) is associated with adverse health outcomes. This study evaluated the relationship between night eating severity, weight, and health behaviors. METHODS: Participants (N = 1017; 77.6% female, mean Body Mass Index (BMI) = 30.5, SD = 7.8 kg/m2, age = 51.1, SD = 15.0 years) were recruited from three health systems. Participants completed the Night Eating Questionnaire (NEQ) and questionnaires assessing sleep, chronotype, physical activity, diet, weight, and napping. RESULTS: In the overall sample, higher NEQ scores were associated with higher BMI (p < .001) and consumption of sugar-sweetened beverages (p < .001), as well as lower fruit/vegetable consumption (p = .001). Higher NEQ scores were associated with increased odds of having overweight/obesity (p < .001), eating fast food (p < .001), moderate-vigorous physical activity (p = .005), and smoking (p = .004). Participants who exceeded the screening threshold for NES (n = 48, 4.7%) reported elevated BMI (p = .014), an increased likelihood of overweight/obesity (p = .004), greater sugar-sweetened beverages consumption (p < .001), napping less than twice per week (p = .029), shorter sleep duration (p = .012), and a later chronotype (M = 4:55, SD = 2:45). CONCLUSION: Night eating severity was associated with obesity and intake of fast food and sugar-sweetened beverages. Interventions to address night eating and associated behaviors may enhance the efficacy of weight management interventions and promote engagement in positive health behaviors.

Cost-effectiveness of Autonomous Point-of-Care Diabetic Retinopathy Screening for Pediatric Patients With Diabetes.

Importance: Screening for diabetic retinopathy is recommended for children with type 1 diabetes (T1D) and type 2 diabetes (T2D), yet screening rates remain low. Point-of-care diabetic retinopathy screening using autonomous artificial intelligence (AI) has become available, providing immediate results in the clinic setting, but the cost-effectiveness of this strategy compared with standard examination is unknown. Objective: To assess the cost-effectiveness of detecting and treating diabetic retinopathy and its sequelae among children with T1D and T2D using AI diabetic retinopathy screening vs standard screening by an eye care professional (ECP). Design, Setting, and Participants: In this economic evaluation, parameter estimates were obtained from the literature from 1994 to 2019 and assessed from March 2019 to January 2020. Parameters included out-of-pocket cost for autonomous AI screening, ophthalmology visits, and treating diabetic retinopathy; probability of undergoing standard retinal examination; relative odds of undergoing screening; and sensitivity, specificity, and diagnosability of the ECP screening examination and autonomous AI screening. Main Outcomes and Measures: Costs or savings to the patient based on mean patient payment for diabetic retinopathy screening examination and cost-effectiveness based on costs or savings associated with the number of true-positive results identified by diabetic retinopathy screening. Results: In this study, the expected true-positive proportions for standard ophthalmologic screening by an ECP were 0.006 for T1D and 0.01 for T2D, and the expected true-positive proportions for autonomous AI were 0.03 for T1D and 0.04 for T2D. The base case scenario of 20% adherence estimated that use of autonomous AI would result in a higher mean patient payment ($8.52 for T1D and $10.85 for T2D) than conventional ECP screening ($7.91 for T1D and $8.20 for T2D). However, autonomous AI screening was the preferred strategy when at least 23% of patients adhered to diabetic retinopathy screening. Conclusions and Relevance: These results suggest that point-of-care diabetic retinopathy screening using autonomous AI systems is effective and cost saving for children with diabetes and their caregivers at recommended adherence rates.

Understanding Primary Care Patients' Self-weighing Habits: Cohort Analysis from the PaTH Clinical Data Research Network.

BACKGROUND: Greater than 60% of adults have overweight or obesity. Self-weighing is an effective weight loss and weight maintenance tool. However, little is known about self-weighing habits among the primary care patient population. Our objective was to examine the frequency of patient-reported self-weighing, and to evaluate the associations of self-weighing with demographic characteristics and self-monitoring behaviors. METHODS: We conducted an analysis of survey data collected as part of the PaTH Clinical Data Research Network, which recruited a cohort of 1,021 primary care patients at 4 academic medical centers. Patients of all body mass index (BMI) categories were included. RESULTS: Response rate of 6-month survey was 727 (71%). The mean age was 56 years, and most were female (68%), White (78%), college graduates (66%), and employed/retired (85%). The mean BMI was 30.2 kg/m2, 80% of participants had a BMI â‰§ 25 kg/m2. Of patients with BMI â‰§ 25 kg/m2, 35% of participants self-weighed weekly and 23% daily. Participants who reported self-weighing at least weekly were more likely to be older (59 vs 54 years, p < 0.01), married (p = 0.01), college graduates (p = 0.03), White (p < 0.01), and employed vs disabled/unemployed (p < 0.01). Patients who self-weighed daily had a lower BMI (29 kg/m2 vs 31 kg/m2, p = 0.04). Patients who tracked exercise or food intake were more likely to self-weigh daily (p < 0.01), as were patients wanting to lose or maintain weight (p < 0.01). CONCLUSIONS: Despite its potential for primary and secondary obesity prevention, only 35% of primary care patients with overweight or obesity engage in self-weighing weekly and less than a quarter (23%) self-weigh daily. Socioeconomic status appears to be a factor influencing regular self-weighing in this population, potentially contributing to greater health disparities in obesity rates. Patients who self-weighed daily had a lower BMI, suggesting that it may play a role in primary prevention of obesity. More work is needed to explore self-weighing among patients.

After Detection: The Improved Accuracy of Lung Cancer Assessment Using Radiologic Computer-aided Diagnosis.

RATIONALE AND OBJECTIVES: The aim of this study was to evaluate the improved accuracy of radiologic assessment of lung cancer afforded by computer-aided diagnosis (CADx). MATERIALS AND METHODS: Inclusion/exclusion criteria were formulated, and a systematic inquiry of research databases was conducted. Following title and abstract review, an in-depth review of 149 surviving articles was performed with accepted articles undergoing a Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-based quality review and data abstraction. RESULTS: A total of 14 articles, representing 1868 scans, passed the review. Increases in the receiver operating characteristic (ROC) area under the curve of .8 or higher were seen in all nine studies that reported it, except for one that employed subspecialized radiologists. CONCLUSIONS: This systematic review demonstrated improved accuracy of lung cancer assessment using CADx over manual review, in eight high-quality observer-performance studies. The improved accuracy afforded by radiologic lung-CADx suggests the need to explore its use in screening and regular clinical workflow.

Preemptive Bone Marrow Transplantation for FANCD1/BRCA2.

Children with biallelic mutations in FANCD1/BRCA2 are at uniquely high risks of leukemia and solid tumors. Preemptive bone marrow transplantation (PE-BMT) has been proposed to avoid the development of leukemia, but empirical study of PE-BMT is unlikely because of the rarity of these children and the unknown benefit of PE-BMT. We used survival analysis to estimate the risks of leukemia and the expected survival if leukemia could be eliminated by curative PE-BMT. We used the results in a decision analysis model to explore the plausibility of PE-BMT for children with variable ages at diagnosis and risks of transplantation-related mortality. For example, PE-BMT at 1 year of age with a 10% risk of transplantation-related mortality increased the mean survival by 1.7 years. The greatest benefit was for patients diagnosed between 1 and 3 years of age, after which the benefit of PE-BMT decreased with age at diagnosis, and the risk of death from solid tumors constituted a relatively greater burden of mortality. Our methods may be used to model survival for other hematologic disorders with limited empirical data and a pressing need for clinical guidance.

Automated detection of retinal disease.

Nearly 4 in 10 Americans with diabetes currently fail to undergo recommended annual retinal exams, resulting in tens of thousands of cases of blindness that could have been prevented. Advances in automated retinal disease detection could greatly reduce the burden of labor-intensive dilated retinal examinations by ophthalmologists and optometrists and deliver diagnostic services at lower cost. As the current availability of ophthalmologists and optometrists is inadequate to screen all patients at risk every year, automated screening systems deployed in primary care settings and even in patients' homes could fill the current gap in supply. Expanding screens to all patients at risk by switching to automated detection systems would in turn yield significantly higher rates of detecting and treating diabetic retinopathy per dilated retinal examination. Fewer diabetic patients would develop complications such as blindness, while ophthalmologists could focus on more complex cases.

Community-based, interdisciplinary geriatric care team satisfaction with an electronic health record: a multimethod study.

This multimethod study measured the impact of an electronic health record (EHR) on clinician satisfaction with clinical process. Subjects were 39 clinicians at a Program of All-inclusive Care for Elders (PACE) site in Philadelphia utilizing an EHR. Methods included the evidence-based evaluation framework, Health Information Technology Research-Based Evaluation Framework, which guided assessment of clinician satisfaction with surveys, observations, follow-up interviews, and actual EHR use at two points in time. Mixed-methods analysis of findings provided context for interpretation and improved validity. The study found that clinicians were satisfied with the EHR; however, satisfaction declined between time periods. Use of EHR was universal and wide and was differentiated by clinical role. Between time periods, EHR use increased in volume, with increased timeliness and decreased efficiency. As the first EHR evaluation at a PACE site from the perspective of clinicians who use the system, this study provides insights into EHR use in the care of older people in community-based healthcare settings.

Active surveillance versus surgery for low risk prostate cancer: a clinical decision analysis.

PURPOSE: We assessed the effect of age, health status and patient preferences on outcomes of surgery vs active surveillance for low risk prostate cancer. MATERIALS AND METHODS: We used Monte Carlo simulation of Markov models of the life courses of 200,000 men diagnosed with low risk prostate cancer and treated with surveillance or radical prostatectomy to calculate quality adjusted life expectancy, life expectancy, prostate cancer specific mortality and years of treatment side effects, with model parameters derived from the literature. We simulated outcomes for men 50 to 75 years old with poor, average or excellent health status (50%, 100% and 150% of average life expectancy, respectively). Sensitivity of outcomes to uncertainties in model parameters was tested. RESULTS: For 65-year-old men in average health, surgery resulted in 0.3 additional years of life expectancy, 1.6 additional years of impotence or incontinence and a 4.9% decrease in prostate cancer specific mortality compared to surveillance, for a net difference of 0.05 fewer quality adjusted life years. Increased age and poorer baseline health status favored surveillance. With greater than 95% probability, surveillance resulted in net benefits compared to surgery for age older than 74, 67 and 54 years for men in excellent, average and poor health, respectively. Patient preferences toward life under surveillance, biochemical recurrence of disease, treatment side effects and future discount rate affected optimal management choice. CONCLUSIONS: Older men and men in poor health are likely to have better quality adjusted life expectancy with active surveillance. However, specific individual preferences impact optimal choices and should be a primary consideration in shared decision making.

Lessons learned in the deployment of a HIV counseling and testing management information system on a new project.

OBJECTIVE: To share our experience on how we used simple but detailed processes and deployed a management information system on a new HIV counseling and testing (HCT) project in Nigeria. DESIGN: The procedures used in this study were adopted for their strength in identifying areas of continuous improvement as the project was implemented. METHODS: We used an iterative brainstorming technique among 30 participants (volunteer counselors and project management staff) as well as iterative quality audits to identify several limitations to the success of the project and to propose solutions. We then implemented the solutions and reevaluated for performance. Findings from the evaluations were then reintroduced into the brainstorming and planning sessions. RESULTS: Several limitations were identified with the most prominent being the poor documentation of records at the site and the lack of a document transfer trail for audit purposes. CONCLUSION: Communication, cohesion and team focus are necessary to achieve success on any new project. Institutionalizing routine HIV behavioral surveillance using data collected at HCT will help in streamlining interventions that will be evidence-based.

The impact of physician subspecialty training, risk calculation, and patient age on treatment recommendations in ocular hypertension.

PURPOSE: To determine whether glaucoma subspecialty training, formal risk estimation, or patient age has an impact on physician treatment recommendations in cases of ocular hypertension. DESIGN: Experimental study. METHODS: Members of the American Academy of Ophthalmology (118) and American Glaucoma Society (58) were recruited. Each physician was first asked how many young and old patients with ocular hypertension he or she would treat to prevent someone from progressing to glaucoma (number needed to treat). The physicians then reviewed 100 simulated cases of patients with ocular hypertension and reported their likelihood to treat each case. Half of these cases were presented with an estimated risk of conversion to glaucoma within 5 years and half were presented without an estimate. The treatment recommendations were analyzed to determine whether subspecialty status or the presence of a risk calculation had any impact on treatment recommendations. RESULTS: Both glaucoma specialists and non-glaucoma specialists were more likely to recommend treatment in cases for which a risk calculation was provided (P = .001). Furthermore, non-glaucoma specialists were more likely to recommend treatment for ocular hypertensive patients than were glaucoma specialists (P < .001). Finally, both groups indicated they were more likely to treat young patients than old. CONCLUSIONS: Both provision of a risk estimate and lack of glaucoma subspecialty training were associated with physicians being more likely to treat ocular hypertension. These findings have implications with regard to ways in which the treatment of ocular hypertensive patients could be modified and possibly made more consistent with available evidence.

Evaluating information prescriptions in two clinical environments.

OBJECTIVE: The research sought to evaluate whether providing personalized information services by libraries can improve satisfaction with information services for specific types of patients. METHODS: Adult breast cancer (BrCa) clinic patients and mothers of inpatient neonatal intensive care unit (NICU) patients were randomized to receive routine information services (control) or an IRx intervention. RESULTS: The BrCa trial randomized 211 patients and the NICU trial, 88 mothers. The BrCa trial showed no statistically significant differences in satisfaction ratings between the treatment and control groups. The IRx group in the NICU trial reported higher satisfaction than the control group regarding information received about diagnosis, treatments, respiratory tradeoffs, and medication tradeoffs. BrCa patients posed questions to librarians more frequently than did NICU mothers, and a higher percentage reported using the website. Questions asked of the librarians by BrCa patients were predominantly clinical and focused on the areas of treatment and side effects. CONCLUSIONS: Study results provide some evidence to support further efforts to both implement information prescription projects in selected settings and to conduct additional research on the costs and benefits of services.

A new instrument for measuring clinician satisfaction with electronic health records.

A new survey instrument was developed and validated to measure clinician (nurse) satisfaction with electronic health record impact on clinical process. The Health Information Technology Reference-Based Evaluation Framework guided the selection of evaluation dimensions for the survey. Survey questions were gathered from existing health information technology satisfaction surveys that reflected individual evaluation concepts, such as efficiency or benefits. Decisions about data-gathering methods (e.g., item selection) were made based on reviews of literature and surveys of clinician satisfaction with health information technology and expert input. Preliminary instrument validation was accomplished using qualitative and statistical analysis of five repeated sets of responses from clinicians at the pilot site and field administrations repeated twice at electronic health record implementation and paper-based comparison sites and by analyzing convergent evidence from observations and interviews. Reliability was assessed on one sample: 30 graduate nursing students at the single pilot site. Validity was assessed on three separate samples: (1) graduate nursing students (n = 30), (2) field test at a site with electronic health record (n = 39 participants), and (3) field test at a paper-based site (n = 17). The implementation and comparison sites are Program of All-Inclusive Care for the Elderly that provide managed day care for frail elderly. Survey responses were assessed for test-retest reliability, internal consistency, and content and construct validity. The instrument design enables its administration before and after electronic health record implementation. Work to date suggests the instrument is reliable and valid; it is offered to electronic health record evaluators for further testing and application.

A new method for determining physician decision thresholds using empiric, uncertain recommendations.

BACKGROUND: The concept of risk thresholds has been studied in medical decision making for over 30 years. During that time, physicians have been shown to be poor at estimating the probabilities required to use this method. To better assess physician risk thresholds and to more closely model medical decision making, we set out to design and test a method that derives thresholds from actual physician treatment recommendations. Such an approach would avoid the need to ask physicians for estimates of patient risk when trying to determine individual thresholds for treatment. Assessments of physician decision making are increasingly relevant as new data are generated from clinical research. For example, recommendations made in the setting of ocular hypertension are of interest as a large clinical trial has identified new risk factors that should be considered by physicians. Precisely how physicians use this new information when making treatment recommendations has not yet been determined. RESULTS: We derived a new method for estimating treatment thresholds using ordinal logistic regression and tested it by asking ophthalmologists to review cases of ocular hypertension before expressing how likely they would be to recommend treatment. Fifty-eight physicians were recruited from the American Glaucoma Society. Demographic information was collected from the participating physicians and the treatment threshold for each physician was estimated. The method was validated by showing that while treatment thresholds varied over a wide range, the most common values were consistent with the 10-15% 5-year risk of glaucoma suggested by expert opinion and decision analysis. CONCLUSIONS: This method has advantages over prior means of assessing treatment thresholds. It does not require physicians to explicitly estimate patient risk and it allows for uncertainty in the recommendations. These advantages will make it possible to use this method when assessing interventions intended to alter clinical decision making.

Impact of consumer health informatics applications.

OBJECTIVE: The objective of the report is to review the evidence on the impact of consumer health informatics (CHI) applications on health outcomes, to identify the knowledge gaps and to make recommendations for future research. DATA SOURCES: We searched MEDLINE, EMBASE, The Cochrane Library, Scopus, and CINAHL databases, references in eligible articles and the table of contents of selected journals; and query of experts. METHODS: Paired reviewers reviewed citations to identify randomized controlled trials (RCTs) of the impact of CHI applications, and all studies that addressed barriers to use of CHI applications. All studies were independently assessed for quality. All data was abstracted, graded, and reviewed by 2 different reviewers. RESULTS: One hundred forty-six eligible articles were identified including 121 RCTs. Studies were very heterogeous and of variable quality. Four of five asthma care studies found significant positive impact of a CHI application on at least one healthcare process measure. In terms of the impact of CHI on intermediate health outcomes, significant positive impact was demonstrated in at least one intermediate health outcome of; all three identified breast cancer studies, 89 percent of 32 diet, exercise, physical activity, not obesity studies, all 7 alcohol abuse studies, 58 percent of 19 smoking cessation studies, 40 percent of 12 obesity studies, all 7 diabetes studies, 88 percent of 8 mental health studies, 25 percent of 4 asthma/COPD studies, and one of two menopause/HRT utilization studies. Thirteen additional single studies were identified and each found evidence of significant impact of a CHI application on one or more intermediate outcomes. Eight studies evaluated the effect of CHI on the doctor patient relationship. Five of these studies demonstrated significant positive impact of CHI on at least one aspect of the doctor patient relationship. In terms of the impact of CHI on clinical outcomes, significant positive impact was demonstrated in at least one clinical outcome of; one of three breast cancer studies, four of five diet, exercise, or physical activity studies, all seven mental health studies, all three identified diabetes studies. No studies included in this review found any evidence of consumer harm attributable to a CHI application. Evidence was insufficient to determine the economic impact of CHI applications. CONCLUSIONS: Despite study heterogeneity, quality variability, and some data paucity, available literature suggests that select CHI applications may effectively engage consumers, enhance traditional clinical interventions, and improve both intermediate and clinical health outcomes.

The impact of risk calculation on treatment recommendations made by glaucoma specialists in cases of ocular hypertension.

PURPOSE: To determine whether a risk calculator changes treatment recommendations made by glaucoma specialists in cases of ocular hypertension. METHODS: Two groups of case scenarios were created using the results of the Ocular Hypertension Treatment Study (OHTS) such that pairs of scenarios had the same risk of developing glaucoma. Glaucoma specialists were asked to review the cases and to make treatment recommendations. Only the second group included the estimated risk of glaucoma. The recommendations of the specialists were analyzed using ordinal regression and 2 measures termed confidence and inconsistency. The relative weighting of risk factors derived from physician recommendations was also compared with the weighting of those factors in the OHTS. The main outcome measure was quantitative change in recommendations when physicians were provided with an estimate of glaucoma risk. RESULTS: Inclusion of the calculator changed recommendations, increasing the measure of confidence and decreasing the measure of inconsistency. The relative weighting of risk factors by physicians in cases in which they did not have a risk calculation were different from the weights of those same risk factors in the OHTS. Even with the risk calculation, physicians tended to weight intraocular pressure and cup-disc ratio more heavily than the OHTS would suggest. CONCLUSIONS: Use of a risk calculator in cases of ocular hypertension changed treatment recommendations. Furthermore, the relative weighting of risk factors was more consistent with the published results from the OHTS when a risk calculation was available.