Using Video from Mobile Phones to Improve Pediatric Phone Triage in an Underserved Population.

BACKGROUND: Video-capable mobile phones are widely available, but few studies have evaluated their use in telephone triage for pediatric patients. We assessed the feasibility, acceptability, and utility of videos sent via mobile phones to enhance pediatric telephone triage for an underserved population with asthma. MATERIALS AND METHODS: We recruited children who presented to an urban pediatric emergency department with an asthma exacerbation along with their parent/guardian. Parents and the research team each obtained a video of the child's respiratory exam, and the research team conducted a concurrent in-person rating of respiratory status. We measured the acceptability of families sending videos as part of telephone triage (survey) and the feasibility of this approach (rates of successful video transmission by parents to the research team). To estimate the utility of the video in appropriately triaging children, four clinicians reviewed each video and rated whether they found the video reassuring, neutral, or raising concerns. RESULTS: Among 60 families (78% Medicaid, 85% Black), 80% of parents reported that sending a video would be helpful and 68% reported that a nurse's review of a video would increase their trust in the triage assessment. Most families (75%) successfully transmitted a video to the research team. All clinician raters found the video reassuring regarding the severity of the child's asthma exacerbation for 68% of children. CONCLUSIONS: Obtaining mobile phone videos for telephone triage is acceptable to families, feasible, and may help improve the quality of telephone triage in an urban, minority population.

Evaluation of a Mobile Health Approach to Tuberculosis Contact Tracing in Botswana.

Tuberculosis (TB) contact tracing is typically conducted in resource-limited settings with paper forms, but this approach may be limited by inefficiencies in data collection, storage, and retrieval and poor data quality. In Botswana, we developed, piloted, and evaluated a mobile health (mHealth) approach to TB contact tracing that replaced the paper form-based approach for a period of six months. For both approaches, we compared the time required to complete TB contact tracing and the quality of data collected. For the mHealth approach, we also administered the Computer System Usability Questionnaire to 2 health care workers who used the new approach, and we identified and addressed operational considerations for implementation. Compared to the paper form-based approach, the mHealth approach reduced the median time required to complete TB contact tracing and improved data quality. The mHealth approach also had favorable overall rating, system usefulness, information quality, and interface quality scores on the Computer System Usability Questionnaire. Overall, the mHealth approach to TB contact tracing improved on the paper form-based approach used in Botswana. This new approach may similarly benefit TB contact tracing efforts in other resource-limited settings.

After-Hours Call Center Triage of Pediatric Head Injury: Outcomes After a Concussion Initiative.

OBJECTIVE: The aim of the study was to characterize referral patterns and medical outcomes of children with head injury triaged by an after-hours call center of a large urban pediatric network, both before and after an institutional concussion initiative. The initiative included a revised call center triage algorithm referring patients with a suspected concussion to see a primary care provider (PCP) within 24 hours, concussion-specific continuing education for medical providers, and a new concussion information Web site. METHODS: Patients aged 5 to 18 years with head injury using the after-hours call center were identified by retrospective review of electronic medical records before (2011) and after (2012) the initiative. A random 50% sample was taken from each year for further analysis. RESULTS: A total of 127 and 159 eligible patient encounters were randomly selected from 2011 to 2012, respectively. From 2011 to 2012, PCP referrals significantly increased from 7% (95% confidence interval [CI], 4%-13%) to 38% (95% CI, 31%-45%), P < 0.001. Concussion diagnoses also significantly increased from 35% (95% CI, 27%-44%) to 58% (95% CI, 50%-66%), P < 0.001. Emergency department referrals and head computed tomography scans decreased but the differences were not statistically significant. No patients had intracranial injury on computed tomography. Most injuries were not sports related. CONCLUSIONS: After an institutional concussion initiative including implementation of a revised head trauma telephone triage algorithm, more head injuries were evaluated by PCPs and more concussions were ultimately diagnosed without an increase in emergency department referrals. Clinicians can benefit from continuing education and infrastructure to aid in initial concussion diagnosis and management.

Accelerating Innovation in Primary Care to Support Adolescent Health Discussions.

BACKGROUND AND OBJECTIVES: Adolescent strengths and risks are not routinely captured in systematized and actionable ways in pediatric primary care. To address this problem, we developed a comprehensive adolescent health questionnaire (AHQ) integrated within the electronic health record and evaluated the AHQ's impact on collection of information on prioritized health-related domains. METHODS: We developed and pilot tested the AHQ. We then scaled and assessed the AHQ's impact on data collection. AHQ development used innovation methods and measured feasibility and acceptability outcomes. Scaling and postscaling outcomes included Reach, Effectiveness, Adoption, Implementation, Maintenance and Sustainability measures: Reach (total questionnaires completed), Effectiveness (capture of key information across health domains pre- vs post-AHQ scaling), Adoption (proportion of practices that adopted the AHQ), Implementation (proportion of eligible adolescents who completed the AHQ), and Maintenance (monthly completion rates). RESULTS: AHQ development led to a tool that was feasible and acceptable for use. During scaling (October 2020-December 2021), 22 147 questionnaires were completed by 20 749 unique adolescents aged 13 to 21 years at their preventive visit. Comparing pre- versus post-AHQ scaling data, use of the AHQ increased collection of information across domains, especially for strengths, gun safety, substance use, sexual activity, sexual orientation, and gender identity, from ranges of 0%-25% to 92%-95%. All 31 practices adopted the AHQ with completion at 88.7% of visits (n = 24 968). Two years postscaling, completion rates were >91% per month. CONCLUSIONS: We successfully developed, scaled, and maintained an AHQ in a widely-used electronic health record system, a model for improving adolescent care and foundation for developing future interventions.

Clinical decision support with a comprehensive in-EHR patient tracking system improves genetic testing follow up.

OBJECTIVE: We sought to develop and evaluate an electronic health record (EHR) genetic testing tracking system to address the barriers and limitations of existing spreadsheet-based workarounds. MATERIALS AND METHODS: We evaluated the spreadsheet-based system using mixed effects logistic regression to identify factors associated with delayed follow up. These factors informed the design of an EHR-integrated genetic testing tracking system. After deployment, we assessed the system in 2 ways. We analyzed EHR access logs and note data to assess patient outcomes and performed semistructured interviews with users to identify impact of the system on work. RESULTS: We found that patient-reported race was a significant predictor of documented genetic testing follow up, indicating a possible inequity in care. We implemented a CDS system including a patient data capture form and management dashboard to facilitate important care tasks. The system significantly sped review of results and significantly increased documentation of follow-up recommendations. Interviews with key system users identified a range of sociotechnical factors (ie, tools, tasks, collaboration) that contribute to safer and more efficient care. DISCUSSION: Our new tracking system ended decades of workarounds for identifying and communicating test results and improved clinical workflows. Interview participants related that the system decreased cognitive and time burden which allowed them to focus on direct patient interaction. CONCLUSION: By assembling a multidisciplinary team, we designed a novel patient tracking system that improves genetic testing follow up. Similar approaches may be effective in other clinical settings.

Electronic health records, mobile health, and the challenge of improving global health.

Technology continues to impact healthcare around the world. This provides great opportunities, but also risks. These risks are compounded in low-resource settings where errors in planning and implementation may be more difficult to overcome. Global Health Informatics provides lessons in both opportunities and risks by building off of general Global Health. Global Health Informatics also requires a thorough understanding of the local environment and the needs of low-resource settings. Forming effective partnerships and following the lead of local experts are necessary for sustainability; it also ensures that the priorities of the local community come first. There is an opportunity for partnerships between low-resource settings and high income areas that can provide learning opportunities to avoid the pitfalls that plague many digital health systems and learn how to properly implement technology that truly improves healthcare.

Early experiences with combined fellowship training in clinical informatics.

Given the ubiquitous nature of information systems in modern health care, interest in the pursuit of formal training in clinical informatics is increasing. This interest is not restricted to generalists-informatics training is increasingly being sought by future subspecialists. The traditional structure of Accreditation Council on Graduate Medical Education subspecialty training requires completion of both clinical and clinical informatics fellowship programs, and understandably lacks appeal due to the time commitment required. One approach to encourage clinical informatics training is to integrate it with clinical fellowships in order to confer dual-board eligibility. In this perspective, we describe 3 successful petitions for combined training in clinical informatics in order to support other programs and the American Board of Preventive Medicine in establishing pathways for training subspecialists in clinical informatics.

Attributing Patients to Pediatric Residents Using Electronic Health Record Features Augmented with Audit Logs.

OBJECTIVE: Patient attribution, or the process of attributing patient-level metrics to specific providers, attempts to capture real-life provider-patient interactions (PPI). Attribution holds wide-ranging importance, particularly for outcomes in graduate medical education, but remains a challenge. We developed and validated an algorithm using EHR data to identify pediatric resident PPIs (rPPIs). METHODS: We prospectively surveyed residents in three care settings to collect self-reported rPPIs. Participants were surveyed at the end of primary care clinic, emergency department (ED), and inpatient shifts, shown a patient census list, asked to mark the patients with whom they interacted, and encouraged to provide a short rationale behind the marked interaction. We extracted routine EHR data elements, including audit logs, note contribution, order placement, care team assignment, and chart closure, and applied a logistic regression classifier to the data to predict rPPIs in each care setting. We also performed a comment analysis of the resident-reported rationales in the inpatient care setting to explore perceived patient interactions in a complicated workflow. RESULTS: We surveyed 81 residents over 111 shifts and identified 579 patient interactions. Among EHR extracted data, time-in-chart was the best predictor in all three care settings (primary care clinic: odds ratio [OR] = 19.36, 95% confidence interval [CI]: 4.19-278.56; ED: OR = 19.06, 95% CI: 9.53-41.65' inpatient: OR = 2.95, 95% CI: 2.23-3.97). Primary care clinic and ED specific models had c-statistic values > 0.98, while the inpatient-specific model had greater variability (c-statistic = 0.89). Of 366 inpatient rPPIs, residents provided rationales for 90.1%, which were focused on direct involvement in a patient's admission or transfer, or care as the front-line ordering clinician (55.6%). CONCLUSION: Classification models based on routinely collected EHR data predict resident-defined rPPIs across care settings. While specific to pediatric residents in this study, the approach may be generalizable to other provider populations and scenarios in which accurate patient attribution is desirable.

Understanding Internet access and use to facilitate patient portal adoption.

Understanding the information-seeking preferences and Internet access habits of the target audiences for a patient portal is essential for successful uptake. The resource must deliver culturally and educationally appropriate information via technology that is accessible to the intended users and be designed to meet their needs and preferences. Providers must consider multiple perspectives when launching a portal and make any needed adjustments once the launch is underway. We report results of a study of 270 parents and caregivers of paediatric patients in a major health system during the process of implementing a patient portal. Through a 26-question paper-and-pencil survey, data were collected on participant demographics, Internet access and use, health information-seeking behaviours, health literacy, and potential use of a patient portal. Results indicate a positive attitude towards portal use but also suggest that low health literacy may be a key issue to portal adoption.

A Model for Clinical Informatics Education for Residents: Addressing an Unmet Need.

Opportunities for education in clinical informatics exist throughout the spectrum of formal education extending from high school to postgraduate training. However, physicians in residency represent an underdeveloped source of potential informaticians. Despite the rapid growth of accredited fellowship programs since clinical informatics became a board-eligible subspecialty in 2011, few resident physicians are aware of their role at the intersection of clinical medicine and health information technology or associated opportunities. In an effort to educate and engage residents in clinical informatics, Children's Hospital of Philadelphia has developed a three-pronged model: (1) an elective rotation with hands-on project experience; (2) a longitudinal experience that offers increased exposure and mentorship; and (3) a resident founded and led working group in clinical informatics. We describe resident participation in these initiatives and lessons learned, as well as resident perceptions of how these components have positively influenced informatics knowledge and career choices. Since inception of this model, five residents have pursued the clinical informatics fellowship. This educational model supports resident involvement in hospital-wide informatics efforts with tangible projects and promotes wider engagement through educational opportunities commensurate with the resident's level of interest.

Influence of simulation on electronic health record use patterns among pediatric residents.

Objective: Electronic health record (EHR) simulation with realistic test patients has improved recognition of safety concerns in test environments. We assessed if simulation affects EHR use patterns in real clinical settings. Materials and Methods: We created a 1-hour educational intervention of a simulated admission for pediatric interns. Data visualization and information retrieval tools were introduced to facilitate recognition of the patient's clinical status. Using EHR audit logs, we assessed the frequency with which these tools were accessed by residents prior to simulation exposure (intervention group, pre-simulation), after simulation exposure (intervention group, post-simulation), and among residents who never participated in simulation (control group). Results: From July 2015 to February 2017, 57 pediatric residents participated in a simulation and 82 did not. Residents were more likely to use the data visualization tool after simulation (73% in post-simulation weeks vs 47% of combined pre-simulation and control weeks, P <. 0001) as well as the information retrieval tool (85% vs 36%, P < .0001). After adjusting for residents' experiences measured in previously completed inpatient weeks of service, simulation remained a significant predictor of using the data visualization (OR 2.8, CI: 2.1-3.9) and information retrieval tools (OR 3.0, CI: 2.0-4.5). Tool use did not decrease in interrupted time-series analysis over a median of 19 (IQR: 8-32) weeks of post-simulation follow-up. Discussion: Simulation was associated with persistent changes to EHR use patterns among pediatric residents. Conclusion: EHR simulation is an effective educational method that can change participants' use patterns in real clinical settings.

Characteristics of the National Applicant Pool for Clinical Informatics Fellowships (2016-2017).

We conducted a national study to assess the numbers and diversity of applicants for 2016 and 2017 clinical informatics fellowship positions. In each year, we collected data on the number of applications that programs received from candidates who were ultimately successful vs. unsuccessful. In 2017, we also conducted an anonymous applicant survey. Successful candidates applied to an average of 4.2 and 5.5 programs for 2016 and 2017, respectively. In the survey, unsuccessful candidates reported applying to fewer programs. Assuming unsuccessful candidates submitted between 2-5 applications each, the total applicant pool numbered 42-69 for 2016 (competing for 24 positions) and 52-85 for 2017 (competing for 30 positions). Among survey respondents (n=33), 24% were female, 1 was black and none were Hispanic. We conclude that greater efforts are needed to enhance interest in clinical informatics among medical students and residents, particularly among women and members of underrepresented minority groups.

The impact of access to immunization information on vaccine acceptance in three countries.

INTRODUCTION: Vaccine acceptance is a critical component of sustainable immunization programs, yet rates of vaccine hesitancy are rising. Increased access to misinformation through media and anti-vaccine advocacy is an important contributor to hesitancy in the United States and other high-income nations with robust immunization programs. Little is known about the content and effect of information sources on attitudes toward vaccination in settings with rapidly changing or unstable immunization programs. OBJECTIVE: The objective of this study was to explore knowledge and attitudes regarding vaccines and vaccine-preventable diseases among caregivers and immunization providers in Botswana, the Dominican Republic, and Greece and examine how access to information impacts reported vaccine acceptance. METHODS: We conducted 37 focus groups and 14 semi-structured interviews with 96 providers and 153 caregivers in Botswana, the Dominican Republic, and Greece. Focus groups were conducted in Setswana, English, Spanish, or Greek; digitally recorded; and transcribed. Transcripts were translated into English, coded in qualitative data analysis software (NVivo 10, QSR International, Melbourne, Australia), and analyzed for common themes. RESULTS: Dominant themes in all three countries included identification of health care providers or medical literature as the primary source of vaccine information, yet participants reported insufficient communication about vaccines was available. Comments about level of trust in the health care system and government contrasted between sites, with the highest level of trust reported in Botswana but lower levels of trust in Greece. CONCLUSIONS: In Botswana, the Dominican Republic, and Greece, participants expressed reliance on health care providers for information and demonstrated a need for more communication about vaccines. Trust in the government and health care system influenced vaccine acceptance differently in each country, demonstrating the need for country-specific data that focus on vaccine acceptance to fully understand which drivers can be leveraged to improve implementation of immunization programs.

Outcomes associated with pediatric after-hours care by call centers: a multicenter study.

OBJECTIVES: To assess 1) parental opinion regarding appropriateness of triage, 2) utilization outcomes, and 3) the frequency of underreferral with subsequent hospitalization for children triaged by nurses at pediatric call centers. DESIGN/METHODS: From August 19 to October 1999, after-hours calls were randomly sampled from computerized records at 4 call centers at children's hospitals. Telephone surveys were conducted 3 to 7 days after the index calls. An expert panel to assess appropriateness of disposition reviewed audio recordings of calls given a nonurgent disposition and then hospitalized within 24 hours. RESULTS: Surveys were completed for 70.5% (N = 1561). Parental agreement with urgent or home care recommendations was >70% but with intermediary recommendations was <50%. Hospitalizations were more common among children urgently referred (4.6% vs 0.45%; P =.0003). Calls judged urgent by call center nurses and referred to a physician for secondary triage had lower rates of urgent visits (odds ratio [OR] 0.58; 95% confidence interval [CI] 0.53-0.65; P <.0001) and higher rates of never having a visit (OR 1.37; 95% CI 1.24-1.51; P <.0001) than those referred directly by nurses. The weighted rate of underreferral with hospitalization was 0.3% (95% CI 0.1-0.7%) or 1 in 481 calls (95% CI 1/152 to 1/1538). CONCLUSIONS: Our data demonstrate an underreferral rate with subsequent hospitalization of 1 in 500 calls and a significant reduction in visits when those cases judged urgent by call center nurses undergo secondary triage by physicians.

Outcomes of children referred to an emergency department by an after-hours call center.

BACKGROUND AND OBJECTIVES: After-hours call centers are increasingly prevalent, yet there is little patient outcomes data. We sought to determine compliance with referral to an emergency department (ED) and describe outcomes and clinical characteristics of referred patients including triage classifications, therapeutic interventions, diagnostic testing, diagnoses, and hospitalization rates. DESIGN AND PARTICIPANTS: A retrospective cohort design. We studied hospital-based primary care patients who were referred to the ED of a tertiary care children's hospital by the call center, without physician consultation. RESULTS: Of the 8265 telephone calls to the call center, 1473 (18%) children were referred to the ED, and 931 (63%) were compliant. Compliant patients were significantly younger (P = 0.01) and were more likely to have been referred to the ED immediately (P = 0.01) compared with noncompliant patients. Among compliant patients, 48% were classified as nonurgent at ED triage; of these, half did not have a therapeutic intervention or diagnostic test or require hospitalization. Overall, therapeutic interventions were administered to 44%, diagnostic tests were performed for 45%, and 13% were hospitalized. Compared to children referred immediately to the ED, the proportion instructed to go to the ED within 4 hours of the telephone call received significantly lower ED triage classifications (93% vs. 77%, P < 0.00001) and hospitalizations (15% vs. 6%, P = 0.001). CONCLUSIONS: In this study, we report the outcomes and clinical characteristics of children referred to the ED by an after-hours call center. Data such as these may be used by call centers in the assessment of management advice and referral practices.

Children referred to an emergency department by an after-hours call center: complaint-specific analysis.

BACKGROUND AND OBJECTIVES: Approximately 20% of phone calls to after-hours call centers result in referrals to the emergency department (ED), but data regarding ED management and disposition are lacking. We sought to determine the acuity of illness of referred children as reflected by triage classifications and need for therapeutic interventions, diagnostic testing, and hospitalization, and to stratify the analysis of ED management and dispositions by chief complaints. DESIGN AND METHODS: Patients referred to the ED by the after-hours call centers, without physician consultation, were identified. The 4 most common groups of chief complaints resulting in ED referral were determined, and the records of these children were analyzed. RESULTS: The 525 patients with chief complaints related to the following organ systems were studied: lower respiratory tract, 263 (50%); gastrointestinal, 104 (20%); head, ears, eyes, nose, and throat, 84 (16%); and upper respiratory tract, 74 (14%). The proportion of children referred for lower respiratory tract complaints who received the after-hours call centers call dispositions (99%) or ED triage classifications (38%) of highest priorities, or who required therapeutic interventions (73%), diagnostic testing (40%), or hospitalization (22%) was significantly higher than for all other categories. Thirteen percent with gastrointestinal complaints, referred primarily for dehydration, required intravenous fluids, and 2% of head, ears, eyes, nose, and throat patients required hospitalization. CONCLUSIONS: Children referred to the ED for illnesses related to the lower respiratory tract, principally wheezing, had illnesses of high acuity. On the other hand, current criteria for ED referral for children in the gastrointestinal, head, ears, eyes, nose, and throat, and upper respiratory tract categories result in the referral of many children with nonurgent problems. These data support a reassessment of current referral practices for children with these complaints.

mHealth to revolutionize information retrieval in low and middle income countries: introduction and proposed solutions using Botswana as reference point.

Information retrieval (IR) practice is invaluable in health care, where the growth of medical knowledge has long surpassed human memory capabilities, and health care workers often have unmet information needs. While the information and communications technology (ICT) revolution is improving, IR in the Western world, the global digital divide has never been wider. Low and Middle Income Countries (LMICs) have the least advanced ICT infrastructure and service provision, and are also burdened with the majority of the world's health issues and severe shortages of health care workers. Initiatives utilizing mobile technology in healthcare and public health (mHealth) have shown potential at addressing these inequalities and challenges. Using Botswana as a reference point, this paper aims to broadly describe the healthcare and ICT challenges facing LMICs, the promise of mHealth as a field in health informatics, and then propose health informatics solutions that specifically address IR content and needs. One solution proposes utilizing Unstructured Supplementary Service Data (USSD) for accessing treatment guidelines, and the other solution outlines applications of smart devices for IR.

A mobile health approach to tuberculosis contact tracing in resource-limited settings.

Tuberculosis remains a leading cause of morbidity and mortality worldwide. In 2011, there were 8.7 million new cases and 1.4 million deaths from the disease, with >95% of these deaths taking place in low- and middle-income countries [1]. Contact tracing prevents the spread of tuberculosis by identifying and screening a case's contacts and referring symptomatic individuals to health care providers. Traditionally, contact tracing has been conducted with paper forms, which can lead to considerable inefficiencies in data collection, storage, and retrieval. These inefficiencies are problematic as tuberculosis can continue to spread if disruption of disease transmission is delayed. Mobile health approaches to tuberculosis contact tracing remain largely unaddressed and limited to management and monitoring of multidrug-resistant tuberculosis [2].To address these limitations, a mobile health application that digitizes and automates contact tracing was developed. This poster presents work currently underway to evaluate this new approach in Botswana, which has the tenth highest incidence rate of tuberculosis in the world [3]. Operational considerations for implementing a mobile health approach to contact tracing in resource-limited settings are also presented.