Early-Life Exposure to Air Pollution and Childhood Asthma Cumulative Incidence in the ECHO CREW Consortium.

Importance: Exposure to outdoor air pollution contributes to childhood asthma development, but many studies lack the geographic, racial and ethnic, and socioeconomic diversity to evaluate susceptibility by individual-level and community-level contextual factors. Objective: To examine early life exposure to fine particulate matter (PM2.5) and nitrogen oxide (NO2) air pollution and asthma risk by early and middle childhood, and whether individual and community-level characteristics modify associations between air pollution exposure and asthma. Design, Setting, and Participants: This cohort study included children enrolled in cohorts participating in the Children's Respiratory and Environmental Workgroup consortium. The birth cohorts were located throughout the US, recruited between 1987 and 2007, and followed up through age 11 years. The survival analysis was adjusted for mother's education, parental asthma, smoking during pregnancy, child's race and ethnicity, sex, neighborhood characteristics, and cohort. Statistical analysis was performed from February 2022 to December 2023. Exposure: Early-life exposures to PM2.5 and NO2 according to participants' birth address. Main Outcomes and Measures: Caregiver report of physician-diagnosed asthma through early (age 4 years) and middle (age 11 years) childhood. Results: Among 5279 children included, 1659 (31.4%) were Black, 835 (15.8%) were Hispanic, 2555 (48.4%) where White, and 229 (4.3%) were other race or ethnicity; 2721 (51.5%) were male and 2596 (49.2%) were female; 1305 children (24.7%) had asthma by 11 years of age and 954 (18.1%) had asthma by 4 years of age. Mean values of pollutants over the first 3 years of life were associated with asthma incidence. A 1 IQR increase in NO2 (6.1 µg/m3) was associated with increased asthma incidence among children younger than 5 years (HR, 1.25 [95% CI, 1.03-1.52]) and children younger than 11 years (HR, 1.22 [95% CI, 1.04-1.44]). A 1 IQR increase in PM2.5 (3.4 µg/m3) was associated with increased asthma incidence among children younger than 5 years (HR, 1.31 [95% CI, 1.04-1.66]) and children younger than 11 years (OR, 1.23 [95% CI, 1.01-1.50]). Associations of PM2.5 or NO2 with asthma were increased when mothers had less than a high school diploma, among Black children, in communities with fewer child opportunities, and in census tracts with higher percentage Black population and population density; for example, there was a significantly higher association between PM2.5 and asthma incidence by younger than 5 years of age in Black children (HR, 1.60 [95% CI, 1.15-2.22]) compared with White children (HR, 1.17 [95% CI, 0.90-1.52]). Conclusions and Relevance: In this cohort study, early life air pollution was associated with increased asthma incidence by early and middle childhood, with higher risk among minoritized families living in urban communities characterized by fewer opportunities and resources and multiple environmental coexposures. Reducing asthma risk in the US requires air pollution regulation and reduction combined with greater environmental, educational, and health equity at the community level.

The Pediatric Data Science and Analytics Subgroup of the Pediatric Acute Lung Injury and Sepsis Investigators Network: Use of Supervised Machine Learning Applications in Pediatric Critical Care Medicine Research.

OBJECTIVE: Perform a scoping review of supervised machine learning in pediatric critical care to identify published applications, methodologies, and implementation frequency to inform best practices for the development, validation, and reporting of predictive models in pediatric critical care. DESIGN: Scoping review and expert opinion. SETTING: We queried CINAHL Plus with Full Text (EBSCO), Cochrane Library (Wiley), Embase (Elsevier), Ovid Medline, and PubMed for articles published between 2000 and 2022 related to machine learning concepts and pediatric critical illness. Articles were excluded if the majority of patients were adults or neonates, if unsupervised machine learning was the primary methodology, or if information related to the development, validation, and/or implementation of the model was not reported. Article selection and data extraction were performed using dual review in the Covidence tool, with discrepancies resolved by consensus. SUBJECTS: Articles reporting on the development, validation, or implementation of supervised machine learning models in the field of pediatric critical care medicine. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Of 5075 identified studies, 141 articles were included. Studies were primarily (57%) performed at a single site. The majority took place in the United States (70%). Most were retrospective observational cohort studies. More than three-quarters of the articles were published between 2018 and 2022. The most common algorithms included logistic regression and random forest. Predicted events were most commonly death, transfer to ICU, and sepsis. Only 14% of articles reported external validation, and only a single model was implemented at publication. Reporting of validation methods, performance assessments, and implementation varied widely. Follow-up with authors suggests that implementation remains uncommon after model publication. CONCLUSIONS: Publication of supervised machine learning models to address clinical challenges in pediatric critical care medicine has increased dramatically in the last 5 years. While these approaches have the potential to benefit children with critical illness, the literature demonstrates incomplete reporting, absence of external validation, and infrequent clinical implementation.

Social risk factors for pediatric asthma exacerbations: A systematic review.

Objective: This systematic review aims to identify social risk factors that influence pediatric asthma exacerbations. Methods: Cohort studies published between 2010 and 2020 were systematically searched on the OVID Medline, Embase, and PsycInfo databases. Using our established phased inclusion and exclusion criteria, studies that did not address a pediatric population, social risk factors, and asthma exacerbations were excluded. Out of a total of 707 initially retrieved articles, 3 prospective cohort and 6 retrospective cohort studies were included. Results: Upon analysis of our retrieved studies, two overarching domains of social determinants, as defined by Healthy People 2030, were identified as major risk factors for pediatric asthma exacerbations: Social/Community Context and Neighborhood/Built Environment. Social/Community factors including African American race and inadequate caregiver perceptions were associated with increased risk for asthma exacerbations. Patients in high-risk neighborhoods, defined by lower levels of education, housing, and employment, had higher rates of emergency department readmissions and extended duration of stay. Additionally, a synergistic interaction between the two domains was found such that patients with public or no health insurance and residence in high-risk neighborhoods were associated with excess hospital utilization attributable to pediatric asthma exacerbations. Conclusion: Social risk factors play a significant role in influencing the frequency and severity of pediatric asthma exacerbations.

Asthma innovations from the first International Collaborative Asthma Network forum.

Background: Many patients have uncontrolled asthma despite available treatments. Most of the new asthma therapies have focused on type 2 (T2) inflammation, leaving an unmet need for innovative research into mechanisms of asthma beyond T2 and immunity. An international group of investigators developed the International Collaborative Asthma Network (ICAN) with the goal of sharing innovative research on disease mechanisms, developing new technologies and therapies, organising pilot studies and engaging early-stage career investigators from across the world. This report describes the purpose, development and outcomes of the first ICAN forum. Methods: Abstracts were solicited from interdisciplinary early-stage career investigators with innovative ideas beyond T2 inflammation for asthma and were selected for presentation at the forum. Breakout sessions were conducted to discuss innovation, collaboration and research translation. Results: The abstracts were categorised into: 1) general omics and big data analysis; 2) lung-brain axis and airway neurology; 3) sex differences; 4) paediatric asthma; 5) new therapeutic targets inspired by airway epithelial biology; 6) new therapeutics targeting airway and circulating immune mediators; and 7) lung anatomy, physiology and imaging. Discussions revealed that research groups are looking for opportunities to further their findings using larger scale collaboration and the ability to translate their in vitro findings into clinical treatment. Conclusions: Through ICAN, teams that included interdisciplinary early-stage career investigators discussed innovation, collaboration and translation in asthma and severe asthma research. With a combination of fresh ideas and energetic, collaborative, global participation, ICAN has laid a firm foundation and model for future collaborative global asthma research.

Natural language processing-driven state machines to extract social factors from unstructured clinical documentation.

Objective: This study sought to create natural language processing algorithms to extract the presence of social factors from clinical text in 3 areas: (1) housing, (2) financial, and (3) unemployment. For generalizability, finalized models were validated on data from a separate health system for generalizability. Materials and Methods: Notes from 2 healthcare systems, representing a variety of note types, were utilized. To train models, the study utilized n-grams to identify keywords and implemented natural language processing (NLP) state machines across all note types. Manual review was conducted to determine performance. Sampling was based on a set percentage of notes, based on the prevalence of social need. Models were optimized over multiple training and evaluation cycles. Performance metrics were calculated using positive predictive value (PPV), negative predictive value, sensitivity, and specificity. Results: PPV for housing rose from 0.71 to 0.95 over 3 training runs. PPV for financial rose from 0.83 to 0.89 over 2 training iterations, while PPV for unemployment rose from 0.78 to 0.88 over 3 iterations. The test data resulted in PPVs of 0.94, 0.97, and 0.95 for housing, financial, and unemployment, respectively. Final specificity scores were 0.95, 0.97, and 0.95 for housing, financial, and unemployment, respectively. Discussion: We developed 3 rule-based NLP algorithms, trained across health systems. While this is a less sophisticated approach, the algorithms demonstrated a high degree of generalizability, maintaining >0.85 across all predictive performance metrics. Conclusion: The rule-based NLP algorithms demonstrated consistent performance in identifying 3 social factors within clinical text. These methods may be a part of a strategy to measure social factors within an institution.

Incidence rates of childhood asthma with recurrent exacerbations in the US Environmental influences on Child Health Outcomes (ECHO) program.

BACKGROUND: Descriptive epidemiological data on incidence rates (IRs) of asthma with recurrent exacerbations (ARE) are sparse. OBJECTIVES: This study hypothesized that IRs for ARE would vary by time, geography, age, and race and ethnicity, irrespective of parental asthma history. METHODS: The investigators leveraged data from 17,246 children born after 1990 enrolled in 59 US with 1 Puerto Rican cohort in the Environmental Influences on Child Health Outcomes (ECHO) consortium to estimate IRs for ARE. RESULTS: The overall crude IR for ARE was 6.07 per 1000 person-years (95% CI: 5.63-6.51) and was highest for children aged 2-4 years, for Hispanic Black and non-Hispanic Black children, and for those with a parental history of asthma. ARE IRs were higher for 2- to 4-year-olds in each race and ethnicity category and for both sexes. Multivariable analysis confirmed higher adjusted ARE IRs (aIRRs) for children born 2000-2009 compared with those born 1990-1999 and 2010-2017, 2-4 versus 10-19 years old (aIRR = 15.36; 95% CI: 12.09-19.52), and for males versus females (aIRR = 1.34; 95% CI 1.16-1.55). Black children (non-Hispanic and Hispanic) had higher rates than non-Hispanic White children (aIRR = 2.51; 95% CI 2.10-2.99; and aIRR = 2.04; 95% CI: 1.22-3.39, respectively). Children born in the Midwest, Northeast and South had higher rates than those born in the West (P < .01 for each comparison). Children with a parental history of asthma had rates nearly 3 times higher than those without such history (aIRR = 2.90; 95% CI: 2.43-3.46). CONCLUSIONS: Factors associated with time, geography, age, race and ethnicity, sex, and parental history appear to influence the inception of ARE among children and adolescents.

Breast Cancer Screening, Diagnosis, and Surgery during the Pre- and Peri-pandemic: Experience of Patients in a Statewide Health Information Exchange.

BACKGROUND: Measures taken to address the COVID-19 pandemic interrupted routine diagnosis and care for breast cancer. The aim of this study was to characterize the effects of the pandemic on breast cancer care in a statewide cohort. PATIENTS AND METHODS: Using data from a large health information exchange, we retrospectively analyzed the timing of breast cancer screening, and identified a cohort of newly diagnosed patients with any stage of breast cancer to further access the information available about their surgical treatments. We compared data for four subgroups: pre-lockdown (preLD) 25 March to 16 June 2019; lockdown (LD) 23 March to 3 May 2020; reopening (RO) 4 May to 14 June 2020; and post-lockdown (postLD) 22 March to 13 June 2021. RESULTS: During LD and RO, screening mammograms in the cohort decreased by 96.3% and 36.2%, respectively. The overall breast cancer diagnosis and surgery volumes decreased up to 38.7%, and the median time to surgery was prolonged from 1.5 months to 2.4 for LD and 1.8 months for RO. Interestingly, higher mean DCIS diagnosis (5.0 per week vs. 3.1 per week, p < 0.05) and surgery volume (14.8 vs. 10.5, p < 0.05) were found for postLD compared with preLD, while median time to surgery was shorter (1.2 months vs. 1.5 months, p < 0.0001). However, the postLD average weekly screening and diagnostic mammogram did not fully recover to preLD levels (2055.3 vs. 2326.2, p < 0.05; 574.2 vs. 624.1, p < 0.05). CONCLUSIONS: Breast cancer diagnosis and treatment patterns were interrupted during the lockdown and still altered 1 year after. Screening in primary care should be expanded to mitigate possible longer-term effects of these interruptions.

Training the next generation of learning health system scientists.

Introduction: The learning health system (LHS) aligns science, informatics, incentives, stakeholders, and culture for continuous improvement and innovation. The Agency for Healthcare Research and Quality and the Patient-Centered Outcomes Research Institute designed a K12 initiative to grow the number of LHS scientists. We describe approaches developed by 11 funded centers of excellence (COEs) to promote partnerships between scholars and health system leaders and to provide mentored research training. Methods: Since 2018, the COEs have enlisted faculty, secured institutional resources, partnered with health systems, developed and implemented curricula, recruited scholars, and provided mentored training. Program directors for each COE provided descriptive data on program context, scholar characteristics, stakeholder engagement, scholar experiences with health system partnerships, roles following program completion, and key training challenges. Results: To date, the 11 COEs have partnered with health systems to train 110 scholars. Nine (82%) programs partner with a Veterans Affairs health system and 9 (82%) partner with safety net providers. Clinically trained scholars (n = 87; 79%) include 70 physicians and 17 scholars in other clinical disciplines. Non-clinicians (n = 29; 26%) represent diverse fields, dominated by population health sciences. Stakeholder engagement helps scholars understand health system and patient/family needs and priorities, enabling opportunities to conduct embedded research, improve outcomes, and grow skills in translating research methods and findings into practice. Challenges include supporting scholars through roadblocks that threaten to derail projects during their limited program time, ranging from delays in access to data to COVID-19-related impediments and shifts in organizational priorities. Conclusions: Four years into this novel training program, there is evidence of scholars' accomplishments, both in traditional academic terms and in terms of moving along career trajectories that hold the potential to lead and accelerate transformational health system change. Future LHS training efforts should focus on sustainability, including organizational support for scholar activities.

Evaluation for Bleeding Disorders in Suspected Child Abuse.

Bruising or bleeding in a child can raise the concern for child abuse. Assessing whether the findings are the result of trauma and/or whether the child has a bleeding disorder is critical. Many bleeding disorders are rare, and not every child with bruising/bleeding that may raise a concern for abuse requires an evaluation for bleeding disorders. However, in some instances, bleeding disorders can present in a manner similar to child abuse. Bleeding disorders cannot be ruled out solely on the basis of patient and family history, no matter how extensive. The history and clinical evaluation can be used to determine the necessity of an evaluation for a possible bleeding disorder, and prevalence and known clinical presentations of individual bleeding disorders can be used to guide the extent of laboratory testing. This clinical report provides guidance to pediatricians and other clinicians regarding the evaluation for bleeding disorders when child abuse is suspected.

Building Cancer Control Capacity in Health Professionals Through Telementoring: A Survey Study of a Cancer Prevention and Survivorship Care ECHO Program.

Project Extension for Community Healthcare Outcomes (Project ECHO©) was developed to democratize knowledge among health professionals in underserved communities. Evidence supporting the use of this model for cancer control is limited. Using surveys adapted from Moore's evaluation framework, we evaluated the training outcomes of an ECHO program on cancer prevention and survivorship care. The study provides preliminary evidence that the ECHO model is a feasible way to build cancer control capacity among the healthcare workforce.

An evaluation of an Extension for Community Healthcare Outcomes (ECHO) intervention in cancer prevention and survivorship care.

To improve cancer care in Indiana, a telementoring program using the Extension for Community Healthcare Outcomes (ECHO) model was introduced in September 2019 to promote best-practice cancer prevention, screening, and survivorship care by primary care providers (PCPs). The aim of this study was to evaluate the program's educational outcomes in its pilot year, using Moore's Evaluation Framework for Continuing Medical Education and focusing on the program's impact on participants' knowledge, confidence, and professional practice. We collected data in 22 semi-structured interviews (13 PCPs and 9 non-PCPs) and 30 anonymous one-time surveys (14 PCPs and 16 non-PCPs) from the program participants (hub and spoke site members), as well as from members of the target audience who did not participate. In the first year, average attendance at each session was 2.5 PCPs and 12 non-PCP professionals. In spite of a relatively low PCP participation, the program received very positive satisfaction scores, and participants reported improvements in knowledge, confidence, and practice. Both program participants and target audience respondents particularly valued three features of the program: its conversational format, the real-life experiences gained, and the support received from a professional interdisciplinary community. PCPs reported preferring case discussions over didactics. Our results suggest that the Cancer ECHO program has benefits over other PCP-targetted cancer control interventions and could be an effective educational means of improving cancer control capacity among PCPs and others. Further study is warranted to explain the discrepancies among study participants' perceptions of the program's strengths and the relatively low PCP participation before undertaking a full-scale effectiveness study.

Childhood Asthma Incidence, Early and Persistent Wheeze, and Neighborhood Socioeconomic Factors in the ECHO/CREW Consortium.

Importance: In the United States, Black and Hispanic children have higher rates of asthma and asthma-related morbidity compared with White children and disproportionately reside in communities with economic deprivation. Objective: To determine the extent to which neighborhood-level socioeconomic indicators explain racial and ethnic disparities in childhood wheezing and asthma. Design, Setting, and Participants: The study population comprised children in birth cohorts located throughout the United States that are part of the Children's Respiratory and Environmental Workgroup consortium. Cox proportional hazard models were used to estimate hazard ratios (HRs) of asthma incidence, and logistic regression was used to estimate odds ratios of early and persistent wheeze prevalence accounting for mother's education, parental asthma, smoking during pregnancy, child's race and ethnicity, sex, and region and decade of birth. Exposures: Neighborhood-level socioeconomic indicators defined by US census tracts calculated as z scores for multiple tract-level variables relative to the US average linked to participants' birth record address and decade of birth. The parent or caregiver reported the child's race and ethnicity. Main Outcomes and Measures: Prevalence of early and persistent childhood wheeze and asthma incidence. Results: Of 5809 children, 46% reported wheezing before age 2 years, and 26% reported persistent wheeze through age 11 years. Asthma prevalence by age 11 years varied by cohort, with an overall median prevalence of 25%. Black children (HR, 1.47; 95% CI, 1.26-1.73) and Hispanic children (HR, 1.29; 95% CI, 1.09-1.53) were at significantly increased risk for asthma incidence compared with White children, with onset occurring earlier in childhood. Children born in tracts with a greater proportion of low-income households, population density, and poverty had increased asthma incidence. Results for early and persistent wheeze were similar. In effect modification analysis, census variables did not significantly modify the association between race and ethnicity and risk for asthma incidence; Black and Hispanic children remained at higher risk for asthma compared with White children across census tracts socioeconomic levels. Conclusions and Relevance: Adjusting for individual-level characteristics, we observed neighborhood socioeconomic disparities in childhood wheeze and asthma. Black and Hispanic children had more asthma in neighborhoods of all income levels. Neighborhood- and individual-level characteristics and their root causes should be considered as sources of respiratory health inequities.

How Do Dental Clinicians Obtain Up-To-Date Patient Medical Histories? Modeling Strengths, Drawbacks, and Proposals for Improvements.

Background: Access to up-to-date patient medical history is essential for dental clinicians (DCs) to avoid potential harm to patients and to improve dental treatment outcomes. The predominant approach for dental clinicians (DCs) to gather patients' medical history is through patient-reported medical histories and medical consults. However, studies reported varied concordance and reliability of patient-reported medical conditions and medication histories compared to the patient medical records and this process also places a significant burden on patients. Information technology tools/platforms such as an integrated electronic health record containing an electronic dental record module may address these issues. However, these integrated systems are expensive and technically complex and may not be easily adopted by DCs in solo and small group practice who provide the most dental care. The recent expansion of regional healthcare information exchange (HIE) provides another approach, but to date, studies on connecting DCs with HIE are very limited. Our study objectives were to model different aspects of the current approaches to identify the strengths and weaknesses, and then model the HIE approach that addresses the weaknesses and retain the strengths of current approaches. The models of current approaches identified the people, resources, organizational aspects, workflow, and areas for improvement; while models of the HIE approach identified system requirements, functions, and processes that may be shared with software developers and other stakeholders for future development. Methods: There are three phases in this study. In Phase 1, we retrieved peer-reviewed PubMed indexed manuscripts published between January 2013 and November 2020 and extracted modeling related data from selected manuscripts. In Phase 2, we built models for the current approaches by using the Integrated DEFinition Method 0 function modeling method (IDEF0), the Unified Modeling Language (UML) Use Case Diagram, and Business Process Model and Notation (BPMN) methods. In Phase 3, we created three conceptual models for the HIE approach. Results: From the 47 manuscripts identified, three themes emerged: 1) medical consult process following patient-reported medical history, 2) integrated electronic dental record-electronic health record (EDR-EHR), and 3) HIE. Three models were built for each of the three themes. The use case diagrams described the actions of the dental patients, DCs, medical providers and the use of information systems (EDR-EHR/HIE). The IDEF0 models presented the major functions involved. The BPMN models depicted the detailed steps of the process and showed how the patient's medical history information flowed through different steps. The strengths and weaknesses revealed by the models of the three approaches were also compared. Conclusions: We successfully modeled the DCs' current approaches of accessing patient medical history and designed an HIE approach that addressed the current approaches' weaknesses as well as leveraged their strengths. Organizational management and end-users can use this information to decide the optimum approach to integrate dental and medical care. The illustrated models are comprehensive and can also be adopted by EHR and EDR vendors to develop a connection between dental systems and HIEs.

A research agenda to support the development and implementation of genomics-based clinical informatics tools and resources.

OBJECTIVE: The Genomic Medicine Working Group of the National Advisory Council for Human Genome Research virtually hosted its 13th genomic medicine meeting titled "Developing a Clinical Genomic Informatics Research Agenda". The meeting's goal was to articulate a research strategy to develop Genomics-based Clinical Informatics Tools and Resources (GCIT) to improve the detection, treatment, and reporting of genetic disorders in clinical settings. MATERIALS AND METHODS: Experts from government agencies, the private sector, and academia in genomic medicine and clinical informatics were invited to address the meeting's goals. Invitees were also asked to complete a survey to assess important considerations needed to develop a genomic-based clinical informatics research strategy. RESULTS: Outcomes from the meeting included identifying short-term research needs, such as designing and implementing standards-based interfaces between laboratory information systems and electronic health records, as well as long-term projects, such as identifying and addressing barriers related to the establishment and implementation of genomic data exchange systems that, in turn, the research community could help address. DISCUSSION: Discussions centered on identifying gaps and barriers that impede the use of GCIT in genomic medicine. Emergent themes from the meeting included developing an implementation science framework, defining a value proposition for all stakeholders, fostering engagement with patients and partners to develop applications under patient control, promoting the use of relevant clinical workflows in research, and lowering related barriers to regulatory processes. Another key theme was recognizing pervasive biases in data and information systems, algorithms, access, value, and knowledge repositories and identifying ways to resolve them.

Social determinants of health and pediatric cancer survival: A systematic review.

Despite treatment advancements and improved survival, approximately 1800 children in the United States will die of cancer annually. Survival may depend on nonclinical factors, such as economic stability, neighborhood and built environment, health and health care, social and community context, and education, otherwise known as social determinants of health (SDoH). Extant literature reviews have linked socioeconomic status (SES) and race to disparate outcomes; however, these are not inclusive of all SDoH. Thus, we conducted a systematic review on associations between SDoH and survival in pediatric cancer patients. Of the 854 identified studies, 25 were included in this review. In addition to SES, poverty and insurance coverage were associated with survival. More studies that include other SDoH, such as social and community factors, utilize prospective designs, and conduct analyses with more precise SDoH measures are needed.

Enhancing cancer prevention and survivorship care with a videoconferencing model for continuing education: a mixed-methods study to identify barriers and incentives to participation.

OBJECTIVE: To enhance cancer prevention and survivorship care by local health care providers, a school of public health introduced an innovative telelearning continuing education program using the Extension for Community Healthcare Outcomes (ECHO) model. In ECHO's hub and spoke structure, synchronous videoconferencing connects frontline health professionals at various locations ("spokes") with experts at the facilitation center ("hub"). Sessions include experts' didactic presentations and case discussions led by spoke site participants. The objective of this study was to gain a better understanding of the reasons individuals choose or decline to participate in the Cancer ECHO program and to identify incentives and barriers to doing so. MATERIALS AND METHODS: Study participants were recruited from the hub team, spoke site participants, and providers who attended another ECHO program but not this one. Participants chose to take a survey or be interviewed. The Consolidated Framework for Implementation Research guided qualitative data coding and analysis. RESULTS: We conducted 22 semistructured interviews and collected 30 surveys. Incentives identified included the program's high-quality design, supportive learning climate, and access to information. Barriers included a lack of external incentives to participate and limited time available. Participants wanted more adaptability in program timing to fit providers' busy schedules. CONCLUSION: Although the merits of the Cancer ECHO program were widely acknowledged, adaptations to facilitate participation and emphasize the program's benefits may help overcome barriers to attending. As the number of telelearning programs grows, the results of this study point to ways to expand participation and spread health benefits more widely.

Ambiguous and Incomplete: Natural Language Processing Reveals Problematic Reporting Styles in Thyroid Ultrasound Reports.

OBJECTIVE: Natural language processing (NLP) systems convert unstructured text into analyzable data. Here, we describe the performance measures of NLP to capture granular details on nodules from thyroid ultrasound (US) reports and reveal critical issues with reporting language. METHODS: We iteratively developed NLP tools using clinical Text Analysis and Knowledge Extraction System (cTAKES) and thyroid US reports from 2007 to 2013. We incorporated nine nodule features for NLP extraction. Next, we evaluated the precision, recall, and accuracy of our NLP tools using a separate set of US reports from an academic medical center (A) and a regional health care system (B) during the same period. Two physicians manually annotated each test-set report. A third physician then adjudicated discrepancies. The adjudicated "gold standard" was then used to evaluate NLP performance on the test-set. RESULTS: A total of 243 thyroid US reports contained 6,405 data elements. Inter-annotator agreement for all elements was 91.3%. Compared with the gold standard, overall recall of the NLP tool was 90%. NLP recall for thyroid lobe or isthmus characteristics was: laterality 96% and size 95%. NLP accuracy for nodule characteristics was: laterality 92%, size 92%, calcifications 76%, vascularity 65%, echogenicity 62%, contents 76%, and borders 40%. NLP recall for presence or absence of lymphadenopathy was 61%. Reporting style accounted for 18% errors. For example, the word "heterogeneous" interchangeably referred to nodule contents or echogenicity. While nodule dimensions and laterality were often described, US reports only described contents, echogenicity, vascularity, calcifications, borders, and lymphadenopathy, 46, 41, 17, 15, 9, and 41% of the time, respectively. Most nodule characteristics were equally likely to be described at hospital A compared with hospital B. CONCLUSIONS: NLP can automate extraction of critical information from thyroid US reports. However, ambiguous and incomplete reporting language hinders performance of NLP systems regardless of institutional setting. Standardized or synoptic thyroid US reports could improve NLP performance.

Informatics education for translational research teams: An unrealized opportunity to strengthen the national research infrastructure.

Objective: To identify the informatics educational needs of clinical and translational research professionals whose primary focus is not informatics. Introduction: Informatics and data science skills are essential for the full spectrum of translational research, and an increased understanding of informatics issues on the part of translational researchers can alleviate the demand for informaticians and enable more productive collaborations when informaticians are involved. Identifying the level of interest in different topics among various types of of translational researchers will help set priorities for development and dissemination of informatics education. Methods: We surveyed clinical and translational science researchers in Clinical and Translational Science Award (CTSA) programs about their educational needs and preferences. Results: Researchers from 23 out of the 62 CTSA hubs responded to the survey. 67% of respondents across roles and topics expressed interest in learning about informatics topics. There was high interest in all 30 topics included in the survey, with some variation in interest depending on the role of the respondents. Discussion: Our data support the need to advance training in clinical and biomedical informatics. As the complexity and use of information technology and data science in research studies grows, informaticians will continue to be a limited resource for research collaboration, education, and training. An increased understanding of informatics issues across translational research teams can alleviate this burden and allow for more productive collaborations. To inform a roadmap for informatics education for research professionals, we suggest strategies to use the results of this needs assessment to develop future informatics education.

The Impact of Diagnostic Decisions on Patient Experience in the Pediatric Emergency Department.

OBJECTIVE: Patient experience serves as both a subjective measure of value-based health care delivery and a metric to inform operational decision making. The objective of this study was to determine if specific diagnostic and therapeutic interventions affect patient experience scores for children seen in the emergency department. METHODS: We performed a retrospective observational study in the emergency department of a large quaternary care children's hospital on patients who were discharged to home and later completed a National Research Corporation Health patient experience survey. We matched the survey results to electronic health record (EHR) data and were able to extract demographics, operational metrics, and order information for each patient. We performed multiple logistic regression analyses to determine the association of image acquisition, laboratory test ordering, medication administration, and discharge prescribing with likelihood to recommend the facility as our measure of patient experience. RESULTS: Of the 4103 patients who met inclusion criteria for the study, 75% strongly recommended the facility. Longer wait times were associated with lower patient experience scores [odds ratio (OR) per waiting room hour increase, 0.72; 95% confidence interval (CI), 0.65-0.81]. Significant diagnostic factors associated with higher patient experience included magnetic resonance imaging ordering (OR, 2.38; 95% CI, 1.00-5.67), x-ray ordering (OR, 1.19; 95% CI, 1.00-1.42), and electrocardiogram ordering (OR, 1.62; 95% CI, 1.07-2.44). Of the treatment factors studied, only antibiotic prescribing at discharge was found to have a significant positive association with patient experience (OR, 1.32; 95% CI, 1.08-1.63). CONCLUSION: The positive association between more intensive diagnostic workups and patient experience could have implications on the utility of patient experience scores to evaluate pediatric care teams. Consideration should be taken to interpret patient experience scores in the context of compliance with approaches in evidence-based medicine.