A maturity grid assessment tool for learning networks.

BACKGROUND: The vision of learning healthcare systems (LHSs) is attractive as a more effective model for health care services, but achieving the vision is complex. There is limited literature describing the processes needed to construct such multicomponent systems or to assess development. METHODS: We used the concept of a capability maturity matrix to describe the maturation of necessary infrastructure and processes to create learning networks (LNs), multisite collaborative LHSs that use an actor-oriented network organizational architecture. We developed a network maturity grid (NMG) assessment tool by incorporating information from literature review, content theory from existing networks, and expert opinion to establish domains and components. We refined the maturity grid in response to feedback from network leadership teams. We followed NMG scores over time for nine LNs and plotted scores for each domain component with respect to SD for one participating network. We sought subjective feedback on the experience of applying the NMG to individual networks. RESULTS: LN leaders evaluated the scope, depth, and applicability of the NMG to their networks. Qualitative feedback from network leaders indicated that changes in NMG scores over time aligned with leaders' reports about growth in specific domains; changes in scores were consistent with network efforts to improve in various areas. Scores over time showed differences in maturation in the individual domains of each network. Scoring patterns, and SD for domain component scores, indicated consistency among LN leaders in some but not all aspects of network maturity. A case example from a participating network highlighted the value of the NMG in prompting strategic discussions about network development and demonstrated that the process of using the tool was itself valuable. CONCLUSIONS: The capability maturity grid proposed here provides a framework to help those interested in creating Learning Health Networks plan and develop them over time.

The Role of Certifying Boards in Improving Health: The Example of the American Board of Pediatrics.

The quality of care for children and adults in the United States is variable and often suboptimal. Approaches that improve the systems of care for entire patient populations are needed. The certifying medical boards can contribute to driving change by ensuring that improving care and outcomes for patients and families is the priority. The American Board of Pediatrics has catalyzed collaborative improvement networks, resulting in improved health outcomes for children, fostered partnerships with patients and families, and brought together key stakeholders to advocate for network improvement efforts for sickle cell disease as one action to address health disparities. Similar concerted efforts by certifying boards in collaboration with physicians and patients can improve the quality of care and lead to better patient outcomes.

Design and implementation of a decision aid for juvenile idiopathic arthritis medication choices.

BACKGROUND: Randomized trials have demonstrated the efficacy of patient decision aids to facilitate shared decision making in clinical situations with multiple medically reasonable options for treatment. However, little is known about how best to implement these tools into routine clinical practice. In addition, reliable implementation of decision aids has been elusive and spread within pediatrics has been slow. We sought to develop and reliably implement a decision aid for treatment of children with juvenile idiopathic arthritis. METHODS: To design our decision aid, we partnered with patient, parent, and clinician stakeholders from the Pediatric Rheumatology Care and Outcomes Improvement Network. Six sites volunteered to use quality improvement methods to implement the decision aid. Four of these sites collected parent surveys following visits to assess outcomes. Parents reported on clinician use of the decision aid and the amount of shared decision making and uncertainty they experienced. We used chi-square tests to compare eligible visits with and without use of the decision aid on the experience of shared decision making and uncertainty. RESULTS: After 18 rounds of testing and revision, stakeholders approved the decision aid design for regular use. Qualitative feedback from end-users was positive. During the implementation project, the decision aid was used in 35% of visits where starting or switching medication was discussed. Clinicians used the decision aid as intended in 68% of these visits. The vast majority of parents reported high levels of shared decision making following visits with (64/76 = 84%) and without (80/95 = 84%) use of the decision aid (p = 1). Similarly, the vast majority of parents reported no uncertainty following visits with (74/76 = 97%) and without (91/95 = 96%) use of the decision aid (p = 0.58). CONCLUSIONS: Although user acceptability of the decision aid was high, reliable implementation in routine clinical care proved challenging. Our parsimonious approach to outcome assessment failed to detect a difference between visits with and without use of our aid. Innovative approaches are needed to facilitate use of decision aids and the assessment of outcomes.

A Statewide Progestogen Promotion Program in Ohio.

OBJECTIVE: To promote use of progestogen therapy to reduce premature births in Ohio by 10%. METHODS: The Ohio Perinatal Quality Collaborative initiated a quality improvement project in 2014 working with clinics at 20 large maternity hospitals, Ohio Medicaid, Medicaid insurers, and service agencies to use quality improvement methods to identify eligible women and remove treatment barriers. The number of women eligible for prophylaxis, the percent prescribed a progestogen before 20 and 24 weeks of gestation, and barriers encountered were reported monthly. Clinics were asked to adopt protocols to identify candidates and initiate treatment promptly. System-level changes were made to expand Medicaid eligibility, maintain Medicaid coverage during pregnancy, improve communication, and adopt uniform data collection and efficient treatment protocols. Rates of singleton births before 32 and 37 weeks of gestation in Ohio hospitals were primary outcomes. We used statistical process control methods to analyze change and generalized linear mixed models to estimate program effects accounting for known risk factors. RESULTS: Participating sites tracked 2,562 women eligible for treatment between January 1, 2014, and November 30, 2015. Late entry to care, variable interpretation of treatment guidelines, maintenance of Medicaid coverage, and inefficient communication among health care providers and insurers were identified as treatment barriers. Births before 32 weeks of gestation decreased in all hospitals by 6.6% and in participating hospitals by 8.0%. Births before 32 weeks of gestation to women with prior preterm birth decreased by 20.5% in all hospitals, by 20.3% in African American women, and by 17.1% in women on Medicaid. Births before 37 weeks of gestation were minimally affected. Adjusting for risk factors and birth clustering by hospital confirmed a program-associated 13% (95% confidence interval 0.3-24%) reduction in births before 32 weeks of gestation to women with prior preterm birth. CONCLUSION: The Ohio progestogen project was associated with a sustained reduction in singleton births before 32 weeks of gestation in Ohio.

Piloting a Statewide Home Visiting Quality Improvement Learning Collaborative.

Objective To pilot test a statewide quality improvement (QI) collaborative learning network of home visiting agencies. Methods Project timeline was June 2014-May 2015. Overall objectives of this 8-month initiative were to assess the use of collaborative QI to engage local home visiting agencies and to test the use of statewide home visiting data for QI. Outcome measures were mean time from referral to first home visit, percentage of families with at least three home visits per month, mean duration of participation, and exit rate among infants <6 months. Of 110 agencies, eight sites were selected based on volume, geography, and agency leadership. Our adapted Breakthrough Series model included monthly calls with performance feedback and cross-agency learning. A statewide data system was used to generate monthly run charts. Results Mean time from referral to first home visit was 16.7 days, and 9.4% of families received ≥3 visits per month. Mean participation was 11.7 months, and the exit rate among infants <6 months old was 6.1%. Agencies tested several strategies, including parent commitment agreements, expedited contact after referral, and Facebook forums. No shift in outcome measures was observed, but agencies tracked intermediate process changes using internal site-specific data. Agencies reported positive experiences from participation including more frequent and structured staff meetings. Conclusions for Practice Within a pilot QI learning network, agencies tested and measured changes using statewide and internal data. Potential next steps are to develop and test new metrics with current pilot sites and a larger collaborative.

Pediatric collaborative networks for quality improvement and research.

Despite efforts of individual clinicians, pediatric practices, and institutions to remedy continuing deficiencies in pediatric safety and health care quality, multiple gaps and disparities exist. Most pediatric diseases are rare; thus, few practices or centers care for sufficient numbers of children, particularly in subspecialties, to achieve large and representative sample sizes, and substantial between-site variation in care and outcomes persists. Pediatric collaborative improvement networks are multi-site clinical networks that allow practice-based teams to learn from one another, test changes to improve quality, and use their collective experience and data to understand, implement, and spread what works in practice. The model was initially developed in 2002 by an American Board of Pediatrics Workgroup to accelerate the translation of evidence into practice, improve care and outcomes for children, and to serve as the gold standard for the performance in practice component of Maintenance of Certification requirements. Many features of an improvement network derive from the Institute for Healthcare Improvement's collaborative improvement model Breakthrough Series, including focus on a high-impact condition or topic; providing support from clinical content and quality improvement experts; using the Model for Improvement to set aims, use data for feedback, and test changes iteratively; providing infrastructure support for data collection, analysis and reporting, and quality improvement coaching; activities to enhance collaboration; and participation of multidisciplinary teams from multiple sites. In addition, they typically include a population registry of the children receiving care for the improvement topic of interest. These registries provide large and representative study samples with high-quality data that can be used to generate information and evidence, as well as to inform clinical decision making. In addition to quality improvement, networks serve as large-scale health system laboratories, providing the social, scientific, and technical infrastructure and data for multiple types of research. Statewide, regional, and national pediatric collaborative networks have demonstrated improvements in primary care practice as well as care for chronic pediatric diseases (eg, asthma, cystic fibrosis, inflammatory bowel disease, congenital heart disease), perinatal care, and patient safety (eg, central line-associated blood stream infections, adverse medication events, surgical site infections); many have documented improved outcomes. Challenges to spreading the improvement network model exist, including the need for the identification of stable funding sources. However, these barriers can be overcome, allowing the benefits of improved care and outcomes to spread to additional clinical and safety topics and care processes for the nation's children.

Understanding treatment decision making in juvenile idiopathic arthritis: a qualitative assessment.

BACKGROUND: The increase in therapeutic options for juvenile idiopathic arthritis (JIA) has added complexity to treatment decisions. Shared decision making has the potential to help providers and families work together to choose the best possible option for each patient from the array of choices. As part of a needs assessment, prior to design and implementation of shared decision making interventions, we conducted a qualitative assessment of clinicians' current approaches to treatment decision making in JIA. METHODS: Pediatric rheumatology clinicians were recruited from 2 academic children's hospitals affiliated with a quality improvement learning network, using purposive and snowball sampling. Semi-structured interviews elicited how clinicians with prescribing authority (n = 10) interact with families to make treatment decisions. Interviews were audio-recorded and transcribed verbatim. A multi-disciplinary research team used content analysis to analyze the interview data.To validate data from individual interviews and enrich our understanding, we presented the interview results to pediatric rheumatology clinicians attending a learning network meeting (n = 24 from 12 children's hospitals). We then asked the clinicians questions to further identify and discuss areas of variation in the decision-making processes. RESULTS: Clinicians described a decision-making process in which they, rather than the family or other care team members, consistently initiated treatment decisions. Initial treatment options presented to families generally reflected the clinician's preferred treatment approaches, which differed across clinicians. Clinicians used various methods to inform families about treatment options and tailor information according to perceptions of a family's information needs, level of comprehension or mood (e.g. anxiety). The attributes of medication presented to families fell into 4 categories: benefits, risks, logistics and family preferences. Clinicians typically included family members in the decision to initiate JIA treatment after limiting the options to fit the clinical situation and the clinician's own preferences. Family members' preferences were seen as more integral in the decision to stop treatment after symptom remission. CONCLUSIONS: Decision making about initial JIA treatment appears to be largely driven by clinician preferences. Family preferences are more likely to be considered for treatment discontinuation. Opportunities exist to develop, test, and implement tools to facilitate shared decision making in pediatric rheumatology.

Exemplar pediatric collaborative improvement networks: achieving results.

A number of pediatric collaborative improvement networks have demonstrated improved care and outcomes for children. Regionally, Cincinnati Children's Hospital Medical Center Physician Hospital Organization has sustained key asthma processes, substantially increased the percentage of their asthma population receiving "perfect care," and implemented an innovative pay-for-performance program with a large commercial payor based on asthma performance measures. The California Perinatal Quality Care Collaborative uses its outcomes database to improve care for infants in California NICUs. It has achieved reductions in central line-associated blood stream infections (CLABSI), increased breast-milk feeding rates at hospital discharge, and is now working to improve delivery room management. Solutions for Patient Safety (SPS) has achieved significant improvements in adverse drug events and surgical site infections across all 8 Ohio children's hospitals, with 7700 fewer children harmed and >$11.8 million in avoided costs. SPS is now expanding nationally, aiming to eliminate all events of serious harm at children's hospitals. National collaborative networks include ImproveCareNow, which aims to improve care and outcomes for children with inflammatory bowel disease. Reliable adherence to Model Care Guidelines has produced improved remission rates without using new medications and a significant increase in the proportion of Crohn disease patients not taking prednisone. Data-driven collaboratives of the Children's Hospital Association Quality Transformation Network initially focused on CLABSI in PICUs. By September 2011, they had prevented an estimated 2964 CLABSI, saving 355 lives and $103,722,423. Subsequent improvement efforts include CLABSI reductions in additional settings and populations.

Center variation in hospital costs for patients undergoing congenital heart surgery.

BACKGROUND: Congenital heart disease consumes significant health care resources; however, there are limited data regarding factors affecting resource utilization. The purpose of this study was to evaluate variation between centers in total hospital costs for 4 congenital heart operations of varying complexity and associated factors. METHODS AND RESULTS: The Premier Database was used to evaluate total cost in children undergoing isolated atrial septal defect (ASD) repair, ventricular septal defect (VSD) repair, tetralogy of Fallot (TOF) repair, or arterial switch operation (ASO) from 2001 to 2007. Mixed models were used to evaluate the impact of center on total hospital costs adjusting for patient and center characteristics and length of stay. A total of 2124 patients were included: 719 ASD (19 centers), 792 VSD (20 centers), 420 TOF (17 centers), and 193 ASO (13 centers). Total cost increased with complexity of operation from median $12 761 (ASD repair) to $55 430 (ASO). In multivariable analysis, models that accounted for center effects versus those that did not performed significantly better for all 4 surgeries (all P≤0.01). The proportion of total cost variation explained by center was 19% (ASD repair), 11% (VSD repair), 6% (TOF repair), and 3% (ASO). Higher-volume centers had significantly lower hospital costs for ASD and VSD repair but not for TOF repair and ASO. CONCLUSIONS: Total hospital costs varied significantly by center for all congenital heart surgeries evaluated, even after adjustment for patient and center characteristics and length of stay. Differences among centers were most prominent for lower complexity procedures.

Special challenges in comparative effectiveness research on children's and adolescents' health.

The United States is undertaking a major expansion of comparative effectiveness research, with the potential to achieve systemwide improvements in health care quality, outcomes, and resource allocation. However, to achieve these improvements in children's health and health care, comparative effectiveness research needs to be targeted, designed, conducted, and reported in ways that are responsive to the unique circumstances of children and adolescents. These include clinically important differences in the type and course of disease in children; demographic differences between the overall child and adult population in the United States, such as racial and ethnic makeup; and methodological issues involving study design. Our overarching point is that the base of evidence in pediatrics must not fall even further behind that for the adult population in an era of rapid advancement and funding of comparative effectiveness research.

Health literacy and quality: focus on chronic illness care and patient safety.

Despite a heightened focus on improving quality, recent studies have suggested that children only receive half of the indicated preventive, acute, or chronic care. Two major areas in need of improvement are chronic illness care and prevention of medical errors. Recently, health literacy has been identified as an important and potentially ameliorable factor for improving quality of care. Studies of adults have documented that lower health literacy is independently associated with poorer understanding of prescriptions and other medical information and worse chronic disease knowledge, self-management behaviors, and clinical outcomes. There is also growing evidence to suggest that health literacy is important in pediatric safety and chronic illness care. Adult studies have suggested that addressing literacy can lead to improved patient knowledge, behaviors, and outcomes. Early studies in the field of pediatrics have shown similar promise. There are significant opportunities to evaluate and demonstrate the importance of health literacy in improving pediatric quality of care. Efforts to address health literacy should be made to apply the 6 Institute of Medicine aims for quality-care that is safe, effective, patient centered, timely, efficient, and equitable. Efforts should also be made to consider the distinct nature of pediatric care and address the "4 D's" unique to child health: the developmental change of children over time; dependency on parents or adults; differential epidemiology of child health; and the different demographic patterns of children and their families.

Disseminating QI interventions.

BACKGROUND: Partnerships contributed to the success of three diverse health care quality improvement (QI) projects. The Partnerships for Quality (PFQ) Dissemination Planning Tool was used to identify the most appropriate partners to disseminate the QI interventions for three projects, that is, partners most likely to reach and influence the target user(s)-(1) the Catholic Healthcare Partners Heart Failure Partnership, a multisite demonstration of the efficacy of a collaborative approach in the management of heart failure, (2) the Center for Value Purchasing, a collaborative study of the effects of quality incentives on the delivery of chronic disease care, and (3) the New York State Information Dissemination project, a collaborative partnership that targeted dissemination of evidence-based practices in the long term care setting. RESULTS: The RE-AIM model, a construct to aid planning, implementation, and evaluation of health behavior interventions, was used as a framework to examine the impact of partnerships on the three collaborative projects. DISCUSSION: When carefully selected and nurtured, partnerships can substantially facilitate the dissemination and impact of quality improvement projects. The PFQ Dissemination Planning Tool was helpful in identifying and developing strategies for working with partners who could facilitate dissemination of promising practices. The RE-AIM model was a useful framework for examining the impact of the partnerships on the QI projects.

Organizational characteristics and preventive service delivery in private practices: a peek inside the "black box" of private practices caring for children.

OBJECTIVE: Although privately owned practices provide the majority of primary care for children, little is known about the organizational characteristics of these practices or how these characteristics affect the quality of care for children. The purpose of this study was to describe selected organizational characteristics and preventive service delivery features that might affect the quality of primary care for children in private practices. METHODS: A cross-sectional study of 44 private pediatric and family medicine practices in 2 regions of North Carolina was performed. Preventive service performance was assessed through chart abstraction for 60 randomly selected children between 24 and 30 months of age, for evaluation of immunizations and anemia, tuberculosis, and lead screening delivery by 2 years of age. Organizational characteristics were determined through surveys of all physicians and staff members. We used descriptive statistics and scatter plots to describe variations in organizational characteristics and preventive services. RESULTS: Overall, practices demonstrated low levels of preventive service performance, with substantial variation among practices. Only 39% of children received 3 of the 4 recommended preventive services measured (practice range: 2-88%). Few practices demonstrated evidence of a systematic approach to prevention. For example, only 12 (27%) of the 44 practices used >1 of 5 recommended preventive service delivery strategies. Furthermore, practices varied greatly with respect to many of the measured organizational characteristics, which were consistent with organizational stress in some cases. For example, turnover of clinicians and staff members was remarkably high, with practices losing an average of 27% of their clinicians every 4 years (range: 0-170%) and 39% of their office staff members every 2 years (range: 0-170%). CONCLUSIONS: Private practices caring for children in North Carolina demonstrated low overall performance for the 4 recommended preventive services examined, with large variations among practices. Few practices had evidence of comprehensive systems for prevention. There was also evidence of substantial variation in many organizational characteristics. Some organizational characteristics were at levels that might impede delivery of high-quality primary care for children. These findings suggest a growing need for research that examines the impact of organizational characteristics on the quality of care in private practices.

Otitis media, hearing loss, and language learning: controversies and current research.

This article reviews research on the possible linkage of otitis media with effusion (OME) to children's hearing and development, identifies gaps, and directions for research, and discusses implications for healthcare practices. About half of children with an episode of OME experience a mild hearing loss while about 5-10% of children have moderate hearing loss. Recent prospective and randomized clinical trials suggest none to very small negative associations of OME to children's later language development. Based on both retrospective and prospective longitudinal studies, associations between OME and perceiving speech in noise and tasks that require equal binaural hearing have been reported but have not been adequately studied with regard to functional outcomes. Thus, on average, for typically developing children, OME may not be a substantial risk factor for later speech and language development or academic achievement. However, these conclusions should be interpreted cautiously, since most of these studies used OME rather than hearing loss as the independent variable (although hearing loss rather than OME is hypothesized to affect language development) and many studies did not control for important confounding variables such as socioeconomic status (SES).