Further Experience with the Practice Integration Profile: A Measure of Behavioral Health and Primary Care Integration.

Valid measures of behavioral health integration have the potential to enable comparisons of various models of integration, contribute to the overall development of high-quality care, and evaluate outcomes that are strategically aligned with standard improvement efforts. The Practice Integration Profile has proven to discriminate among clinic types and integration efforts. We continued the validation of the measure's internal consistency, intra-rater consistency, and inter-rater consistency with a separate and larger sample from a broader array of practices. We found that the Practice Integration Profile demonstrated a high level of internal consistency, suggesting empirically sound measurement of independent attributes of integration, and high reliability over time. The Practice Integration Profile provides internally consistent and interpretable results and can serve as both a quality improvement and health services research tool.

Participation in school-related activities that require hand use for children with and without developmental disabilities.

BACKGROUND: Children with developmental disabilities (DD) may experience limited participation in school activities. Little is known about whether school participation of children with DD who attend special schools is impacted. This study specifically focused on physical engagement in school-related activities that require hand use for the comparison between this group of children with DD and typically developing children. METHODS: The sample consisted of 97 children with DD who attended special schools (mean age 8.2 ± 2.9 years; 60 boys and 37 girls) and 105 typically developing children who attended mainstream schools/kindergartens (mean age 8.6 ± 2.4 years; 48 boys and 57 girls). Parents completed the Children's Assessment of Participation with Hands, one of the domains of which captures participation in eight school-related activities involving hand use. RESULTS: Parents of children with DD reported that their children participated less, in terms of the number (χ2  = 8.45-14.97, P ≤ 0.004) and frequency (t = 4.00-6.47, P < 0.001), in four activities than typically developing children. Parents of children with DD also reported that more assistance was needed for their children's participation in all activities (t = 6.93-11.92, P < 0.001), and they wanted their children to participate in most activities more often and more independently (χ2  = 18.46-59.34, P < 0.001). CONCLUSIONS: Differences in participation in school-related activities requiring hand use between children with DD and typically developing children were revealed generally across all participation dimensions (does participate, frequency, independence, and desired change). This study provides information on the areas in which greater efforts are needed to support children's school participation.

Intervention decision-making processes and information preferences of parents of children with autism spectrum disorders.

BACKGROUND: When a child is diagnosed with autism, parents are faced with the task of choosing from many different intervention options. To find information about the options available, parents turn to a number of different sources. This study explores parents' (n = 23) intervention decision-making processes and information preferences following the diagnosis of ASD for their child. METHODS: Qualitative thematic analysis of verbatim transcripts from interviews and focus groups involving parents of children with an autism diagnosis was undertaken. RESULTS: Analysis of the results revealed that there are concurrent emotional and pragmatic intervention 'journeys' undertaken by parents post diagnosis, which encompass the primary themes of: (1) information sources used, (2) parents' information preferences and (3) factors influencing intervention decision making. Parents described a journey from the point of diagnosis that involved seeking information on ASD interventions from multiple sources, with the Internet being the primary source. They were overwhelmed by the sheer volume of information available, and their preferences for information varied according to their stage in the journey post diagnosis. Parents had a 'trial and error' approach to choosing ASD interventions, with confidence increasing as they became more familiar with their child's condition, and had opportunities to explore numerous information sources about their child's diagnosis. While confidence increased over time, consideration of the effectiveness or evidence supporting interventions remained largely absent throughout the journey. CONCLUSION: This study highlights the need for parents of children with ASD to be supported to make informed intervention decisions, particularly with consideration for research evidence.

Health IT-Enabled Care Coordination: A National Survey of Patient-Centered Medical Home Clinicians.

PURPOSE: Health information technology (IT) offers promising tools for improving care coordination. We assessed the feasibility and acceptability of 6 proposed care coordination objectives for stage 3 of the Centers for Medicare and Medicaid Services electronic health record incentive program (Meaningful Use) related to referrals, notification of care from other facilities, patient clinical summaries, and patient dashboards. METHODS: We surveyed physician-owned and hospital/health system-affiliated primary care practices that achieved patient-centered medical home recognition and participated in the Meaningful Use program, and community health clinics with patient-centered medical home recognition (most with certified electronic health record systems). The response rate was 35.1%. We ascertained whether practices had implemented proposed objectives and perceptions of their importance. We analyzed the association of organizational and contextual factors with self-reported use of health IT to support care coordination activities. RESULTS: Although 78% of the 350 respondents viewed timely notification of hospital discharges as very important, only 48.7% used health IT systems to accomplish this task. The activity most frequently supported by health IT was providing clinical summaries to patients, in 76.6% of practices; however, merely 47.7% considered this activity very important. Greater use of health IT to support care coordination activities was positively associated with the presence of a nonclinician responsible for care coordination and the practice's capacity for systematic change. CONCLUSIONS: Even among practices having a strong commitment to the medical home model, the use of health IT to support care coordination objectives is not consistent. Health IT capabilities are not currently aligned with clinicians' priorities. Many practices will need financial and technical assistance for health IT to enhance care coordination.

The 5 R's: an emerging bold standard for conducting relevant research in a changing world.

Research often fails to find its way into practice or policy in a timely way, if at all. Given the current pressure and pace of health care change, many authors have recommended different approaches to make health care research more relevant and rapid. An emerging standard for research, the "5 R's" is a synthesis of recommendations for care delivery research that (1) is relevant to stakeholders; (2) is rapid and recursive in application; (3) redefines rigor; (4) reports on resources required; and (5) is replicable. Relevance flows from substantive ongoing participation by stakeholders. Rapidity and recursiveness occur through accelerated design and peer reviews followed by short learning/implementation cycles through which questions and answers evolve over time. Rigor is the disciplined conduct of shared learning within the specific changing situations in diverse settings. Resource reporting includes costs of interventions. Replicability involves designing for the factors that may affect subsequent implementation of an intervention or program in different contexts. These R's of the research process are mutually reinforcing and can be supported by training that fosters collaborative and reciprocal relationships among researchers, implementers, and other stakeholders. In sum, a standard is emerging for research that is both rigorous and relevant. Consistent and bold application will increase the value, timeliness, and applicability of the research enterprise.

Measures of participation outcomes related to hand use for 2- to 12-year-old children with disabilities: a systematic review.

Many interventions have been used to improve children's hand-related impairments or hand skill performance in functional activities so as to promote life participation. There is thus a need to have suitable instruments assessing children's participation in life situations that specifically require hand use in order to support and evaluate such interventions. This systematic review investigated the availability of potential instruments that can be used to assess children's participation specifically in life situations requiring hand use. Clinical utility and evidence for psychometric properties were also sourced. Database searches initially identified measures that were used to evaluate participation of children aged 2-12 years, involved self- or proxy report or interview administration and had generic application for a range of disabilities/diagnoses. These measures were further evaluated to determine if they fulfilled the above inclusion criteria and contained at least 60% of the items involving hand use. Further searches for psychometric evidence were undertaken for the eligible measures. Fourteen measures were identified and nine met the inclusion criteria. However, none of these measures, except for the Children Helping Out: Responsibilities, Expectations, and Supports (CHORES), contained all items related to hand use. Most of the included measures had limited psychometric properties. Only the Children's Assessment of Participation and Enjoyment/Preferences for Activities of Children (CAPE/PAC), the School Function Assessment-Participation section (SFA-P) and the Children Participation Questionnaire (CPQ) revealed sufficient evidence of validity and reliability. The findings suggest a need for adapting existing participation measures or developing new ones that specifically assess participation in life situations requiring hand use to support interventions.

Benefits and harms of treatments for chronic nonspecific low back pain without radiculopathy: systematic review and meta-analysis.

BACKGROUND CONTEXT: Currently, there are no published studies that compare nonpharmacological, pharmacological and invasive treatments for chronic low back pain in adults and provide summary statistics for benefits and harms. PURPOSE: The aim of this review was to compare the benefits and harms of treatments for the management of chronic low back pain without radiculopathy and to report the findings in a format that facilitates direct comparison (Benefit-Harm Scale: level 1 to 7). DESIGN: Systematic review and meta-analysis of randomized controlled trials, including trial registries, from electronic databases up to 23rd May 2022. PATIENT SAMPLE: Adults with chronic nonspecific low back pain, excluding radicular pain, in any clinical setting. OUTCOME MEASURES: Comparison of pain at immediate-term (≤2 weeks) and short-term (>2 weeks to ≤12 weeks) and serious adverse events using the Benefit-Harm Scale (level 1 to 7). METHODS: This was a registered systematic review and meta-analysis of randomized controlled trials. Interventions included nonpharmacological (acupuncture, spinal manipulation), pharmacological and invasive treatments compared to placebo. Best evidence criteria was used. Two independent reviewers conducted eligibility assessment, data extraction and quality appraisal. RESULTS: The search retrieved 17,362 records. Three studies provided data on the benefits of interventions, and 30 provided data on harms. Studies included interventions of acupuncture (n=8); manipulation (n=2); pharmacological therapies (n=9), including NSAIDs and opioid analgesics; surgery (n=8); and epidural corticosteroid injections (n=3). Acupuncture (standardized mean difference (SMD) -0.51, 95%CI -0.88 to -0.14, n=1 trial, moderate quality of evidence, benefit rating of 3) and manipulation (SMD -0.39, 95%CI -0.56 to -0.21, n=2 trials, moderate quality of evidence, benefit rating of 5) were effective in reducing pain intensity compared to sham. The benefit of the other interventions was scored as uncertain due to not being effective, statistical heterogeneity preventing pooling of effect sizes, or the absence of relevant trials. The harms level warnings were at the lowest (eg, indicating rarer risk of events) for acupuncture, spinal manipulation, NSAIDs, combination ingredient opioids, and steroid injections, while they were higher for single ingredient opioid analgesics (level 4) and surgery (level 6). CONCLUSIONS: There is uncertainty about the benefits and harms of all the interventions reviewed due to the lack of trials conducted in patients with chronic nonspecific low back pain without radiculopathy. From the limited trials conducted, nonpharmacological interventions of acupuncture and spinal manipulation provide safer benefits than pharmacological or invasive interventions. However, more research is needed. There were high harms ratings for opioids and surgery.

Association of Race and Risk of Future Scleroderma Renal Crisis at Systemic Sclerosis Diagnosis.

OBJECTIVE: Scleroderma renal crisis (SRC) is a rare and severe manifestation of systemic sclerosis (SSc). Although it is well documented that Black patients with SSc have worse morbidity and mortality than non-Black patients, racial predilection for SRC is underreported. We examine the association of race and future development of SRC in an SSc cohort. METHODS: Using the electronic health record of the US Military Health System, we conducted a comprehensive chart review of each patient with SSc from 2005 to 2016. The final study cohort was comprised of 31 SRC cases and 322 SSc without SRC controls. We conducted logistic regression of SRC as the outcome variable and race (Black versus non-Black) as the primary predictor variable, adjusted for age, estimated glomerular filtration rate, hypertension, and proteinuria at SSc diagnosis. RESULTS: Of 353 patients, 294 had identifiable race (79 Black, 215 non-Black). Thirteen of 79 Black patients (16.5%) versus 16 of 215 (7.4%) non-Black patients developed SRC (P = 0.02). On adjusted analysis, Black patients had a significantly higher risk of developing SRC than non-Black patients (odds ratio 6.4 [95% confidence interval 1.3-31.2], P = 0.02). Anti-Ro antibody was present in a higher proportion of Black SRC patients versus Black patients without SRC (45% versus 14%, P = 0.01). Conversely, older age, thrombocytopenia, and anti-RNA polymerase III antibody at SSc diagnosis were significantly associated with future SRC in the non-Black cohort. CONCLUSION: Black race was independently associated with a higher risk of future SRC. Further studies are needed to elucidate the mechanisms that underlie this important association.

Understanding and applying the RE-AIM framework: Clarifications and resources.

INTRODUCTION: Understanding, categorizing, and using implementation science theories, models, and frameworks is a complex undertaking. The issues involved are even more challenging given the large number of frameworks and that some of them evolve significantly over time. As a consequence, researchers and practitioners may be unintentionally mischaracterizing frameworks or basing actions and conclusions on outdated versions of a framework. METHODS: This paper addresses how the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework has been described, summarizes how the model has evolved over time, and identifies and corrects several misconceptions. RESULTS: We address 13 specific areas where misconceptions have been noted concerning the use of RE-AIM and summarize current guidance on these issues. We also discuss key changes to RE-AIM over the past 20 years, including the evolution to Pragmatic Robust Implementation and Sustainability Model, and provide resources for potential users to guide application of the framework. CONCLUSIONS: RE-AIM and many other theories and frameworks have evolved, been misunderstood, and sometimes been misapplied. To some degree, this is inevitable, but we conclude by suggesting some actions that reviewers, framework developers, and those selecting or applying frameworks can do to prevent or alleviate these problems.

Identification of Chlamydophila abortus and the development of lesions in placental tissues of experimentally infected sheep.

Chlamydophila (C.) abortus is a major cause of infectious abortion in sheep in many countries. Twenty-one pregnant sheep were experimentally infected intranasally with C. abortus at 70 days of gestation (dg). Thereafter, a number of animals were killed at weekly intervals and a post-mortem examination was carried out. Evidence of chlamydial infection in the placenta was determined by isolation of the bacterium by tissue culture and detection of C. abortus DNA by real-time polymerase chain reaction (real-time PCR). In addition, histopathological changes in the placenta were assessed, as was the detection of chlamydial antigen by immunohistochemistry (IHC). Evidence of placental infection was observed as early as 2 weeks after inoculation, and while only relatively low numbers of bacteria were isolated by culture and/or detected by real-time PCR prior to 113-114dg, at 119-121dg, it was more numerous. This study, using the four criteria for assessment of infection, showed that while C. abortus gained access to the placenta as early as 85dg, characteristic histopathological changes were not apparent until 119/121dg. While the chronology of when the bacterium arrived in the placenta and subsequent lesion development is remarkable for its consistency this paper provides more reliable data on the former which in turn now allows study of the factors that permit its access to this tissue and govern its multiplication and the ensuing triggering of damage.

Risk Factors for Future Scleroderma Renal Crisis at Systemic Sclerosis Diagnosis.

OBJECTIVE: Systemic sclerosis (SSc) is a disease of autoimmunity, fibrosis, and vasculopathy. Scleroderma renal crisis (SRC) is one of the most severe complications. Corticosteroid exposure, presence of anti-RNA polymerase III antibodies (ARA), skin thickness, and significant tendon friction rubs are among the known risk factors at SSc diagnosis for developing future SRC. Identification of additional clinical characteristics and laboratory findings could expand and improve the risk profile for future SRC at SSc diagnosis. METHODS: In this retrospective cohort study of the entire military electronic medical record between 2005 and 2016, we compared the demographics, clinical characteristics, and laboratory results at SSc diagnosis for 31 cases who developed SRC after SSc diagnosis to 322 SSc without SRC disease controls. RESULTS: After adjustment for potential confounding variables, at SSc diagnosis these conditions were all associated with future SRC: proteinuria (p < 0.001; OR 183, 95% CI 19.1-1750), anemia (p = 0.001; OR 9.9, 95% CI 2.7-36.2), hypertension (p < 0.001; OR 13.1, 95% CI 4.7-36.6), chronic kidney disease (p = 0.008; OR 20.7, 95% CI 2.2-190.7), elevated erythrocyte sedimentation rate (p < 0.001; OR 14.3, 95% CI 4.8-43.0), thrombocytopenia (p = 0.03; OR 7.0, 95% CI 1.2-42.7), hypothyroidism (p = 0.01; OR 2.8, 95% CI 1.2-6.7), Anti-Ro antibody seropositivity (p = 0.003; OR 3.9, 95% CI 1.6-9.8), and ARA (p = 0.02; OR 4.1, 95% CI 1.2-13.8). Three or more of these risk factors present at SSc diagnosis was sensitive (77%) and highly specific (97%) for future SRC. No SSc without SRC disease controls had ≥ 4 risk factors. CONCLUSION: In this SSc cohort, we present a panel of risk factors for future SRC. These patients may benefit from close observation of blood pressure, proteinuria, and estimated glomerular filtration rate, for earlier SRC identification and intervention. Future prospective therapeutic studies could focus specifically on this high-risk population.

Measuring the integration of primary care and behavioral health services.

OBJECTIVE: To perform a factor analysis of the Practice Integration Profile (PIP), a 30-item practice-level measure of primary care and behavioral health integration derived from the Agency for Healthcare Research and Quality's Lexicon for Behavioral Health and Primary Care Integration. DATA SOURCES: The PIP was completed by 735 individuals, representing 357 practices across the United States. STUDY DESIGN: The study design was a cross-sectional survey. An exploratory factor analysis and assessment of internal consistency reliability via Cronbach's alpha were performed. DATA COLLECTION METHODS: Participant responses were collected using REDCap, a secure, web-based data capture tool. PRINCIPAL FINDINGS: Five of the PIP's six domains had factor loadings for most items related to each factor representing the PIP of 0.50 or greater. However, one factor had items from two PIP domains that had loadings >0.50. A five-factor model with redistributed items resulted in improved factor loadings for all domains along with greater internal consistency reliability (>0.80). CONCLUSIONS: Five of the PIP's six domains demonstrated excellent internal consistency for measures of health care resources. Although minor improvements to strengthen the PIP are possible, it is a valid and reliable measure of the integration of primary care and behavioral health.

Autoantibodies are present before the clinical diagnosis of systemic sclerosis.

Systemic sclerosis (SSc) is a heterogeneous autoimmune disorder associated with vascular dysfunction and fibrotic changes in the skin, vasculature and internal organs. Although serologic abnormalities are an important diagnostic tool for SSc, little is known about whether autoantibodies precede clinical diagnosis. Here we investigated the presence of autoantibodies before SSc diagnosis and assessed whether certain autoantibodies might associate with the future onset of scleroderma renal crisis (SRC), a potentially fatal complication of the disease. Using the Department of Defense Serum Repository, autoantibodies were analyzed from archived, prospectively collected, longitudinal serum samples from sixteen individuals with SRC (SSc/SRC) and thirty cases of SSc without SRC (SSc/no SRC), matched for age, sex, and race. Seventy five percent (12/16) of the SSc/SRC and 40% (12/30) of the SSc/no SRC were seropositive for at least one autoantibody prior to clinical diagnosis (up to 27.1 years earlier, mean = -7.4 years). Although both disease groups demonstrated a heterogeneous immunoreactivity profile against the autoantigen panel, the SSc/SRC subjects showed two enriched clusters with one featuring elevated levels of autoantibodies against Ro52 and/or Ro60 and another with high levels of immunoreactivity against the RNA polymerase complex. Consistent with larger spectrum of immunoreactivity and the elevated levels of autoantibodies in SSc/SRC, the total response against the autoantigen panel from the last time point of the seropositive subjects revealed that the SSc/SRC cohort harbored higher antibody levels (p = 0.02) compared to SSc/no SRC. Overall, our findings demonstrate that relevant seropositive autoantibodies often precede the clinical diagnosis of SSc/no SRC and SSc/SRC.

Microscopical lesions and antigen distribution in bovine fetal tissues and placentae following experimental infection with bovine herpesvirus-1 during pregnancy.

As part of a larger investigation, gross and histopathological examinations were carried out on six aborted and one non-viable calf born to heifers inoculated with bovine herpesvirus-1 (BHV-1) early in the third trimester of pregnancy. Antibody titres in sera collected from the dams confirmed seroconversion following inoculation. Samples of liver, lung, kidney, brain, heart, spleen, hepatic lymph node and placenta were subjected to histopathological examination. Immunohistochemistry for the detection of BHV-1 antigen was performed on liver and placenta from each calf, and on the full range of tissue from three of the six calves. Six dams aborted between 15 and 50 days post-inoculation (dpi) whilst one produced a live but non-viable calf at 51dpi. Consistent microscopical findings in tissues from the six aborted calves were multifocal coagulative necrosis in the liver and necrotic placentitis. The latter was characterized by villous necrosis, necrosis of vascular endothelium and infiltration of necrotic villi by mixed inflammatory cells. Other findings included multifocal necrosis in kidney, spleen and hepatic lymph node as well as haemorrhage in the lung and kidney. Immunohistochemistry confirmed the presence of BHV-1 antigen in association with these lesions and also revealed focal labelling of the endothelium of small blood vessels and surrounding glial processes in the brains of three calves. Virus isolation confirmed the presence of BHV-1 in the placentae from the six aborted calves and in pooled tissues of three of the fetuses. It is concluded that the pathogenesis of BHV-1 abortion involves infection of vascular endothelial cells in multiple tissues including placenta and brain. Furthermore, histopathological examination in suspected cases of BHV-1 abortion should include placenta as well as fetal viscera, and immunohistochemistry is a valuable tool for confirming a diagnosis of infection with the virus.

Ovine toxoplasmosis: transmission, clinical outcome and control.

Toxoplasma gondii is a significant cause of abortion in sheep. Infection is picked up from the environment and if initiated during pregnancy may cause fetal mortality. Infected sheep remain persistently infected with tissue cysts in brain and muscle (meat), and are also immune and would not be expected to abort again. The live tachyzoite vaccine (Toxovax) protects against abortion and this allows the suggestion that it may also reduce or prevent tissue cyst development in muscle. If this were so it raises the question of whether the vaccine could be used to make meat safer for human consumption.

Development and use of a clinical decision support tool for behavioral health screening in primary care clinics.

OBJECTIVE: Screening, brief intervention, and referral for treatment (SBIRT) for behavioral health (BH) is a key clinical process. SBIRT tools in electronic health records (EHR) are infrequent and rarely studied. Our goals were 1) to design and implement SBIRT using clinical decision support (CDS) in a commercial EHR; and 2) to conduct a pragmatic evaluation of the impact of the tools on clinical outcomes. METHODS: A multidisciplinary team designed SBIRT workflows and CDS tools. We analyzed the outcomes using a retrospective descriptive convenience cohort with age-matched comparison group. Data extracted from the EHR were evaluated using descriptive statistics. RESULTS: There were 2 outcomes studied: 1) development and use of new BH screening tools and workflows; and 2) the results of use of those tools by a convenience sample of 866 encounters. The EHR tools developed included a flowsheet for documenting screens for 3 domains (depression, alcohol use, and prescription misuse); and 5 alerts with clinical recommendations based on screening; and reminders for annual screening. Positive screen rate was 21% (≥1 domain) with 60% of those positive for depression. Screening was rarely positive in 2 domains (11%), and never positive in 3 domains. Positive and negative screens led to higher rates of documentation of brief intervention (BI) compared with a matched sample who did not receive screening, including changes in psychotropic medications, updated BH terms on the problem list, or referral for BH intervention. Clinical process outcomes changed even when screening was negative. CONCLUSIONS: Modified workflows for BH screening and CDS tools with clinical recommendations can be deployed in the EHR. Using SBIRT tools changed clinical process metrics even when screening was negative, perhaps due to conversations about BH not captured in the screening flowsheet. Although there are limitations to the study, results support ongoing investigation.

Role of endogenous transplacental transmission in toxoplasmosis in sheep.

To investigate the potential role of endogenous transplacental transmission of Toxoplasma gondii, 31 seropositive ewes presumed to be persistently infected with the parasite and 15 seronegative ewes were mated and monitored throughout pregnancy and lambing. Antibody titres were determined in precolostral sera from the liveborn lambs and in thoracic fluid from the dead lambs. A PCR for the B1 gene of T gondii was applied to the placentas from all the ewes and to the brains of the stillborn lambs. Samples of brain, lung, liver, spleen and heart from the dead lambs were examined by histopathology. No evidence of toxoplasmosis was detected by histopathology or PCR in any of the samples, but low titres of antibody to T gondii were detected in two liveborn, healthy offspring of a seropositive ewe by the immunofluorescent antibody test (3.2 per cent of pregnancies and 4.1 per cent of lambs in the seropositive group). Antibody to specific antigens of T gondii was demonstrated in sera from these two lambs by Western blotting.

Development and validation of a measure of primary care behavioral health integration.

INTRODUCTION: We developed the Practice Integration Profile (PIP) to measure the degree of behavioral health integration in clinical practices with a focus on primary care (PC). Its 30 items, completed by providers, managers, and staff, provide an overall score and 6 domain scores derived from the Lexicon of Collaborative Care. We describe its history and psychometric properties. METHOD: The PIP was tested in a convenience sample of practices. Linear regression compared scores across integration exemplars, PC with behavioral services, PC without behavioral services, and community mental health centers without PC. An additional sample rated 4 scenarios describing practices with varying degrees of integration. RESULTS: One hundred sixty-nine surveys were returned. Mean domain scores ran from 49 to 65. The mean total score was 55 (median 58; range 0-100) with high internal consistency (Cronbach's alpha = .95). The lowest total scores were for PC without behavioral health (27), followed by community mental health centers (44), PC with behavioral health (60), and the exemplars (86; p < .001). Eleven respondents rerated their practices 37 to 194 days later. The mean change was + 1.5 (standard deviation = 11.1). Scenario scores were highly correlated with the degree of integration each scenario was designed to represent (Spearman's ρ = -0.71; P = 0.0005). DISCUSSION: These data suggest that the PIP is useful, has face, content, and internal validity, and distinguishes among types of practices with known variations in integration. We discuss how the PIP may support practices and policymakers in their integration efforts and researchers assessing the degree to which integration affects patient health outcomes. (PsycINFO Database Record