Researching the Appropriateness of Care in the Complementary and Integrative Health Professions Part 5: Using Patient Records: Selection, Protection, and Abstraction.

OBJECTIVES: The purpose of this paper is to describe the 4-step process (consent, selection, protection, and abstraction) of acquiring a large sample of chiropractic patient records from multiple practices and subsequent data abstraction. METHODS: From April 2017 to December 2017, RAND acquired patient records from 99 chiropractic practices across the United States. The records included patients enrolled in a survey e-study (prospective sample) and a random sample of all clinic patients (retrospective sample) with chronic back or neck pain. Clinic staff were trained to collect the sample, scan, and transfer the records. We designed an online data collection tool for abstraction. Protocols were instituted to protect patient confidentiality. Doctors of chiropractic were selected and trained as abstractors, and a system was established to monitor data collection. RESULTS: In compliance with data protection protocols, 3603 patient records were scanned, including 1475 in the prospective sample and 2128 in the random sample. A total of 1716 patients (prospective sample) consented to having their records scanned, but only 1475 could be retrieved. Of records scanned, 19% were unusable owing to illegibility, no care during the period of interest, or poor scanning. The abstractor interrater reliability for appropriateness of care decisions was fair to moderate (κ .38-.48). CONCLUSION: The acquisition, handling, and abstraction of a large sample of chiropractic records was a complex task with challenges that necessitated adapting planned approaches. Of the records abstracted, many revealed incomplete provider documentation regarding the details of and rationale for care. Better documentation and more standardized record keeping would facilitate future research using patient records.

Quality of care and patient-reported outcomes in carpal tunnel syndrome: A prospective observational study.

INTRODUCTION: Higher quality care for carpal tunnel syndrome (CTS) may be associated with better outcomes. METHODS: This prospective observational study recruited adults diagnosed with CTS from 30 occupational health centers, evaluated physicians' adherence to recommended care processes, and assessed results of the Boston Carpal Tunnel Questionnaire (BCTQ) and Short Form Health Survey version 2 (SF-12v2) at recruitment and at 18 months. RESULTS: Among 343 individuals, receiving better care (80th vs. 20th percentile for adherence) was associated with greater improvements in BCTQ Symptom Severity scores (-0.18, 95% confidence interval [CI] -0.32 to -0.05), BCTQ Functional Status scores (-0.21, 95% CI -0.34 to -0.08), and SF12-v2 Physical Component scores (1.75, 95% CI 0.33-3.16). Symptoms improved more when physicians assessed and managed activity, patients underwent necessary surgery, and employers adjusted job tasks. DISCUSSION: Efforts should be made to ensure that patients with CTS receive essential care processes including necessary surgery and activity assessment and management. Muscle Nerve 57: 896-904, 2018.

The Quality of Care Provided to Women with Urinary Incontinence in 2 Clinical Settings.

PURPOSE: Our aim was to test the feasibility of a set of quality of care indicators for urinary incontinence and at the same time measure the care provided to women with urinary incontinence in 2 clinical settings. MATERIALS AND METHODS: This was a pilot test of a set of quality of care indicators. A total of 20 quality of care indicators were previously developed using the RAND Appropriateness Method. These quality of care indicators were used to measure care received for 137 women with a urinary incontinence diagnosis in a 120-physician hospital based multispecialty medical group. We also performed an abstraction of 146 patient records from primary care offices in Southern California. These charts were previously used as part of ACOVE (Assessing Care of Vulnerable Elders Project). As a post-hoc secondary analysis, the 2 populations were compared with respect to quality, as measured by compliance with the quality of care indicators. RESULTS: In the ACOVE population, 37.7% of patients with urinary incontinence underwent a pelvic examination vs 97.8% in the multispecialty medical group. Only 15.6% of cases in the multispecialty medical group and 14.2% in ACOVE (p = 0.86) had documentation that pelvic floor exercises were offered. Relatively few women with a body mass index of greater than 25 kg/m(2) were counseled about weight loss in either population (20.9% multispecialty medical group vs 26.1% ACOVE, p = 0.76). For women undergoing sling surgery, documentation of counseling about risks was lacking and only 9.3% of eligible cases (multispecialty medical group only) had documentation of the risks of mesh. CONCLUSIONS: Quality of care indicators are a feasible means to measure the care provided to women with urinary incontinence. Care varied by population studied and yet deficiencies in care were prevalent in both patient populations studied.

Redesign of an electronic clinical reminder to prevent falls in older adults.

BACKGROUND: Falls are the leading cause of unintentional injury among US older adults. Guidelines recommend screening patients for fall risk, and providing exercise for patients with gait and balance problems. We redesigned an electronic clinical reminder to improve identification and management of Veterans at high risk for falls, and piloted the reminder in 3 Veterans Health Administration community-based outpatient clinics. METHODS: This project had 5 key elements: (1) case finding, (2) efficient collection of condition-specific clinical data, (3) clinical reminders to prompt appropriate care, (4) patient and family education materials, and (5) primary care provider (PCP) decision support/PCP and staff education. We reviewed clinical reminder reports, interviewed nurses and PCPs, directly observed clinic operations, and watched nurses and PCPs use the clinical reminder with a dummy patient record to determine areas in need of improvement. RESULTS: Over a 1-year period, 2943 Veterans aged 75 years and older visited the 3 clinics, with 2264 screened for fall risk by the intake nurse, yielding 472 positive screens. PCPs completed gait, balance, and strength evaluations on 231 screen-positive Veterans. Among the 162 Veterans who had a gait, balance, or strength problem on evaluation and were free of advanced dementia or poor prognosis, 39 were offered physical therapy or exercise. PCPs and nurses held divergent opinions about the clinical reminder and the project, with PCPs more negative and nurses more positive. CONCLUSIONS: A fall prevention clinical reminder can be incorporated into routine care, but low referral rates to exercise programs suggest that further quality improvement cycles are needed.

Development of quality indicators for women with urinary incontinence.

AIMS: To develop a means to measure the quality of care provided to women treated for urinary incontinence (UI) through the development of quality-of-care indicators (QIs). METHODS: We performed an extensive literature review to develop a set of potential quality indicators for the management of UI. QIs were modeled after those previously described in the Assessing the Care of Vulnerable Elders (ACOVE) project. Nine experts ranked the indicators on a nine-point scale for both validity and feasibility. We analyzed preliminary rankings of each indicator using the RAND Appropriateness Method. A forum was then held in which each indicator was thoroughly discussed by the panelists as a group, after which the indicators were rated a second time individually using the same nine-point scale. RESULTS: QIs were developed that addressed screening, diagnosis, work-up, and both non-surgical and surgical management. Areas of controversy included whether routine screening for incontinence should be performed, whether urodynamics should be performed before non-surgical management is initiated, and whether cystoscopy should be part of the pre-operative work-up of uncomplicated stress incontinence. Following the expert panel discussion, 27 of 40 potential indicators were determined to be valid for UI with a median score of at least seven on a nine-point scale. CONCLUSIONS: We identified 27 quality indicators for the care of women with UI. Once these QIs are pilot-tested for feasibility, they will be applied on a larger scale to measure the quality of care provided to women with UI in the United States.

Quality-of-care indicators for pelvic organ prolapse: development of an infrastructure for quality assessment.

INTRODUCTION AND HYPOTHESIS: A paucity of data exists addressing the quality of care provided to women with pelvic organ prolapse (POP). We sought to develop a means of measuring this quality through the development of quality-of-care indicators (QIs). METHODS: QIs were modeled after those previously described in the Assessing the Care of Vulnerable Elders (ACOVE) project. The indicators were then presented to a panel of nine experts. Using the RAND Appropriateness Method, we analyzed each indicator's preliminary rankings. A forum was then held in which each indicator was thoroughly discussed by the panelists as a group, after which panelists individually re-rated the indicators. QIs with median scores of at least 7 were considered valid. RESULTS: QIs were developed that addressed screening, diagnosis, work-up, and both nonsurgical and surgical management. Areas of controversy included whether screening should be performed to identify prolapse, whether pessary users should undergo a vaginal examination by a health professional every 6 months versus annually, and whether a colpocleisis should be offered to older women planning to undergo surgery for POP. Fourteen out of 21 potential indicators were rated as valid for pelvic organ prolapse (median score ≥7). CONCLUSION: We developed and rated 14 potential quality indicators for the care of women with POP. Once these QIs are tested for feasibility they can be used on a larger scale to measure and compare the care provided to women with prolapse in different clinical settings.

Improving Pain Care for Service Members: Administrator, Provider, and Patient Perspectives on Treatment, Policies, and Opportunities for Change.

Acute and chronic pain are common among service members, with musculoskeletal pain and injuries being the leading cause of nondeployability among active-duty service members. Given the significant implications for individual health and force readiness, providing high-quality pain care to service members is a priority of the Military Health System (MHS). Prior RAND research used administrative data to assess the quality and safety of pain care and opioid prescribing in the MHS, generated a set of quality measures that the MHS could adopt going forward, and identified strengths and opportunities for improvement in care provided to service members with pain conditions. In this study, authors document findings from interviews with MHS administrators, providers, and patients, providing valuable detail and context for those findings, along with on-the-ground perspectives on MHS pain care policies and guidance in practice. Staff and patients recommended prioritizing increases in treatment access and availability to improve pain care, and patients emphasized effective treatment and patient-centered care as the most important facilitators of high-quality pain care.

Virtual Behavioral Health for Army Soldiers: Soldier Perspectives and Patterns of Treatment.

Delivery of high-quality behavioral health (BH) care is essential to supporting the readiness of the U.S. armed forces and their families. The coronavirus disease 2019 (COVID-19) pandemic led to a dramatic expansion of virtual behavioral health (VBH) care: remote patient access to BH care using technology such as a computer or cellular phone. The U.S. Army asked RAND Arroyo Center to examine the use of VBH to inform recommendations on the role of VBH care in the future of BH care in the Military Health System. The authors analyzed administrative data on VBH and in-person BH care from prior to the pandemic through March 2022 and surveyed soldiers who received BH care to assess their perceptions of VBH care. Administrative data analyses showed that direct care providers were less likely to deliver VBH care than private-sector providers and relied heavily on audio rather than video VBH. In addition, soldiers who received VBH care typically received a mix of VBH and in-person visits. Survey respondents who used VBH care had similar perceptions of the quality of their care and more-positive views of VBH than respondents who did not use VBH care. Few respondents had declined VBH care in favor of in-person care. Using these findings, the authors make recommendations on the role of VBH care in overall BH delivered by the military.

The quality of supportive care among inpatients dying with advanced cancer.

PURPOSE: Managing symptoms and communicating effectively are essential aspects of providing high-quality cancer care, especially among patients with advanced cancer. The purpose of this study is to apply novel quality indicators to measure the quality of supportive care provided to patients with advanced cancer who died in a large university medical center. METHODS: Cancer quality ASSIST is a comprehensive quality indicator (QI) set that includes 92 symptom and care planning indicators, of which we piloted 15 applicable to persons with advanced cancer who died in the hospital setting. We evaluated medical records of all adult terminal hospitalizations with lengths of stay ≥3 days at one university medical center between April 2005 and April 2006. RESULTS: Of 496 decedents, 118 had advanced cancer (mean age 60, 54% male). Forty-five percent received chemotherapy or radiation in the month prior to or during admission. During the hospitalization, 56% of the patients spent time in the ICU (median length of stay 8 days), one in five received first-time hemodialysis, and 23% had a ventilator withdrawn anticipating death. The 118 patients triggered 596 quality indicators of which 476 passed (QI level pass rate 80%, range 50-100%). Pain assessment and management were consistently performed; however, other cancer supportive care needed improvement: 26% of patients not receiving cancer therapy who had nausea and vomiting received inadequate follow-up, more than one quarter of patients with dyspnea had this symptom inadequately addressed, and 29% of patients taking long-acting opioids were not prescribed a bowel regimen. Timely discussion of patient preferences upon admission to the ICU or initiation of mechanical ventilation occurred in 64 and 69% of cases, respectively. CONCLUSIONS: This set of quality indicators can evaluate the quality of supportive and end-of-life care provided to inpatients dying with advanced cancer and identify aspects of care that need improvement.

Nurse care manager contribution to quality of care in a dual-eligible special needs plan.

We evaluated the quality of care provided to older patients with complex needs in a dual-eligible, community-based Medicare Special Needs Plan that used a nurse care manager model. Care provided by physicians was substantially supplemented by nurse care managers, as measured by Assessing Care of Vulnerable Elders quality indicators. We describe selected nurse care manager activities for six geriatric conditions (falls, dementia, depression, nutrition, urinary incontinence, and end-of-life care) during provision of patient care coordination and management for patients in the highest decile of clinical complexity. We identify areas of high nurse performance (i.e., falls screening, functional assessment, behavioral interventions for dementia problems, advance care planning) and areas of potential missed opportunities (i.e., follow up for new memory problems, targeted dementia counseling, nutrition, and behavioral approaches to urinary incontinence). Increasing the collaborative interaction between nurses providing care in this model and physicians has the potential to enhance nurses' contributions to primary care for vulnerable older adults.

Readiness of Soldiers and Adult Family Members Who Receive Behavioral Health Care: Identifying Promising Outcome Metrics.

Behavioral health (BH) conditions-such as posttraumatic stress disorder, depression, and anxiety-are the second most common medical reasons for nondeployability in the U.S. Army. The authors of this report aimed to identify promising metrics to assess readiness among soldiers and adult family members who receive BH care. These metrics would expand the Army's outcome monitoring, which currently includes symptom improvement metrics, for patients who received BH care. The authors developed rigorous criteria to evaluate candidate readiness metrics, conducted interviews with stakeholders (Army subject-matter experts and BH providers), reviewed existing sources of data that could support the development of a readiness metric, and conducted a literature review to identify instruments that have been used to measure readiness-related domains in both military and civilian populations. The authors found that no existing data source or patient self-report instrument met criteria for implementation of a readiness metric for soldiers, but one instrument, the Walter Reed Functional Impairment Scale (WRFIS), is promising. No existing data source or patient self-report instrument met criteria for Army-wide implementation of a readiness metric for adult family members. Stakeholders reported that psychiatric symptoms, diagnosis, treatment, and impaired functioning are important indicators of lack of readiness among soldiers and adult family members. BH providers reported variability in assessing readiness and applying profiles, but behavioral experts provided suggestions for improving readiness assessment. The authors recommend that the Army conduct a pilot evaluation of a soldier readiness metric based on the WRFIS and increase standardization in applying profiles by continuing provider training.

Assessing the Quality of Outpatient Pain Care and Opioid Prescribing in the Military Health System.

Pain conditions are the leading cause of disability among active-duty service members. Given the significant implications for force readiness and service member well-being, the Military Health System (MHS) has made it a strategic priority to provide service members with the highest-quality treatment for pain conditions. RAND researchers assessed MHS outpatient care for acute and chronic pain, including opioid prescribing. The assessment involved developing a set of 14 quality measures designed to assess aspects of outpatient care for pain, including care associated with dental and ambulatory procedures, acute low back pain, chronic pain, opioid prescribing, and medication treatment for opioid use disorder. This research offers the most comprehensive examination to date of the quality and safety of pain care in the MHS and its alignment with evidence-based clinical practice guidelines. It identifies several areas of strength in pain care delivery, along with some areas for improvement, and provides recommendations to support the MHS in continuing to improve pain care for service members.

Is patient-perceived severity of a geriatric condition related to better quality of care?

BACKGROUND: Care for falls and urinary incontinence (UI) among older patients is inadequate. One possible explanation is that physicians provide less recommended care to patients who are not as concerned about their falls and UI. OBJECTIVE: To test whether patient-reported severity for 2 geriatric conditions, falls, and UI, is associated with quality of care. RESEARCH DESIGN: Prospective cohort study of elders with falls and/or fear of falling (n = 384) and UI (n = 163). SUBJECTS: Participants in the Assessing Care of Vulnerable Elders-2 Study (2002-2003), which evaluated an intervention to improve the care for falls and UI among older (age, ≥ 75) ambulatory care patients with falls/fear of falling or UI. MEASURES: Falls Efficacy Scale (FES) and the Incontinence Quality of Life surveys measured at baseline, quality of care measured by a 13-month medical record abstraction. RESULTS: There was a small difference in falls quality scores across the range of FES, with greater patient-perceived falls severity associated with better odds of passing falls quality indicators (OR: 1.11 [95% CI: 1.02-1.21] per 10-point increment in FES). Greater patient-perceived UI severity (Incontinence Quality of Life score) was not associated with better quality of UI care. CONCLUSIONS: Although older persons with greater patient-perceived falls severity receive modestly better quality of care, those with more distressing incontinence do not. For both conditions, however, even the most symptomatic patients received less than half of recommended care. Low patient-perceived severity of condition is not the basis of poor care for falls and UI.

Improving Behavioral Health Care for U.S. Army Personnel: Identifying Predictors of Treatment Outcomes.

This article identifies factors associated with changes in outcomes for soldiers who received Army behavioral health (BH) specialty care and provides recommendations to improve BH care and outcomes. RAND researchers identified three samples of soldiers who received Army BH care with diagnoses of posttraumatic stress disorder (PTSD), depression, or anxiety and whose symptoms were assessed during their care. Multivariate analyses included 141 patient and treatment variables to identify factors associated with symptom improvement. Analyses also examined patterns in how the symptoms changed over time. Analyses suggest that the Behavioral Health Data Portal, an online system that allows for collection of multiple patient- and clinician-reported measures, is widely used to track symptoms of PTSD, depression, and anxiety, but there are opportunities to expand symptom tracking. Two treatment factors-therapeutic alliance and receipt of benzodiazepines-were associated with treatment outcomes. Specifically, a stronger therapeutic relationship or alliance with providers, as reported by soldiers, was associated with improved PTSD, depression, and anxiety outcomes. Further, receipt of more than a 30-day supply of benzodiazepines was associated with poorer PTSD, depression, and anxiety outcomes. Many soldiers' trajectories of symptom change did not demonstrate improvement. Recommendations include providing feedback and guidance to providers on how to strengthen alliance with their patients, expanding tracking and feedback on benzodiazepine prescribing, and increasing provider use of measurement-based BH care.

Continuity of Information Between Mental Health and Primary Care Providers After a Mental Health Consultation.

OBJECTIVE: Information sharing between mental health providers (MHPs) and primary care providers (PCPs) is important for persons with mental illnesses. The authors determined the level of information continuity between MHPs who saw a patient for a new consult and PCPs and whether continuity varied between providers with and without access to a shared electronic health record (EHR). METHODS: Data were analyzed for 141 randomly selected enrollees in six Medicare Advantage plans receiving a new outpatient mental health consultation in 2012. Medical records of MHPs and PCPs were abstracted to evaluate whether PCP records recognized the consultation, documented mental health hospitalizations and emergency department visits, and acknowledged psychotropic medications. Measures were compared between patients whose providers used and did not use mutual-access EHRs. RESULTS: For 21% of patients, the PCP record documented communication from the MHP within three months of the consultation. The PCP record showed evidence of timely communication (within seven days) for 42% of mental health hospitalizations and emergency department visits. Of 152 medications recorded by MHPs, 103 (68%) were acknowledged in the PCP record by the next visit. For patients with mutual-access EHRs, provider communication about the consultation was documented for a greater percentage of patients, compared with those without mutual-access EHRs (46% versus 11%, p<.001), as was communication about psychotropic medication (100% versus 57%, p<.001). CONCLUSIONS: This small but detailed study of patients receiving new outpatient mental health consults found poor continuity of information between MHPs and PCPs. A mutual-access EHR facilitated but did not guarantee such information sharing.

Quality of Care for PTSD and Depression in the Military Health System: Final Report.

The U.S. Department of Defense (DoD) strives to maintain a physically and psychologically healthy, mission-ready force, and the care provided by the Military Health System (MHS) is critical to meeting this goal. Attention has been directed to ensuring the quality and availability of programs and services for posttraumatic stress disorder (PTSD) and depression. This study is a comprehensive assessment of the quality of care delivered by the MHS in 2013-2014 for over 38,000 active-component service members with PTSD or depression. The assessment includes performance on 30 quality measures to evaluate the receipt of recommended assessments and treatments. These measures draw on multiple data sources including administrative encounter data, medical record review data, and patient self-reported outcome monitoring data. The assessment identified strengths and areas for improvement for the MHS. In particular, the MHS excels at screening for suicide risk and substance use, but rates of appropriate follow-up for service members with suicide risk are lower. Most service members received at least some psychotherapy, but less than half of psychotherapy delivered was evidence-based. In analyses focused on Army soldiers, outcome monitoring increased notably over time, yet preliminary analyses suggest that more work is needed to ensure that services are effective in reducing symptoms. When comparing performance between 2012-2013 and 2013-2014, most measures demonstrated slight improvement, but targeted efforts will be needed to support further improvements. RAND provides recommendations for strategies to improve the quality of care delivered for these conditions.

Hospital-Based Quality Measures for Pediatric Mental Health Care.

BACKGROUND AND OBJECTIVES: Patients with a primary mental health condition account for nearly 10% of pediatric hospitalizations nationally, but little is known about the quality of care provided for them in hospital settings. Our objective was to develop and test medical record-based measures used to assess quality of pediatric mental health care in the emergency department (ED) and inpatient settings. METHODS: We drafted an evidence-based set of pediatric mental health care quality measures for the ED and inpatient settings. We used the modified Delphi method to prioritize measures; 2 ED and 6 inpatient measures were operationalized and field-tested in 2 community and 3 children's hospitals. Eligible patients were 5 to 19 years old and diagnosed with psychosis, suicidality, or substance use from January 2012 to December 2013. We used bivariate and multivariate models to examine measure performance by patient characteristics and by hospital. RESULTS: Eight hundred and seventeen records were abstracted with primary diagnoses of suicidality (n = 446), psychosis (n = 321), and substance use (n = 50). Performance varied across measures. Among patients with suicidality, male patients (adjusted odds ratio: 0.27, P < .001) and African American patients (adjusted odds ratio: 0.31, P = .02) were less likely to have documentation of caregiver counseling on lethal means restriction. Among admitted suicidal patients, 27% had documentation of communication with an outside provider, with variation across hospitals (0%-38%; P < .001). There was low overall performance on screening for comorbid substance abuse in ED patients with psychosis (mean: 30.3). CONCLUSIONS: These new pediatric mental health care quality measures were used to identify sex and race disparities and substantial hospital variation. These measures may be useful for assessing and improving hospital-based pediatric mental health care quality.

Introduction to the assessing care of vulnerable elders-3 quality indicator measurement set.

OBJECTIVES: To update and increase the comprehensiveness of the Assessing Care of Vulnerable Elders (ACOVE) set of process-of-care quality indicators (QIs) for the medical care provided to vulnerable elders and to keep up with the constantly changing medical literature, the QIs were revised and expanded. DESIGN: The ACOVE Clinical Committee expanded the number of measured conditions to 26 in the revised (ACOVE-3) set. For each condition, a content expert created potential QIs and, based on systematic reviews, developed a peer-reviewed monograph detailing each QI and its supporting evidence. Using these literature reviews, multidisciplinary panels of clinical experts participated in two rounds of anonymous ratings and a face-to-face group discussion to evaluate whether the QIs were valid measures of quality of care using a process that is an explicit combination of scientific evidence and professional consensus. The Clinical Committee evaluated the coherence of the complete set of QIs that the expert panels rated as valid. RESULTS: ACOVE-3 contains 392 QIs covering 14 different types of care processes (e.g., taking a medical history, performing a physical examination) and all four domains of care: screening and prevention (31% of QIs), diagnosis (20%), treatment (35%), and follow-up and continuity (14%). All QIs also apply to community-dwelling patients aged 75 and older. CONCLUSION: ACOVE-3 contains a set of QIs to comprehensively measure the care provided to vulnerable older persons at the level of the health system, health plan, or medical group. These QIs can be applied to identify areas of care in need of improvement and can form the basis of interventions to improve care.

Patients' global ratings of their health care are not associated with the technical quality of their care.

BACKGROUND: Patient global ratings of care are commonly used to assess health care. However, the extent to which these assessments of care are related to the technical quality of care received is not well understood. OBJECTIVE: To investigate the relationship between patient-reported global ratings of health care and the quality of providers' communication and technical quality of care. DESIGN: Observational cohort study. SETTING: 2 managed care organizations. PATIENTS: Vulnerable older patients identified by brief interviews of a random sample of community-dwelling adults 65 years of age or older who received care in 2 managed care organizations during a 13-month period. MEASUREMENTS: Survey questions from the second stage of the Consumer Assessment of Healthcare Providers and Systems program were used to determine patients' global rating of health care and provider communication. A set of 236 quality indicators, defined by the Assessing Care of Vulnerable Elders project, were used to measure technical quality of care given for 22 clinical conditions; 207 quality indicators were evaluated by using data from chart abstraction or patient interview. RESULTS: Data on the global rating item, communication scale, and technical quality of care score were available for 236 vulnerable older patients. In a multivariate logistic regression model that included patient and clinical factors, better communication was associated with higher global ratings of health care. Technical quality of care was not significantly associated with the global rating of care. LIMITATIONS: Findings were limited to vulnerable elders who were enrolled in managed care organizations and may not be generalizable to other age groups or types of insurance coverage. CONCLUSIONS: Vulnerable elders' global ratings of care should not be used as a marker of technical quality of care. Assessments of quality of care should include both patient evaluations and independent assessments of technical quality.

Development and Testing of the Pediatric Respiratory Illness Measurement System (PRIMES) Quality Indicators.

OBJECTIVES: To develop and test quality indicators for assessing care in pediatric hospital settings for common respiratory illnesses. PATIENTS: A sample of 2796 children discharged from the emergency department or inpatient setting at 1 of the 3 participating hospitals with a primary diagnosis of asthma, bronchiolitis, croup, or community-acquired pneumonia (CAP) between January 1, 2010, and December 31, 2011. SETTING: Three tertiary care children's hospitals in the United States. METHODS: We developed evidence-based quality indicators for asthma, bronchiolitis, croup, and CAP. Expert panel-endorsed indicators were included in the Pediatric Respiratory Illness Measurement System (PRIMES). This new set of pediatric quality measures was tested to assess feasibility of implementation and sensitivity to variations in care. Medical records data were extracted by trained abstractors. Quality measure scores (0-100 scale) were calculated by dividing the number of times indicated care was received by the number of eligible cases. Score differences within and between hospitals were determined by using the Student's t-test or analysis of variance. RESULTS: CAP and croup condition-level PRIMES scores demonstrated significant between-hospital variations (P < .001). Asthma and bronchiolitis condition-level PRIMES scores demonstrated significant within-hospital variation with emergency department scores (means [SD] 82.2(6.1)-100.0 (14.4)] exceeding inpatient scores (means [SD] 71.1 (2.0)-90.8 (1.3); P < .001). CONCLUSIONS: PRIMES is a new set of measures available for assessing the quality of hospital-based care for common pediatric respiratory illnesses.