Multicenter Validation of a Customizable Scoring Tool for Selection of Trainees for a Residency or Fellowship Program. The EAST-IST Study.

RATIONALE: Few data have been published regarding scoring tools for selection of postgraduate medical trainee candidates that have wide applicability. OBJECTIVES: The authors present a novel scoring tool developed to assist postgraduate programs in generating an institution-specific rank list derived from selected elements of the U.S. Electronic Residency Application System (ERAS) application. METHODS: The authors developed and validated an ERAS and interview day scoring tool at five pulmonary and critical care fellowship programs: the ERAS Application Scoring Tool-Interview Scoring Tool. This scoring tool was then tested for intrarater correlation versus subjective rankings of ERAS applications. The process for development of the tool was performed at four other institutions, and it was performed alongside and compared with the "traditional" ranking methods at the five programs and compared with the submitted National Residency Match Program rank list. RESULTS: The ERAS Application Scoring Tool correlated highly with subjective faculty rankings at the primary institution (average Spearman's r = 0.77). The ERAS Application Scoring Tool-Interview Scoring Tool method correlated well with traditional ranking methodology at all five institutions (Spearman's r = 0.54, 0.65, 0.72, 0.77, and 0.84). CONCLUSIONS: This study validates a process for selecting and weighting components of the ERAS application and interview day to create a customizable, institution-specific tool for ranking candidates to postgraduate medical education programs. This scoring system can be used in future studies to compare the outcomes of fellowship training.

Adult Bronchoscopy Training: Current State and Suggestions for the Future: CHEST Expert Panel Report.

BACKGROUND: The determination of competency of trainees in programs performing bronchoscopy is quite variable. Some programs provide didactic lectures with hands-on supervision, other programs incorporate advanced simulation centers, whereas others have a checklist approach. Although no single method has been proven best, the variability alone suggests that outcomes are variable. Program directors and certifying bodies need guidance to create standards for training programs. Little well-developed literature on the topic exists. METHODS: To provide credible and trustworthy guidance, rigorous methodology has been applied to create this bronchoscopy consensus training statement. All panelists were vetted and approved by the CHEST Guidelines Oversight Committee. Each topic group drafted questions in a PICO (population, intervention, comparator, outcome) format. MEDLINE data through PubMed and the Cochrane Library were systematically searched. Manual searches also supplemented the searches. All gathered references were screened for consideration based on inclusion criteria, and all statements were designated as an Ungraded Consensus-Based Statement. RESULTS: We suggest that professional societies move from a volume-based certification system to skill acquisition and knowledge-based competency assessment for trainees. Bronchoscopy training programs should incorporate multiple tools, including simulation. We suggest that ongoing quality and process improvement systems be introduced and that certifying agencies move from a volume-based certification system to skill acquisition and knowledge-based competency assessment for trainees. We also suggest that assessment of skill maintenance and improvement in practice be evaluated regularly with ongoing quality and process improvement systems after initial skill acquisition. CONCLUSIONS: The current methods used for bronchoscopy competency in training programs are variable. We suggest that professional societies and certifying agencies move from a volume- based certification system to a standardized skill acquisition and knowledge-based competency assessment for pulmonary and thoracic surgery trainees.

Entrustable professional activities and curricular milestones for fellowship training in pulmonary and critical care medicine: executive summary from the Multi-Society Working Group.

Assessment of graduate medical trainee progress via the accomplishment of competency milestones is an important element of the Next Accreditation System of the Accreditation Council for Graduate Medical Education. This article summarizes the findings of a multisociety working group that was tasked with creating the entrustable professional activities and curricular milestones for fellowship training in pulmonary medicine, critical care medicine, and combined programs. Using the Delphi process, experienced medical educators from the American College of Chest Physicians, American Thoracic Society, Society of Critical Care Medicine, and Association of Pulmonary and Critical Care Medicine Program Directors reached consensus on the detailed curricular content and expected skill set of graduates of these programs. These are now available to trainees and program directors for the purposes of curriculum design, review, and trainee assessment.

Entrustable professional activities and curricular milestones for fellowship training in pulmonary and critical care medicine: report of a multisociety working group.

This article describes the curricular milestones and entrustable professional activities for trainees in pulmonary, critical care, or combined fellowship programs. Under the Next Accreditation System of the Accreditation Council for Graduate Medical Education (ACGME), curricular milestones compose the curriculum or learning objectives for training in these fields. Entrustable professional activities represent the outcomes of training, the activities that society and professional peers can expect fellowship graduates to be able to perform unsupervised. These curricular milestones and entrustable professional activities are the products of a consensus process from a multidisciplinary committee of medical educators representing the American College of Chest Physicians (CHEST), the American Thoracic Society, the Society of Critical Care Medicine, and the Association of Pulmonary and Critical Care Medicine Program Directors. After consensus was achieved using the Delphi process, the document was revised with input from the sponsoring societies and program directors. The resulting lists can serve as a roadmap and destination for trainees, program directors, and educators. Together with the reporting milestones, they will help mark trainees' progress in the mastery of the six ACGME core competencies of graduate medical education.

Role-modeling and medical error disclosure: a national survey of trainees.

PURPOSE: To measure trainees' exposure to negative and positive role-modeling for responding to medical errors and to examine the association between that exposure and trainees' attitudes and behaviors regarding error disclosure. METHOD: Between May 2011 and June 2012, 435 residents at two large academic medical centers and 1,187 medical students from seven U.S. medical schools received anonymous, electronic questionnaires. The questionnaire asked respondents about (1) experiences with errors, (2) training for responding to errors, (3) behaviors related to error disclosure, (4) exposure to role-modeling for responding to errors, and (5) attitudes regarding disclosure. Using multivariate regression, the authors analyzed whether frequency of exposure to negative and positive role-modeling independently predicted two primary outcomes: (1) attitudes regarding disclosure and (2) nontransparent behavior in response to a harmful error. RESULTS: The response rate was 55% (884/1,622). Training on how to respond to errors had the largest independent, positive effect on attitudes (standardized effect estimate, 0.32, P < .001); negative role-modeling had the largest independent, negative effect (standardized effect estimate, -0.26, P < .001). Positive role-modeling had a positive effect on attitudes (standardized effect estimate, 0.26, P < .001). Exposure to negative role-modeling was independently associated with an increased likelihood of trainees' nontransparent behavior in response to an error (OR 1.37, 95% CI 1.15-1.64; P < .001). CONCLUSIONS: Exposure to role-modeling predicts trainees' attitudes and behavior regarding the disclosure of harmful errors. Negative role models may be a significant impediment to disclosure among trainees.

S100 calcium binding protein B as a biomarker of delirium duration in the intensive care unit - an exploratory analysis.

BACKGROUND: Currently, there are no valid and reliable biomarkers to identify delirious patients predisposed to longer delirium duration. We investigated the hypothesis that elevated S100 calcium binding protein B (S100ß) levels will be associated with longer delirium duration in critically ill patients. METHODS: A prospective observational cohort study was performed in the medical, surgical, and progressive intensive care units (ICUs) of a tertiary care, university affiliated, and urban hospital. Sixty-three delirious patients were selected for the analysis, with two samples of S100ß collected on days 1 and 8 of enrollment. The main outcome measure was delirium duration. Using the cutoff of <0.1 ng/mL and ≥0.1 ng/mL as normal and abnormal levels of S100ß, respectively, on day 1 and day 8, four exposure groups were created: Group A, normal S100ß levels on day 1 and day 8; Group B, normal S100ß level on day 1 and abnormal S100ß level on day 8; Group C, abnormal S100ß level on day 1 and normal on day 8; and Group D, abnormal S100ß levels on both day 1 and day 8. RESULTS: Patients with abnormal levels of S100ß showed a trend towards higher delirium duration (P=0.076); Group B (standard deviation) (7.0 [3.2] days), Group C (5.5 [6.3] days), and Group D (5.3 [6.0] days), compared to patients in Group A (3.5 [5.4] days). CONCLUSION: This preliminary investigation identified a potentially novel role for S100ß as a biomarker for delirium duration in critically ill patients. This finding may have important implications for refining future delirium management strategies in ICU patients.

Clinical decision support system and incidence of delirium in cognitively impaired older adults transferred to intensive care.

BACKGROUND: Elderly patients with cognitive impairment are at increased risk of developing delirium, especially in the intensive care unit. OBJECTIVE: To evaluate the efficacy of a computer-based clinical decision support system that recommends consulting a geriatrician and discontinuing use of urinary catheters, physical restraints, and unnecessary anticholinergic drugs in reducing the incidence of delirium. METHODS: Data for a subgroup of patients enrolled in a large clinical trial who were transferred to the intensive care units of a tertiary-care, urban public hospital in Indianapolis were analyzed. Data were collected on frequency of orders for consultation with a geriatrician; discontinuation of urinary catheterization, physical restraints, or anticholinergic drugs; and the incidence of delirium. RESULTS: The sample consisted of 60 adults with cognitive impairment. Mean age was 74.6 years; 45% were African American, and 52% were women. No differences were detected between the intervention and the control groups in orders for consultation with a geriatrician (33% vs 40%; P = .79) or for discontinuation of urinary catheters (72% vs 76%; P = .99), physical restraints (12% vs 0%; P=.47), or anticholinergic drugs (67% vs 36%; P=.37). The 2 groups did not differ in the incidence of delirium (27% vs 29%; P = .85). CONCLUSION: Use of a computer-based clinical decision support system may not be effective in changing prescribing patterns or in decreasing the incidence of delirium.

Delirium in hospitalized patients: implications of current evidence on clinical practice and future avenues for research--a systematic evidence review.

BACKGROUND: Despite the significant burden of delirium among hospitalized adults, critical appraisal of systematic data on delirium diagnosis, pathophysiology, treatment, prevention, and outcomes is lacking. PURPOSE: To provide evidence-based recommendations for delirium care to practitioners, and identify gaps in delirium research. DATA SOURCES: Medline, PubMed, the Cochrane Library, and the Cumulative Index to Nursing and Allied Health Literature (CINAHL) information systems from January 1966 to April 2011. STUDY SELECTION: All published systematic evidence reviews (SERs) on delirium were evaluated. DATA EXTRACTION: Three reviewers independently extracted the data regarding delirium risk factors, diagnosis, prevention, treatment, and outcomes, and critically appraised each SER as good, fair, or poor using the United States Preventive Services Task Force criteria. DATA SYNTHESIS: Twenty-two SERs graded as good or fair provided the data. Age, cognitive impairment, depression, anticholinergic drugs, and lorazepam use were associated with an increased risk for developing delirium. The Confusion Assessment Method (CAM) is reliable for delirium diagnosis outside of the intensive care unit. Multicomponent nonpharmacological interventions are effective in reducing delirium incidence in elderly medical patients. Low-dose haloperidol has similar efficacy as atypical antipsychotics for treating delirium. Delirium is associated with poor outcomes independent of age, severity of illness, or dementia. CONCLUSION: Delirium is an acute, preventable medical condition with short- and long-term negative effects on a patient's cognitive and functional states.

Comparison and agreement between the Richmond Agitation-Sedation Scale and the Riker Sedation-Agitation Scale in evaluating patients' eligibility for delirium assessment in the ICU.

BACKGROUND: Delirium evaluation in patients in the ICU requires the use of an arousal/sedation assessment tool prior to assessing consciousness. The Richmond Agitation-Sedation Scale (RASS) and the Riker Sedation-Agitation Scale (SAS) are well-validated arousal/sedation tools. We sought to assess the concordance of RASS and SAS assessments in determining eligibility of patients in the ICU for delirium screening using the confusion assessment method for the ICU (CAM-ICU). METHODS: We performed a prospective cohort study in the adult medical, surgical, and progressive (step-down) ICUs of a tertiary care, university-affiliated, urban hospital in Indianapolis, Indiana. The cohort included 975 admissions to the ICU between January and October 2009. RESULTS: The outcome measures of interest were the correlation and agreement between RASS and SAS measurements. In 2,469 RASS and SAS paired screens, the rank correlation using the Spearman correlation coefficient was 0.91, and the agreement between the two screening tools for assessing CAM-ICU eligibility as estimated by the κ coefficient was 0.93. Analysis showed that 70.1% of screens were eligible for CAM-ICU assessment using RASS (7.1% sedated [RASS −3 to −1]; 62.6% calm [0]; and 0.4% restless, agitated [+1 to +3]), compared with 72.1% using SAS (5% sedated [SAS 3]; 66.5% calm [4]; and 0.6% anxious, agitated [5, 6]). In the mechanically ventilated subgroup, RASS identified 19.1% CAM-ICU eligible patients compared with 24.6% by SAS. The correlation coefficient in this subgroup was 0.70 and the agreement was 0.81. CONCLUSION: Both SAS and RASS led to similar rates of delirium assessment using the CAM-ICU.

Enhancing care for hospitalized older adults with cognitive impairment: a randomized controlled trial.

BACKGROUND: Approximately 40% of hospitalized older adults have cognitive impairment (CI) and are more prone to hospital-acquired complications. The Institute of Medicine suggests using health information technology to improve the overall safety and quality of the health care system. OBJECTIVE: Evaluate the efficacy of a clinical decision support system (CDSS) to improve the quality of care for hospitalized older adults with CI. DESIGN: A randomized controlled clinical trial. SETTING: A public hospital in Indianapolis. POPULATION: A total of 998 hospitalized older adults were screened for CI, and 424 patients (225 intervention, 199 control) with CI were enrolled in the trial with a mean age of 74.8, 59% African Americans, and 68% female. INTERVENTION: A CDSS alerts the physicians of the presence of CI, recommends early referral into a geriatric consult, and suggests discontinuation of the use of Foley catheterization, physical restraints, and anticholinergic drugs. MEASUREMENTS: Orders of a geriatric consult and discontinuation orders of Foley catheterization, physical restraints, or anticholinergic drugs. RESULTS: Using intent-to-treat analyses, there were no differences between the intervention and the control groups in geriatric consult orders (56% vs 49%, P = 0.21); discontinuation orders for Foley catheterization (61.7% vs 64.6%, P = 0.86); physical restraints (4.8% vs 0%, P = 0.86), or anticholinergic drugs (48.9% vs 31.2%, P = 0.11). CONCLUSION: A simple screening program for CI followed by a CDSS did not change physician prescribing behaviors or improve the process of care for hospitalized older adults with CI.

Time-motion analysis of health care workers' contact with patients and workers' hand hygiene: open vs closed units.

BACKGROUND: The effects of open (care provided by general medicine teams with a pulmonary intensivist consultant) vs closed (care provided by a dedicated critical care team) intensive care units on health care workers' contact with patients and their hand hygiene is uncertain. OBJECTIVE: To determine if closed intensive care units have fewer visits of patients by health care providers and greater hand-washing compliance among providers than do open units. METHODS: Time-motion analysis was used to observe 2 rooms in a medical intensive care unit at a teaching hospital affiliated with Indiana University School of Medicine, Indianapolis, for 96 hours before and after closure of the unit. The main outcome measures were frequency of health care providers' visits and their hand-washing hygiene compliance rates. RESULTS: Mean number of visits per room per hour by physicians (1.53 in the open unit vs 1.27 in the closed unit; P = .93) and nurses (3.98 in open unit vs 4.14 in closed unit; P = .60) did not differ. No differences were observed in gold-standard hand washing among physicians (0.00% in open unit vs 2.63% in closed unit; P = .11) or nurses (2.50% in open unit vs 3.49% in closed unit; P = .51). However, hand washing decreased significantly in nurses in the closed unit (40.94% in open unit vs 29.84% in closed unit; P = .002). CONCLUSION: Closing the intensive care unit did not decrease the number of contacts between health care providers and patients nor did it increase the providers' compliance with hand hygiene.

Linking residency training effectiveness to clinical outcomes: a quality improvement approach.

BACKGROUND: The Accreditation Council for Graduate Medical Education (ACGME)'s Outcome Project requires training programs to use external measures such as quality of care indicators to assess their effectiveness. A practical, quality improvement (QI) process was implemented at Henry Ford Hospital to enhance the training program's educational effectiveness and clinical outcomes. METHODS: A QI process consisting ofa modified Plan-Do-Study-Act (PDSA) cycle was applied to residency and fellowship curricula in a medical intensive care unit (MICU). The PDSA activities focused on improving clinical outcomes but also outlined educational goals for residents and fellows, defined teaching methods, and determined assessment methods for the ACGME curricula. The improvement process linked clinical outcomes to specific competency-based educational objectives. Residents and fellows received instruction on QI and applied the new curricula to their clinical training in the MICU. RESULTS: Two of seven MICU clinical outcomes demonstrated initial performance below national benchmarks: iatrogenic pneumothorax rate and sepsis-specific mortality. During the QI process, clinical outcomes in both areas improved. Training program directors used the MICU clinical outcomes as indicators of their programs' educational effectiveness. They also assessed individual trainee performance in QI initiatives through direct observation and review of their written summaries of these projects. CONCLUSIONS: Training programs can use hospital-tracked clinical outcomes to analyze their educational strengths and weaknesses and accordingly to enhance their educational curricula. Linking competency-based learning objectives for trainees to the clinical outcomes of their patients can improve physician education and patient care.

Elevated 1, 25-dihydroxyvitamin D levels are associated with protracted treatment in sarcoidosis.

BACKGROUND: Active vitamin D metabolite, 1, 25-dihydroxyvitamin D, has pleomorphic effects on both innate and acquired immunity. Sarcoid granuloma derived 1, 25-dihydroxyvitamin D leads to hypercalcemia, but the association of 1, 25-dihydroxyvitamin D with the clinical phenotype of the disease is currently unknown. OBJECTIVE: To determine the relationship between serum 1, 25-dihydroxyvitamin D levels and the degree of sarcoidosis disease chronicity. DESIGN: Serum 1, 25-dihydroxyvitamin D levels were measured and associated with sarcoidosis activity and phenotypes as assessed by Sarcoidosis Severity Score and Sarcoidosis Clinical Activity Classification respectively. RESULTS: Fifty nine patients were recruited with 44% having a sub-acute onset, and the chronic disease phenotype. There was no significant difference in serum 1, 25-dihydroxyvitamin D levels by chest radiograph stage (p = 0.092) nor did the levels correlate with the Sarcoidosis Severity Score (r = -0.16; p = 0.216). Serum 1, 25-dihydroxyvitamin D levels were associated with patients requiring repeated regimens of systemic immunosuppressive therapy or >1 year of therapy (SCAC Class 6). Increasing quartiles of serum 1, 25-dihydroxyvitamin D level was associated increased odds of the chronic phenotype (OR 1.82, 95% CI, 1.11, 2.99, p = 0.019). The majority (71%) of the patients with levels >51 pg/mL required chronic immunosuppressive therapy as defined by SCAC class 6. CONCLUSIONS: In patients with sarcoidosis, elevated 1, 25-dihydroxyvitamin D levels are associated with chronic treatment needs.

Multisociety task force recommendations of competencies in Pulmonary and Critical Care Medicine.

RATIONALE: Numerous accrediting organizations are calling for competency-based medical education that would help define specific specialties and serve as a foundation for ongoing assessment throughout a practitioner's career. Pulmonary Medicine and Critical Care Medicine are two distinct subspecialties, yet many individual physicians have expertise in both because of overlapping content. Establishing specific competencies for these subspecialties identifies educational goals for trainees and guides practitioners through their lifelong learning. OBJECTIVES: To define specific competencies for graduates of fellowships in Pulmonary Medicine and Internal Medicine-based Critical Care. METHODS: A Task Force composed of representatives from key stakeholder societies convened to identify and define specific competencies for both disciplines. Beginning with a detailed list of existing competencies from diverse sources, the Task Force categorized each item into one of six core competency headings. Each individual item was reviewed by committee members individually, in group meetings, and conference calls. Nominal group methods were used for most items to retain the views and opinions of the minority perspective. Controversial items underwent additional whole group discussions with iterative modified-Delphi techniques. Consensus was ultimately determined by a simple majority vote. MEASUREMENTS AND MAIN RESULTS: The Task Force identified and defined 327 specific competencies for Internal Medicine-based Critical Care and 276 for Pulmonary Medicine, each with a designation as either: (1) relevant, but competency is not essential or (2) competency essential to the specialty. CONCLUSIONS: Specific competencies in Pulmonary and Critical Care Medicine can be identified and defined using a multisociety collaborative approach. These recommendations serve as a starting point and set the stage for future modification to facilitate maximum quality of care as the specialties evolve.

Clinical characteristics of patients with acute pulmonary embolism: data from PIOPED II.

BACKGROUND: Selection of patients for diagnostic tests for acute pulmonary embolism requires recognition of the possibility of pulmonary embolism on the basis of the clinical characteristics. Patients in the Prospective Investigation of Pulmonary Embolism Diagnosis II had a broad spectrum of severity, which permits an evaluation of the subtle characteristics of mild pulmonary embolism and the characteristics of severe pulmonary embolism. METHODS: Data are from the national collaborative study, Prospective Investigation of Pulmonary Embolism Diagnosis II. RESULTS: There may be dyspnea only on exertion. The onset of dyspnea is usually, but not always, rapid. Orthopnea may occur. In patients with pulmonary embolism in the main or lobar pulmonary arteries, dyspnea or tachypnea occurred in 92%, but the largest pulmonary embolism was in the segmental pulmonary arteries in only 65%. In general, signs and symptoms were similar in elderly and younger patients, but dyspnea or tachypnea was less frequent in elderly patients with no previous cardiopulmonary disease. Dyspnea may be absent even in patients with circulatory collapse. Patients with a low-probability objective clinical assessment sometimes had pulmonary embolism, even in proximal vessels. CONCLUSION: Symptoms may be mild, and generally recognized symptoms may be absent, particularly in patients with pulmonary embolism only in the segmental pulmonary branches, but they may be absent even with severe pulmonary embolism. A high or intermediate-probability objective clinical assessment suggests the need for diagnostic studies, but a low-probability objective clinical assessment does not exclude the diagnosis. Maintenance of a high level of suspicion is critical.