Patient Surgical Outcomes When Surgery Residents Are the Primary Surgeon by Intensity of Surgical Attending Supervision in Veterans Affairs Medical Centers.

Objective: Using health records from the Department of Veterans Affairs (VA), the largest healthcare training platform in the United States, we estimated independent associations between the intensity of attending supervision of surgical residents and 30-day postoperation patient outcomes. Background: Academic leaders do not agree on the level of autonomy from supervision to grant surgery residents to best prepare them to enter independent practice without risking patient outcomes. Methods: Secondary data came from a national, systematic 1:8 sample of n = 862,425 teaching encounters where residents were listed as primary surgeon at 122 VA medical centers from July 1, 2004, through September 30, 2019. Independent associations between whether attendings had scrubbed or not scrubbed on patient 30-day all-cause mortality, complications, and 30-day readmission were estimated using generalized linear-mixed models. Estimates were tested for any residual confounding biases, robustness to different regression models, stability over time, and validated using moderator and secondary factors analyses. Results: After accounting for potential confounding factors, residents supervised by scrubbed attendings in 733,997 nonemergency surgery encounters had fewer deaths within 30 days of the operation by 14.2% [0.3%, 29.9%], fewer case complications by 7.9% [2.0%, 14.0%], and fewer readmissions by 17.5% [11.2%, 24.2%] than had attendings not scrubbed. Over the 15 study years, scrubbed surgery attendings may have averted an estimated 13,700 deaths, 43,600 cases with complications, and 73,800 readmissions. Conclusions: VA policies on attending surgeon supervision have protected patient safety while allowing residents in selected teaching encounters to have limited autonomy from supervision.

Assessing Physician Resident Contributions to Outpatient Clinical Workload.

BACKGROUND: Graduate medical education is centered in hospitals despite a care system where patients mostly receive their care in an outpatient setting. Such gaps may exist because of inadequate funding for residency positions in community and hospital-based clinics. OBJECTIVE: Determine if physician residents' contribution to outpatient workload offsets their costs for supervision, salary, and fringe benefits as residents acquire skills to become independent practitioners. RESEARCH DESIGN: VA's electronic patient records from 2005 through 2018 were analyzed using generalized linear mixed models to estimate resident and staff contributions to workload in relative value units. MEASURES: Resident participation rate is resident contributed workload net of supervision as a percent of total clinic workload. Productivity is per diem resident workload as a percent of per diem staff workload. Efficiency is per dollar resident workload as a percent of per dollar staff workload. Progressive independence is annual rate of change in resident productivity. RESULTS: Average participation rates varied by specialty from 6% to 22%, with 11% (primary care) and 13% (psychiatry). Productivity rates ranged from 21% to 94%, with 57% (primary care) and 61% (psychiatry). Efficiency rates varied from 0.63 to 3.81, with 1.69 (primary care), 1.89 (psychiatry). Progressive independence rates varied from 2.7%/year (psychiatry) to 39.7%/year (specialty care). CONCLUSIONS: Although residents rotating through most VA clinics generate revenue to cover their direct costs as they learn, some federal subsidies may be necessary to encourage hospital- and community-based clinics to accept residents from the less profitable primary care and mental health specialties.

Assessing Interpersonal Relationships in Medical Education: the Connection Index.

OBJECTIVE: The relationship between a resident physician and his/her supervising attending is foundational to graduate medical education and may impact the clinical learning environment and resident well-being. This paper focuses on how to measure connection between a resident and their clinical supervisor. Connection includes the subdomains of psychological safety, empathy, educational alliance, and feedback. METHODS: After reviewing the literature, the authors designed the 12-item, 7-point Connection Index (CI12) to quantitatively measure connections between a resident and his/her supervisor during a 6-month period (supervision dyad), and based on educational alliance, empathy, psychological safety, and effective feedback. A 9-criteria evaluation framework was applied to assess its reliability and validity on a sample of psychiatry residents at a residency program, July 2016 through June 2018. RESULTS: Out of a total possible number of 50 residents, 100% participated to rate 41 supervisors over 201 supervision dyads; the CI12 satisfied all eight of the eight testable criteria, including high scalability (H = 0.78), consistency (alpha = 0.98), test-retest validity (ICC = 0.95), and construct validity where CI12 was found to have statistically significant correlations with outcomes measures (greater connection was associated with less negative emotional experiences, less mistreatment or bias, less burnout, and higher attendance to supervision sessions). CONCLUSION: The authors showed the CI12 can be a valid and reliable instrument to quantify whether a resident and his/her supervisor connects during a 6-month supervision with respect to empathy, psychological safety, educational alliance, and feedback. We recommend assessing connections as part of the overall evaluation of a resident's experience with the clinical learning environment.

Calibration Bias and the Interpretation of Clinical Learning Environment Perceptions Surveys.

BACKGROUND: The clinical learning environment (CLE) is frequently assessed using perceptions surveys, such as the AAMC Graduation Questionnaire and ACGME Resident/Fellow Survey. However, these survey responses often capture subjective factors not directly related to the trainee's CLE experiences. OBJECTIVE: The authors aimed to assess these subjective factors as "calibration bias" and show how it varies by health professions education discipline, and co-varies by program, patient-mix, and trainee factors. METHODS: We measured calibration bias using 2011-2017 US Department of Veterans Affairs (VA) Learners' Perceptions Survey data to compare medical students and physician residents and fellows (n = 32 830) with nursing (n = 29 758) and allied and associated health (n = 27 092) trainees. RESULTS: Compared to their physician counterparts, nursing trainees (OR 1.31, 95% CI 1.22-1.40) and allied/associated health trainees (1.18, 1.12-1.24) tended to overrate their CLE experiences. Across disciplines, respondents tended to overrate CLEs when reporting 1 higher level (of 5) of psychological safety (3.62, 3.52-3.73), 1 SD more time in the CLE (1.05, 1.04-1.07), female gender (1.13, 1.10-1.16), 1 of 7 lower academic level (0.95, 1.04-1.07), and having seen the lowest tercile of patients for their respective discipline who lacked social support (1.16, 1.12-1.21) and had low income (1.05, 1.01-1.09), co-occurring addictions (1.06, 1.02-1.10), and mental illness (1.06, 1.02-1.10). CONCLUSIONS: Accounting for calibration bias when using perception survey scores is important to better understand physician trainees and the complex clinical learning environments in which they train.

Impact of clinical training on recruiting graduating health professionals.

OBJECTIVES: Recruiting professional staff is an important business reason for hospitals allowing health trainees to engage in supervised patient care. Whereas prior studies have focused on educational institutions, this study focuses on teaching hospitals and whether trainees' clinical experiences affect their willingness to work (ie, recruitability) for the type of healthcare center where they trained. STUDY DESIGN: A pre-post, observational study based on Learners' Perceptions Survey data in which respondents served as their own controls. METHODS: Convenience sample of 15,207 physician, 11,844 nursing, and 13,012 associated health trainees who rotated through 1 of 169 US Department of Veterans Affairs (VA) medical centers between July 1, 2014, and June 30, 2017. Generalized estimating equations computed how clinical, learning, working, and cultural experiences influenced pre-post differences in willingness to consider VA for future employment. RESULTS: VA recruitability increased dramatically from 55% pretraining to 75% post training (adjusted odds ratio [OR], 2.1; 95% CI, 2.0-2.1; P <.001) in all 3 cohorts: physician (from 39% to 59%; OR, 1.6; 95% CI, 1.5-1.6; P <.001), nursing (from 61% to 84%; OR, 2.5; 95% CI, 2.4-2.6; P <.001), and associated health trainees (from 68% to 87%; OR, 2.7; 95% CI, 2.6-2.9; P <.001). For all trainees, changes in recruitability (P <.001) were associated with how trainees rated their clinical learning environment, personal experiences, and culture of psychological safety. Satisfaction ratings with faculty and preceptors (P <.001) were associated with positive changes in recruitability among nursing and associated health students but not physician residents, whereas nursing students who gave higher ratings for interprofessional team culture became less recruitable. CONCLUSIONS: Academic medical centers can attract their health trainees for future employment if they provide positive clinical, working, learning, and cultural experiences.

Medical Graduates, Truthful and Useful Analytics With Big Data, and the Art of Persuasion.

The authors propose that the provision of state-of-the-art, effective, safe, and affordable health care requires medical school graduates not only to be competent practitioners and scientists but also to be policy makers and professional leaders. To meet this challenge in the era of big data and cloud computing, these graduates must be able to understand and critically interpret analyses of large, observational datasets from electronic health records, third-party claims files, surveys, and epidemiologic health datasets.The authors contend that medical students need to be exposed to three components. First, students should be familiar with outcome metrics that not only are scientifically valid but also are robust, useful for the medical community, understandable to patients and relevant to their preferences and health goals, and persuasive to health administrators and policy decision makers. Next, students must interact with an inclusive set of analysts including biostatisticians, mathematical and computational statisticians, econometrists, psychometricians, epidemiologists, informaticians, and qualitative researchers. Last, students should learn in environments in which data analyses are not static with a "one-size-fits-all" solution but, rather, where mathematical and computer scientists provide new, innovative, and effective ways of solving predictable and commonplace data limitations such as missing data; make causal inferences from nonrandomized studies and/or those with selection biases; and estimate effect size when patient outcomes are heterogeneous and surveys have low response rates.

Has Interprofessional Education Changed Learning Preferences? A National Perspective.

OBJECTIVE: To assess how changes in curriculum, accreditation standards, and certification and licensure competencies impacted how medical students and physician residents value interprofessional team and patient-centered care. PRIMARY DATA SOURCE: The Department of Veterans Affairs Learners' Perceptions Survey (2003-2013). The nationally administered survey asked a representative sample of 56,569 U.S. medical students and physician residents, with a comparison group of 78,038 nonphysician trainees, to rate satisfaction with 28 elements, in two overall domains, describing their clinical learning experiences at VA medical centers. STUDY DESIGN: Value preferences were scored as independent adjusted associations between an element (interprofessional team, patient-centered preceptor) and the respective overall domain (clinical learning environment, faculty, and preceptors) relative to a referent element (quality of clinical care, quality of preceptor). PRINCIPAL FINDINGS: Physician trainees valued interprofessional (14 percent vs. 37 percent, p < .001) and patient-centered learning (21 percent vs. 36 percent, p < .001) less than their nonphysician counterparts. Physician preferences for interprofessional learning showed modest increases over time (2.5 percent/year, p < .001), driven mostly by internal medicine and surgery residents. Preferences did not increase with trainees' academic progress. CONCLUSIONS: Despite changes in medical education, physician trainees continue to lag behind their nonphysician counterparts in valuing experience with interprofessional team and patient-centered care.

Does Psychological Safety Impact the Clinical Learning Environment for Resident Physicians? Results From the VA's Learners' Perceptions Survey.

BACKGROUND: Psychological safety (PS) is the perception that it is safe to take interpersonal risks in the work environment. In teaching hospitals, PS may influence the clinical learning environment for trainees. OBJECTIVE: We assessed whether resident physicians believe they are psychologically safe, and if PS is associated with how they rate satisfaction with their clinical learning experience. METHODS: Data were extracted from the Learners' Perceptions Survey (LPS) of residents who rotated through a Department of Veterans Affairs health care facility for academic years 2011-2014. Predictors of PS and its association with resident satisfaction were adjusted to account for confounding and response rate biases using generalized linear models. RESULTS: The 13 044 respondents who completed the LPS (30% response rate) were comparable to nonpediatric, non-obstetrics-gynecology residents enrolled in US residency programs. Among respondents, 11 599 (89%) agreed that ". . . members of the clinical team of which I was part are able to bring up problems and tough issues." Residents were more likely to report PS if they were male, were in a less complex clinical facility, in an other medicine or psychiatry specialty, or cared for patients who were aged, had multiple illnesses, or had social supports. Nonpsychiatric residents felt safer when treating patients with no concurrent mental health diagnoses. PS was strongly associated with how residents rated their satisfaction across 4 domains of their clinical learning experience (P < .001). CONCLUSIONS: PS appears to be an important factor in resident satisfaction across 4 domains that evaluators of graduate medical education programs should consider when assessing clinical learning experiences.

A systematic approach to subgroup analyses in a smoking cessation trial.

BACKGROUND: Traditional approaches to subgroup analyses that test each moderating factor as a separate hypothesis can lead to erroneous conclusions due to the problems of multiple comparisons, model misspecification, and multicollinearity. OBJECTIVE: To demonstrate a novel, systematic approach to subgroup analyses that avoids these pitfalls. METHODS: A Best Approximating Model (BAM) approach that identifies multiple moderators and estimates their simultaneous impact on treatment effect sizes was applied to a randomized, controlled, 11-week, double-blind efficacy trial on smoking cessation of adult smokers with attention-deficit/hyperactivity disorder (ADHD), randomized to either OROS-methylphenidate (n = 127) or placebo (n = 128), and treated with nicotine patch. Binary outcomes measures were prolonged smoking abstinence and point prevalence smoking abstinence. RESULTS: Although the original clinical trial data analysis showed no treatment effect on smoking cessation, the BAM analysis showed significant subgroup effects for the primary outcome of prolonged smoking abstinence: (1) lifetime history of substance use disorders (adjusted odds ratio [AOR] 0.27; 95% confidence interval [CI] 0.10-0.74), and (2) more severe ADHD symptoms (baseline score >36; AOR 2.64; 95% CI 1.17-5.96). A significant subgroup effect was also shown for the secondary outcome of point prevalence smoking abstinence--age 18 to 29 years (AOR 0.23; 95% CI 0.07-0.76). CONCLUSIONS: The BAM analysis resulted in different conclusions about subgroup effects compared to a hypothesis-driven approach. By examining moderator independence and avoiding multiple testing, BAMs have the potential to better identify and explain how treatment effects vary across subgroups in heterogeneous patient populations, thus providing better guidance to more effectively match individual patients with specific treatments.

Comparing clinical predictors of deep venous thrombosis versus pulmonary embolus after severe injury: a new paradigm for posttraumatic venous thromboembolism?

BACKGROUND: The traditional paradigm is that deep venous thrombosis (DVT) and pulmonary embolus (PE) are different temporal phases of a single disease process, most often labeled as the composite end point venous thromboembolism (VTE). However, we theorize that after severe blunt injury, DVT and PE may represent independent thrombotic entities rather than different stages of a single pathophysiologic process and therefore exhibit different clinical risk factor profiles. METHODS: We examined a large, multicenter prospective cohort of severely injured blunt trauma patients to compare clinical risk factors for DVT and PE, including indicators of injury severity, shock, resuscitation parameters, comorbidities, and VTE prophylaxis. Independent risk factors for each outcome were determined by cross-validated logistic regression modeling using advanced exhaustive model search procedures. RESULTS: The study cohort consisted of 1,822 severely injured blunt trauma patients (median Injury Severity Score [ISS], 33; median base deficit, -9.5). Incidence of DVT and PE were 5.1% and 3.9%, respectively. Only 9 (5.7%) of 73 patients with a PE were also diagnosed with DVT. Independent risk factors associated with DVT include prophylaxis initiation within 48 hours (odds ratio [OR], 0.57; 95% confidence interval [CI], 0.36-0.90) and thoracic Abbreviated Injury Scale (AIS) score of 3 or greater (OR, 1.82; 95% CI, 1.12-2.95), while independent risk factors for PE were serum lactate of greater than 5 (OR, 2.33; 95% CI, 1.43-3.79) and male sex (OR, 2.12; 95% CI, 1.17-3.84). Both DVT and PE exhibited differing risk factor profiles from the classic composite end point of VTE. CONCLUSION: DVT and PE exhibit differing risk factor profiles following severe injury. Clinical risk factors for diagnosis of DVT after severe blunt trauma include the inability to initiate prompt pharmacologic prophylaxis and severe thoracic injury, which may represent overall injury burden. In contrast, risk factors for PE are male sex and physiologic evidence of severe shock. We hypothesize that postinjury DVT and PE may represent a broad spectrum of pathologic thrombotic processes as opposed to the current conventional wisdom of peripheral thrombosis and subsequent embolus.

The learners' perceptions survey-primary care: assessing resident perceptions of internal medicine continuity clinics and patient-centered care.

BACKGROUND: In 2010, the Department of Veterans Affairs (VA) implemented a national patient-centered care initiative that organized primary care into interdisciplinary teams of health care professionals to provide patient-centered, continuous, and coordinated care. OBJECTIVE: We assessed the discriminate validity of the Learners' Perceptions Survey-Primary Care (LPS-PC), a tool designed to measure residents' perceptions about their primary and patient-centered care experiences. METHODS: Between October 2010 and June 2011, the LPS-PC was administered to Loma Linda University Medical Center internal medicine residents assigned to continuity clinics at the VA Loma Linda Healthcare System (VALLHCS), a university setting, or the county hospital. Adjusted differences in satisfaction ratings across settings and over domains (patient- and family-centered care, faculty and preceptors, learning, clinical, work and physical environments, and personal experience) were computed using a generalized linear model. RESULTS: Our response rate was 86% (77 of 90). Residents were more satisfied with patient- and family-centered care at the VALLHCS than at either the university or county (P < .001). However, faculty and preceptors (odds ratio [OR]  =  1.53), physical (OR  =  1.29), and learning (OR  =  1.28) environments had more impact on overall resident satisfaction than patient- and family-centered care (OR  =  1.08). CONCLUSIONS: The LPS-PC demonstrated discriminate validity to assess residents' perceptions of their patient-centered clinical training experience across outpatient primary care settings at an internal medicine residency program. The largest difference in scores was the patient- and family-centered care domain, in which residents rated the VALLHCS much higher than the university or county sites.

Factors associated with the satisfaction of millennial generation dental residents.

Data from the 2010 Learners' Perceptions Survey (LPS) administered through the Office of Academic Affiliations, Department of Veterans Affairs (VA) were analyzed to identify factors associated with dental residents' satisfaction with the VA as a clinical training environment. Satisfaction scores were linked to clinic workloads, dental procedure complexity levels, staffing patterns, and facility infrastructure data to explore conditions that may improve residents' satisfaction. Findings supported the construct validity of the LPS survey data and underscored the importance of maintaining optimal ratios of attending dentists, dental assistants, and administrative staff to residents so that each trainee will have opportunities to perform an adequate level of dental workload. As programs strive to improve the quality of graduate dental education, findings from this study are vital for setting curriculum design guidelines and for providing infrastructure support for dental resident education.

Cognitive impairment and medication adherence in outpatients with heart failure.

OBJECTIVES: The study objectives were (a) to describe the prevalence and severity of cognitive impairment (CI) in an outpatient veteran population with heart failure (HF), (b) to describe the cognitive domains affected in those subjects found to have CI, (c) to examine clinical and demographic variables that may be associated with CI, and (d) to determine the relationship between CI and medication adherence (MA). We hypothesized that CI is a prevalent condition in veterans with HF and is associated with poorer MA. Adherence to therapy is essential for successful outcomes. CI may affect adherence; little is known about CI in veterans with HF or the effect of CI on MA. METHODS: We enrolled 251 veteran outpatients with HF. Subjects were screened for CI; adherence was determined by pill counts. Subjects with CI underwent further neuropsychologic testing. RESULTS: Unrecognized CI was found in 58% of subjects. Verbal learning, immediate memory, and delayed verbal memory were most impaired. CI was significantly associated with poorer MA. Variables associated with CI included age, African-American race, depression, use of alcohol, and nonparticipation in pill count. CONCLUSION: Unrecognized CI was prevalent and associated with poorer MA. We propose routine screening for CI in patients with HF.

A randomized controlled trial of supported employment among veterans with posttraumatic stress disorder.

OBJECTIVE: Posttraumatic stress disorder (PTSD) is a potentially disabling mental illness that can cause occupational dysfunction. Although vocational rehabilitation is often prescribed for patients with PTSD, standard vocational services are far from adequate in helping them obtain and maintain competitive employment. This study is the first to examine the outcome of evidence-based supported employment for veterans with PTSD. METHODS: Unemployed veterans with PTSD were randomly assigned to either individual placement and support (IPS) supported employment (N = 42) or a Veterans Health Administration Vocational Rehabilitation Program (VRP) treatment as usual (N = 43). Employment rates and occupational outcomes were followed for 12 months. RESULTS: During the 12-month study, 76% of the IPS participants gained competitive employment, compared with 28% of the VRP participants (number needed to treat = 2.07; χ(2) = 19.84, df = 1, p<.001). Veterans assigned to IPS also worked substantially more weeks than those assigned to VRP (42% versus 16% of the eligible weeks, respectively; Mann-Whitney z test p<.001) and earned higher 12-month income (mean ± SD income of $9,264 ± $13,294 for IPS versus $2,601 ± $6,009 for VRP; Mann-Whitney z test p<.001) during the 12-month period. CONCLUSIONS: Veterans with PTSD who received IPS were 2.7 times more likely to gain competitive employment than those who received VRP. Because work is central to recovery, these results should assist stakeholders in planning improved services for veterans with PTSD.

Quality and safety training in primary care: making an impact.

PURPOSE: Preparing residents for future practice, knowledge, and skills in quality improvement and safety (QI/S) is a requisite element of graduate medical education. Despite many challenges, residency programs must consider new curricular innovations to meet the requirements. We report the effectiveness of a primary care QI/S curriculum and the role of the chief resident in quality and patient safety in facilitating it. METHOD: Through the Veterans Administration Graduate Medical Education Enhancement Program, we added a position for a chief resident in quality and patient safety, and 4 full-time equivalent internal medicine residents, to develop the Primary Care Interprofessional Patient-Centered Quality Care Training Curriculum. The curriculum includes a first-or second-year, 1-month block rotation that serves as a foundational experience in QI/S and interprofessional care. The responsibilities of the chief resident in quality and patient safety included organizing and teaching the QI/S curriculum and mentoring resident projects. Evaluation included prerotation and postrotation surveys of self-assessed QI/S knowledge, abilities, skills, beliefs, and commitment (KASBC); an end-of-the-year KASBC; prerotation and postrotation knowledge test; and postrotation and faculty surveys. RESULTS: Comparisons of prerotation and postrotation KASBC indicated significant self-assessed improvements in 4 of 5 KASBC domains: knowledge (P < .001), ability (P < .001), skills (P < .001), and belief (P < .03), which were sustained on the end-of-the-year survey. The knowledge test demonstrated increased QI/S knowledge (P  =  .002). Results of the postrotation survey indicate strong satisfaction with the curriculum, with 76% (25 of 33) and 70% (23 of 33) of the residents rating the quality and safety curricula as always or usually educational. Most faculty members acknowledged that the chief resident in quality and patient safety enhanced both faculty and resident QI/S interest and participation in projects. CONCLUSIONS: Our primary care QI/S curriculum was associated with improved and persistent resident self-perceived knowledge, abilities, and skills and increased knowledge-based scores of QI/S. The chief resident in quality and patient safety played an important role in overseeing the curriculum, teaching, and providing leadership.

Early blood product and crystalloid volume resuscitation: risk association with multiple organ dysfunction after severe blunt traumatic injury.

BACKGROUND: Elements of volume resuscitation from hemorrhagic shock, such as amount of blood product and crystalloid administration, have been shown to be associated with multiple organ dysfunction (MOD). However, it is unknown whether these are causative factors or merely markers of an underlying requirement for large-volume resuscitation. We sought to further delineate the relevance of the major individual components of early volume resuscitation to onset of MOD after severe blunt traumatic injury. METHODS: We performed a secondary analysis of a large, multicenter prospective observational cohort of severely injured blunt trauma patients, the NIGMS Trauma Glue Grant, to assess the relevance of individual components of resuscitation administered in the first 12 hours of resuscitation including packed red blood cells (PRBC), fresh frozen plasma (FFP), and isotonic crystalloid, to the onset of MOD within the first 28 days after injury. Deaths within 48 hours of injury were excluded. We used a two tiered, exhaustive logistic regression model search technique to adjust for potential confounders from clinically relevant MOD covariates, including indicators of shock severity, injury severity, comorbidities, age, and gender. RESULTS: The study cohort consisted of 1,366 severely injured blunt trauma patients (median new Injury Severity Score = 34). Incidence of 28-day Marshall MOD was 19.6%. Transfusion of ≥10 Units of PRBC in the first 12 hours (odds ratio, 2.06; 95% confidence interval 1.44-2.94), but not FFP (≥8 U) or large volume crystalloid administration (≥12 L), was independently associated with onset of 28-day Marshall MOD. PRBC:FFP ratio in the first 12 hours was not significantly associated with MOD. CONCLUSIONS: When controlling for all major components of acute volume resuscitation, massive-transfusion volumes of PRBC's within the first 12 hours of resuscitation are modestly associated with MOD, whereas FFP and large volume crystalloid administration are not independently associated with MOD. Previous reported associations of blood products and large-volume crystalloid with MOD may be reflecting overall resuscitation requirements and burden of injury rather than independent causation.