Building a comprehensive mentoring academy for schools of health.

Formal mentoring programs are increasingly recognized as critical for faculty career development. We describe a mentoring academy (MA) developed for faculty across tracks (i.e., researchers, clinicians, educators) within a "school of health" encompassing schools of medicine and nursing. The program is anchored dually in a clinical and translational science center and a school of health. The structure includes the involvement of departmental and center mentoring directors to achieve widespread uptake and oversight. A fundamental resource provided by the MA includes providing workshops to enhance mentoring skills. Initiatives for junior faculty emphasize establishing and maintaining strong mentoring relationships and implementing individual development plans (IDPs) for career planning. We present self-report data on competency improvement from mentor workshops and data on resources and barriers identified by junior faculty (n = 222) in their IDPs. Mentors reported statistically significantly improved mentoring competency after workshop participation. Junior faculty most frequently identified mentors (61%) and collaborators (23%) as resources for goal attainment. Top barriers included insufficient time and time-management issues (57%), funding limitations (18%), work-life balance issues (18%), including inadequate time for self-care and career development activities. Our MA can serve as a model and roadmap for providing resources to faculty across traditional tracks within medical schools.

Medical School Applicant Characteristics Associated With Performance in Multiple Mini-Interviews Versus Traditional Interviews: A Multi-Institutional Study.

PURPOSE: To examine applicant characteristics associated with multiple mini-interview (MMI) or traditional interview (TI) performance at five California medical schools. METHOD: Of the five California Longitudinal Evaluation of Admission Practices consortium schools, three used TIs and two used MMIs. Schools provided retrospective data on 2011-2013 admissions cycle interviewees: age, gender, race/ethnicity (underrepresented in medicine [UIM] or not), disadvantaged (DA) status, undergraduate GPA, Medical College Admission Test (MCAT) score, and interview score (standardized as z score; mean = 0; SD = 1). Adjusted linear regression analyses, stratified by interview type, examined associations with interview performance. RESULTS: The 4,993 applicants who completed 7,516 interviews included 931 (18.6%) UIM and 962 (19.3%) DA individuals; 3,226 (64.6%) had only 1 interview. Mean age was 24.4 (SD = 2.7); mean GPA and MCAT score were 3.72 (SD = 0.22) and 33.6 (SD = 3.7), respectively. Older age, female gender, and number of prior interviews were associated with better performance on both MMIs and TIs. Higher GPA was associated with lower MMI scores (z score, per unit GPA = -0.26; 95% CI = -0.45, -0.06) but unrelated to TI scores. DA applicants had higher TI scores (z score = 0.17; 95% CI = 0.07, 0.28) but lower MMI scores (z score = -0.18; 95% CI = -0.28, -0.08) than non-DA applicants. Neither UIM status nor MCAT score was associated with interview performance. CONCLUSIONS: These findings have potentially important workforce implications, particularly regarding MMI performance of DA applicants, and illustrate the need for other multi-institutional studies.

Reliability of Multiple Mini-Interviews and traditional interviews within and between institutions: a study of five California medical schools.

BACKGROUND: Many medical schools use admissions Multiple Mini-Interviews (MMIs) rather than traditional interviews (TIs), partly because MMIs are thought to be more reliable. Yet prior studies examined single-school samples of candidates completing either an MMI or TI (not both). Using data from five California public medical schools, the authors examined the within- and between-school reliabilities of TIs and MMIs. METHODS: The analyses included applicants interviewing at ≥1 of the five schools during 2011-2013. Three schools employed TIs (TI1, TI2, TI3) and two employed MMIs (MMI1, MMI2). Mixed linear models accounting for nesting of observations within applicants examined standardized TI and MMI scores (mean = 0, SD = 1), adjusting for applicant socio-demographics, academic metrics, year, number of interviews, and interview date. RESULTS: A total of 4993 individuals (completing 7516 interviews [TI = 4137, MMI = 3379]) interviewed at ≥1 school; 428 (14.5%) interviewed at both MMI schools and 687 (20.2%) at more than one TI school. Within schools, inter-interviewer consistency was generally qualitatively lower for TI1, TI2, and TI3 (Pearson's r 0.07, 0.13, and 0.29, and Cronbach's α, 0.40, 0.44, and 0.61, respectively) than for MMI1 and MMI 2 (Cronbach's α 0.68 and 0.60, respectively). Between schools, the adjusted intraclass correlation coefficient was 0.27 (95% CI 0.20-0.35) for TIs and 0.47 (95% CI 0.41-0.54) for MMIs. CONCLUSIONS: Within and between-school reliability was qualitatively higher for MMIs than for TIs. Nonetheless, TI reliabilities were higher than anticipated from prior literature, suggesting TIs may not need to be abandoned on reliability grounds if other factors favor their use.

Training the translational research teams of the future: UC Davis-HHMI Integrating Medicine into Basic Science program.

There is a need for successful models of how to recruit, train, and retain bench scientists at the earliest stages of their careers into translational research. One recent, promising model is the University of California Davis Howard Hughes Medical Institute Integrating Medicine into Basic Science (HHMI-IMBS) program, part of the HHMI Med into Grad initiative. This paper outlines the HHMI-IMBS program's logic, design, and curriculum that guide the goal of research that moves from bedside to bench. That is, a curriculum that provides graduate students with guided translational training, clinical exposure, team science competencies, and mentors from diverse disciplines that will advance the students careers in clinical translational research and re-focusing of research to answer clinical dilemmas. The authors have collected data on 55 HHMI-IMBS students to date. Many of these students are still completing their graduate work. In the current study the authors compare the initial two cohorts (15 students) with a group of 29 control students to examine the program success and outcomes. The data indicate that this training program provides an effective, adaptable model for training future translational researchers. HHMI-IMBS students showed improved confidence in conducting translational research, greater interest in a future translational career, and higher levels of research productivity and collaborations than a comparable group of predoctoral students.

Physician communication regarding prostate cancer screening: analysis of unannounced standardized patient visits.

PURPOSE: Prostate cancer screening with prostate-specific antigen (PSA) is a controversial issue. The present study aimed to explore physician behaviors during an unannounced standardized patient encounter that was part of a randomized controlled trial to educate physicians using a prostate cancer screening, interactive, Web-based module. METHODS: Participants included 118 internal medicine and family medicine physicians from 5 health systems in California, in 2007-2008. Control physicians received usual education about prostate cancer screening (brochures from the Center for Disease Control and Prevention). Intervention physicians participated in the prostate cancer screening module. Within 3 months, all physicians saw unannounced standardized patients who prompted prostate cancer screening discussions in clinic. The encounter was audio-recorded, and the recordings were transcribed. Authors analyzed physician behaviors around screening: (1) engagement after prompting, (2) degree of shared decision making, and (3) final recommendations for prostate cancer screening. RESULTS: After prompting, 90% of physicians discussed prostate cancer screening. In comparison with control physicians, intervention physicians showed somewhat more shared decision making behaviors (intervention 14 items vs control 11 items, P <.05), were more likely to mention no screening as an option (intervention 63% vs control 26%, P <.05), to encourage patients to consider different screening options (intervention 62% vs control 39%, P <.05) and seeking input from others (intervention 25% vs control 7%, P<.05). CONCLUSIONS: A brief Web-based interactive educational intervention can improve shared decision making, neutrality in recommendation, and reduce PSA test ordering. Engaging patients in discussion of the uses and limitations of tests with uncertain value can decrease utilization of the tests.

Pairing physician education with patient activation to improve shared decisions in prostate cancer screening: a cluster randomized controlled trial.

BACKGROUND: Most expert groups recommend shared decision making for prostate cancer screening. Most primary care physicians, however, routinely order a prostate-specific antigen (PSA) test with little or no discussion about whether they believe the potential benefits justify the risk of harm. We sought to assess whether educating primary care physicians and activating their patients to ask about prostate cancer screening had a synergistic effect on shared decision making, rates and types of discussions about prostate cancer screening, and the physician's final recommendations. METHODS: Our study was a cluster randomized controlled trial among primary care physicians and their patients, comparing usual education (control), with physician education alone (MD-Ed), and with physician education and patient activation (MD-Ed+A). Participants included 120 physicians in 5 group practices, and 712 male patients aged 50 to 75 years. The interventions comprised a Web-based educational program for all intervention physicians and MD-Ed+A patients compared with usual education (brochures from the Centers for Disease Control and Prevention). The primary outcome measure was patients' reported postvisit shared decision making regarding prostate cancer screening; secondary measures included unannounced standardized patients' reported shared decision making and the physician's recommendation for prostate cancer screening. RESULTS: Patients' ratings of shared decision making were moderate and did not differ between groups. MD-Ed+A patients reported that physicians had higher prostate cancer screening discussion rates (MD-Ed+A = 65%, MD-Ed = 41%, control=38%; P <.01). Standardized patients reported that physicians seeing MD-Ed+A patients were more neutral during prostate cancer screening recommendations (MD-Ed+A=50%, MD-Ed=33%, control=15%; P <.05). Of the male patients, 80% had had previous PSA tests. CONCLUSIONS: Although activating physicians and patients did not lead to significant changes in all aspects of physician attitudes and behaviors that we studied, interventions that involved physicians did have a large effect on their attitudes toward screening and in the discussions they had with patients, including their being more likely than control physicians to engage in prostate cancer screening discussions and more likely to be neutral in their final recommendations.

State policies and language access in California's HMOs: public reporting and regulation of HMOs' language services.

OBJECTIVE: Describe the status of language access services for California's limited English proficient (LEP) health maintenance organization (HMO) members within the context of voluntary public reporting and anticipated state regulation. STUDY DESIGN: Descriptive analysis of longitudinal data provided by health plans. METHODS: Retrospective, descriptive analysis of responses to voluntary annual/biennial surveys of commercial, Medicare, Medicaid, and Healthy Families HMOs, 2003-2008. RESULTS: From 2003 to 2008, during California's public reporting of HMO language services, the percentage of HMOs providing in-person interpretation free of charge to consumers increased to over 80% across all product lines. By 2008, the percentage of commercial HMO plans matching new LEP members to providers by language increased to 70%, while 79% provided telephone interpretation services in at least seven languages. CONCLUSIONS: Increasingly HMOs provide language access services for LEP Californians, perhaps resulting from public reporting and anticipated state regulation, although similar trends in other states cannot be ruled out.

Hepatitis C videoconferencing: the impact on continuing medical education for rural healthcare providers.

This study compared the impact of multipoint videoconferencing (VC) versus standard lecturing (ST) on primary care providers' (MDs, NPs/PAs, and RNs) education regarding hepatitis C virus (HCV). The hypothesis was that the educational impact of teaching through telemedicine is comparable to the traditional method. The aim was to provide participants clinically relevant information and knowledge about the natural history, diagnosis, and management of HCV. Improved knowledge was scored from a 10-item quiz administered before and after the educational intervention. Comparison of the pretest knowledge scores within provider groups showed no statistically significant difference in baseline knowledge for the ST versus VC method. However, for all practitioners combined, the VC group scored significantly lower on the pretest than the ST group (p < 0.05). All three types of learners improved their knowledge scores following intervention. On average, MDs and NP/PAs correctly answered two to 3.5 more questions in the posttest. RNs showed the greatest improvements, correctly answering an average of four to five more questions following intervention. Improvement in knowledge scores between the two methods was statistically significant in favor of VC for the MDs (VC = 3.56 +/- 1.92 vs. ST = 2.13 +/- 1.89, p < 0.001) and all groups combined (VC 4.37 +/- 1.92 vs ST 3.06 +/- 1.89, p < 0.001). The results of this study indicate that VC is equivalent, if not better, than standard continuing medical education (CME). VC can potentially improve clinician education regarding the history, diagnosis, and management of HCV, thereby making a substantial impact on the clinical course of patients with this condition. In addition, VC has the potential to eliminate the financial and geographic barriers to professional education for rural practitioners.

What data do California HMOs use to select hospitals for contracting?

OBJECTIVE: To explore whether health maintenance organization (HMO) executives in a mature market are familiar with hospital report cards, whether they find the report cards useful (and if not, why not), and how they weight such data relative to other factors. STUDY DESIGN: Cross-sectional survey of HMO executives in 1999. PATIENTS AND METHODS: We contacted all 47 licensed HMOs and the sponsors of all 90 employee medical benefit plans in California with at least 1000 participants. Thirty of the 47 (63.8%) eligible HMOs provided usable responses: 19 in writing, 11 by telephone. RESULTS: HMO executives reported basing their contracting decisions primarily on hospital accreditation, location, and price. Although hospital quality is considered important, HMO executives rely primarily on accreditation, government disciplinary actions, reputation, and member satisfaction as measures of quality. Respondents voiced multiple concerns about the validity and usefulness of currently available process and outcome data. Accredited plans are more likely than unaccredited plans to perform independent analyses of hospital performance. CONCLUSIONS: Although HMO executives are interested in information on hospital quality, and are confident that such information will improve care, they are concerned about the limitations of available data and uncomfortable weighting these data heavily in selecting network hospitals. Prior empirical evidence suggests that HMOs may rely on surrogate quality measures and informal evaluation mechanisms to steer their members toward better-performing hospitals. Policy makers and producers of hospital report cards will need to address these problems by providing more timely data with longitudinal follow-up and external validation.

Can administrative data be used to compare postoperative complication rates across hospitals?

BACKGROUND: Several quality assessment systems use administrative data to identify postoperative complications, with uncertain validity. OBJECTIVES: To determine how accurately postoperative complications are reported in administrative data, whether accuracy varies systematically across hospitals, and whether serious complications are more consistently reported. DESIGN: Retrospective cohort. SUBJECTS: Nine hundred ninety-one randomly sampled adults who underwent elective lumbar diskectomies at 30 nonfederal acute care hospitals in California in 1990 to 1991. Hospitals with especially low or high risk-adjusted complication rates, and patients who experienced complications, were over sampled. MEASURES: Postoperative complications were specified by reviewing medical literature and consulting clinical experts; each complication was mapped to ICD-9-CM. Hospital-reported complications were compared with our independent recoding of the same records. RESULTS: The weighted sensitivity, specificity, and positive and negative predictive values for reported complications were 35%, 98%, 82%, and 84%, respectively. The weighted sensitivity was 30% for serious, 40% for minor, and 10% for questionable complications. It varied from 21% among hospitals with fewer complications than expected to 45% among hospitals with more complications than expected. Only reoperation, bacteremia/sepsis, postoperative infection, and deep vein thrombosis were reported with at least 60% sensitivity. Half of the difference in risk-adjusted complication rates between low and high outlier hospitals was attributable to reporting variation. CONCLUSIONS: ICD-9-CM complications were underreported among diskectomy patients, especially at hospitals with low risk-adjusted complication rates. The validity of using coded complications to compare provider performance is questionable, even with careful efforts to identify serious events, although these results must be confirmed using more recent data.

Can administrative data be used to ascertain clinically significant postoperative complications?

The purpose of this study is to assess whether postoperative complications can be ascertained using administrative data. We randomly sampled 991 adults who underwent elective open diskectomies at 30 nonfederal acute care hospitals in California. Postoperative complications were specified by reviewing medical literature and by consulting clinical experts. We compared hospital-reported ICD-9-CM data and independently recoded ICD-9-CM data with complications abstracted by clinicians using detailed criteria. Recoded ICD-9-CM data were more likely than hospital-reported ICD-9-CM data to capture true complications, when they occurred, but they also mislabeled more patients who never experienced clinically significant complications. This finding was most evident for mild or ambiguous complications, such as atelectasis, posthemorrhagic anemia, and hypotension. Overall, recoded ICD-9-CM data captured 47% and 56% of all mild and severe complications, respectively, whereas hospital-reported ICD-9-CM data captured only 37% and 44%, respectively, of all mild and severe complications. These findings raise questions about the validity of using administrative data to ascertain postoperative complications, even if coders are carefully hired, trained, and supervised. ICD-9-CM complication codes are more promising as a tool to help providers identify their own adverse outcomes than as a tool for comparing performance.