Trends in Adoption and Maturation of Telehealth Programs at Teaching Hospitals and Health Systems.

Introduction: Although early adopters of telehealth have built and sustained telehealth programs over long periods, little research has been conducted differentiating the characteristics of health systems at different stages of maturation. Methods: This study surveyed 165 major teaching hospitals and health systems from fiscal year 2015 through 2018 about the stage and characteristics of their telehealth services. Respondents reported (i) the progression level of their telehealth program, (ii) which of six services they provide, and (iii) greatest barriers and motivators to implementing telehealth, as well as their overall operational and financial characteristics. Results: Telehealth programs at teaching hospitals progressed steadily and adoption of a wide range of telehealth delivery modes expanded. Hospital operational and financial characteristics corresponding to both higher maturation and the adoption of more delivery modes were identified. Reported barriers and motivations were similar across maturation levels. Discussion: With telehealth's broader use and the heterogeneity of delivery modes being utilized, a binary metric of whether or not to implement telehealth does not sufficiently capture key differences in telehealth programs or differentiate implementation scope and scale across health systems. Conclusions: The findings suggest that programs at different levels of maturation are characteristically different from one another. Identifying factors related to mature telehealth programs may help guide policymakers, future telehealth program leaders, and other stakeholders in identifying barriers to continued investment in telehealth.

Expert Consensus: Telehealth Skills for Health Care Professionals.

Background: The COVID-19 pandemic has driven most clinicians, from those practicing in small independent practices to those in large system, to adopt virtual care. However, individuals and organizations may lack the experience and skills that would be considered fundamental prerequisites to adopting telehealth in less urgent times. What are those skills? Before the pandemic, the Association of American Medical Colleges (AAMC) convened national experts to identify and articulate a consensus set of critical telehealth skills for clinicians. Methods: Through a structured review of the literature, followed by several rounds of review and refinement by committee and community members via a modified Delphi process, the committee came to consensus on a set of skills required by clinicians to provide quality care via telehealth. Conclusion: The consensus set of telehealth skills presented in this paper, developed by the AAMC and national experts, can serve providers and health systems seeking to ensure that clinicians are prepared to meet the demand for care delivered via telehealth now and in the future.

Comparing Patients' Experiences with Electronic and Traditional Consultation: Results from a Multisite Survey.

BACKGROUND: There have been no large-scale studies to date of patients' experiences with electronic consultation (eConsult) between primary and specialty care. OBJECTIVE: Compare experiences with eConsult and referral for in-person specialist consultation. DESIGN: Online survey 2-6 weeks following eConsult or referral at 9 US academic medical centers. PARTICIPANTS: Adult patients with no more than one eConsult or referral order from a primary care provider (PCP) in the prior month. Over 9 months, 29,291 email invitations were sent (88% referral; 12% eConsult). MAIN MEASURES: Trust in and satisfaction with PCP; consult type awareness; agreement with decision to seek specialist input; timeliness of care; mode of PCP-patient eConsult communication; satisfaction with specialist's recommendations; future preference for eConsult or referral. KEY RESULTS: A 27.6% response rate yielded 8087 respondents (88.4% referral; 11.6% eConsult). Many did not know that their PCP had placed a referral (32.8% unaware) or eConsult (52.9%), and eConsult awareness was significantly higher among patients reporting better health (OR 1.62, 95% CI 1.18-2.23). Most (81.4% eConsult; 82.0% referral) were satisfied with the specialist's recommendations. Those who had a good primary care experience were more likely to be satisfied (eConsult: OR 10.63, 95% CI 2.95-38.32; referral: OR 2.87, 95% CI 1.86-4.44). For a similar problem in the future, 78% of eConsult and 32% percent of referral patients preferred eConsult. CONCLUSIONS: This multisite study demonstrates that many patients find virtual consultation to be an acceptable strategy for the management of their medical condition and that trust and confidence in one's PCP are crucial ingredients for a satisfying eConsult experience. The lack of awareness of eConsult among many patients who were beneficiaries of the service warrants an increased effort to include patients in eConsult decision-making and communication. Further research is needed to assess eConsult acceptability and satisfaction in more diverse patient populations.

Patients Assess an eConsult Model's Acceptability at 5 US Academic Medical Centers.

PURPOSE: Electronic consultation (eConsult), involving asynchronous primary care clinician-to-specialist consultation, is being adopted at a growing number of health systems. Most evaluations of eConsult programs have assessed clinical and financial impacts and clinician acceptability. Less attention has been focused on patients' opinions. We set out to understand patient perspectives and preferences for hypothetical eConsult use at 5 US academic medical centers in the process of adopting an eConsult model. METHODS: We invited adult primary care patients to participate in focus groups. Participants were introduced to the eConsult model, considered its potential benefits and drawbacks, judged the acceptability of a hypothetical copay, and expressed their preferences for future involvement in eConsult decision making and communication. Thematic analysis was used for data interpretation. RESULTS: One focus group was conducted at each of the 5 sites with a total of 52 participants. Focus groups responded positively to the idea of eConsult, with quicker access to specialty care and convenience identified as key benefits. Approval was particularly high among those with a trusted primary care clinician. Preference for involvement in eConsult decision making and communication varied and enthusiasm about eConsult waned when a hypothetical copay was introduced. Concerns included potential misuse of eConsult and exclusion of the patient's illness narrative in the eConsult exchange. CONCLUSIONS: Primary care patients expressed strong support for eConsult, particularly when used by a trusted primary care clinician, in addition to voicing several concerns. Patient involvement in eConsult outreach and education efforts could help to enhance the model's effectiveness and acceptability.

Republished: Key characteristics of successful quality improvement curricula in physician education: a realist review.

PURPOSE: Quality improvement (QI) is a common competency that must be taught in all physician training programmes, yet, there is no clear best approach to teach this content in clinical settings. We conducted a realist systematic review of the existing literature in QI curricula within the clinical setting, highlighting examples of trainees learning QI by doing QI. METHOD: Candidate theories describing successful QI curricula were articulated a priori. We searched MEDLINE (1 January 2000 to 12 March 2013), the Cochrane Library (2013) and Web of Science (15 March 2013) and reviewed references of prior systematic reviews. Inclusion criteria included study design, setting, population, interventions, clinical and educational outcomes. The data abstraction tool included categories for setting, population, intervention, outcomes and qualitative comments. Themes were iteratively developed and synthesised using realist review methodology. A methodological quality tool assessed the biases, confounders, secular trends, reporting and study quality. RESULTS: Among 39 studies, most were before-after design with resident physicians as the primary population. Twenty-one described clinical interventions and 18 described educational interventions with a mean intervention length of 6.58 (SD=9.16) months. Twenty-eight reported successful clinical improvements; no studies reported clinical outcomes that worsened. Characteristics of successful clinical QI curricula include attention to the interface of educational and clinical systems, careful choice of QI work for the trainees and appropriately trained local faculty. CONCLUSIONS: This realist review identified success characteristics to guide training programmes, medical schools, faculty, trainees, accrediting organisations and funders to further develop educational and improvement resources in QI educational programmes.

Factors influencing family physicians' contribution to the child health care workforce.

PURPOSE: We wanted to explore demographic and geographic factors associated with family physicians' provision of care to children. METHODS: We analyzed the proportion of family physicians providing care to children using survey data collected by the American Board of Family Medicine from 2006 to 2009. Using a cross-sectional study design and logistic regression analysis, we examined the association of various physician demographic and geographic factors and providing care of children. RESULTS: Younger age, female sex, and rural location are positive predictors of family physicians providing care to children: odds ratio (OR) = 0.97 (95% CI, 0.97-0.98), 1.19 (1.12-1.25), and 1.50 (1.39-1.62), respectively. Family physicians practicing in a partnership are more likely to provide care to children than those in group practice: OR = 1.53 (95% CI, 1.40-1.68). Family physicians practicing in areas with higher density of children are more likely to provide care to children: OR = 1.04 (95% CI, 1.03-1.05), while those in high-poverty areas are less likely 0.10 (95% CI, 0.10-0.10). Family physicians located in areas with no pediatricians are more likely to provide care to children than those in areas with higher pediatrician density: OR = 1.80 (95% CI, 1.59-2.01). CONCLUSIONS: Various demographic and geographic factors influence the likelihood of family physicians providing care to children, findings that have important implications to policy efforts aimed at ensuring access to care for children.

Growing a rural family physician workforce: The contributions of rural background and rural place of residency training.

OBJECTIVE: To determine the distinct influences of rural background and rural residency training on rural practice choice among family physicians. DATA SOURCES AND STUDY SETTING: We used a subset of The RTT Collaborative rural residency list and longitudinal data on family physicians from the American Board of Family Medicine National Graduate Survey (NGS; three cohorts, 2016-2018) and American Medical College Application Service (AMCAS). STUDY DESIGN: We conducted a logistic regression, computing predictive marginals to assess associations of background and residency location with physician practice location 3 years post-residency. DATA COLLECTION/EXTRACTION METHODS: We merged NGS data with residency type-rural or urban-and practice location with AMCAS data on rural background. PRINCIPAL FINDINGS: Family physicians from a rural background were more likely to choose rural practice (39.2%, 95% CI = 35.8, 42.5) than those from an urban background (13.8%, 95% CI = 12.5, 15.0); 50.9% (95% CI = 43.0, 58.8) of trainees in rural residencies chose rural practice, compared with 18.0% (95% CI = 16.8, 19.2) of urban trainees. CONCLUSIONS: Increasing rural programs for training residents from both rural and urban backgrounds, as well as recruiting more rural students to medical education, could increase the number of rural family physicians.

Development of eConsult reflective learning tools for healthcare providers: a pragmatic mixed methods approach.

BACKGROUND: Electronic consultation (eConsult) programs are crucial components of modern healthcare that facilitate communication between primary care providers (PCPs) and specialists. eConsults between PCPs and specialists. They also provide a unique opportunity to use real-world patient scenarios for reflective learning as part of professional development. However, tools that guide and document learning from eConsults are limited. The purpose of this study was to develop and pilot two eConsult reflective learning tools (RLTs), one for PCPs and one for specialists, for those participating in eConsults. METHODS: We performed a four-phase pragmatic mixed methods study recruiting PCPs and specialists from two public health systems located in two countries: eConsult BASE in Canada and San Francisco Health Network eConsult in the United States. In phase 1, subject matter experts developed preliminary RLTs for PCPs and specialists. During phase 2, a Delphi survey among 20 PCPs and 16 specialists led to consensus on items for each RLT. In phase 3, we conducted cognitive interviews with three PCPs and five specialists as they applied the RLTs on previously completed consults. In phase 4, we piloted the RLTs with eConsult users. RESULTS: The RLTs were perceived to elicit critical reflection among participants regarding their knowledge and practice habits and could be used for quality improvement and continuing professional development. CONCLUSION: PCPs and specialists alike perceived that eConsult systems provided opportunities for self-directed learning wherein they were motivated to investigate topics further through the course of eConsult exchanges. We recommend the RLTs be subject to further evaluation through implementation studies at other sites.

Primary care pediatricians' satisfaction with subspecialty care, perceived supply, and barriers to care.

OBJECTIVES: To compare satisfaction with specialty care by primary care pediatricians (PCPs), perceived barriers to care, and adequacy of specialist supply. STUDY DESIGN: A survey of U.S. pediatricians was conducted in 2007. PCPs were asked about satisfaction with specialty care for their patients, as well as supply of specific pediatric subspecialists. Responses of rural and nonrural PCPs were compared regarding 10 potential barriers to care. RESULTS: Most PCPs are satisfied with the quality of subspecialty care. However, they were not satisfied with wait times for appointments, and the availability of many pediatric medical subspecialties and several pediatric surgical specialties. Rural PCPs were significantly more likely to report these shortages compared with nonrural pediatricians; these included 9 of the 18 medical and 5 of the 7 surgical specialties. In addition to wait times for appointments, PCPs reported that subspecialists' nonparticipation in health insurance plans and lack of acceptance of uninsured patients were also barriers to obtaining subspecialty care for their patients. CONCLUSIONS: PCPs provide valuable insight into access to the pediatric subspecialty workforce. This survey of PCPs raises significant concerns about the adequacy of children's access to pediatric subspecialists, especially in rural communities.

Defining Rural: The Predictive Value of Medical School Applicants' Rural Characteristics on Intent to Practice in a Rural Community.

PURPOSE: To understand the predictive value of medical student application characteristics on rural practice intent. METHOD: The authors constructed a linked database of 2012-2017 medical school matriculants from American Medical College Application Service applications and Association of American Medical Colleges Matriculating Student Questionnaire (MSQ, 2012-2017) and Graduation Questionnaire (GQ, 2016-2018). Using logistic regression, they compared application variables (birth, high school, childhood county, and self-declared geographical origin) to students' MSQ and GQ intent to practice rurally. Rural practice intent from matriculation to graduation was compared using the McNemar test for paired nominal data. RESULTS: The number of students meeting inclusion criteria was 115,027. More students self-declared rural origin (18,662; 16.4%) than were identified using geographically coded variables (6,097-8,784; 6.1%-8.1%). Geographically coded rural variables were all strongly and similarly associated with rural practice intent, with rural high school being the most predictive on both MSQ (odds ratio [OR], 6.51; CI, 6.1-7.0) and GQ (OR, 5.4; CI, 4.9-6.0). Self-declared geographical origin was associated with a similar rural practice intent on both MSQ (OR, 6.93; CI, 6.5-7.3) and GQ (OR, 5.69; CI, 5.2-6.2). Rural practice intent declined for all groups from matriculation to graduation. CONCLUSIONS: Considering students who self-declare as rural identifies a larger group of rural medical school applicants than more "objective" geographic variables, without negatively impacting students' predicted interest in eventual rural practice. Further research should track actual practice location and explore strategies to mitigate declining rural career interest.

The Decline In Rural Medical Students: A Growing Gap In Geographic Diversity Threatens The Rural Physician Workforce.

Growing up in a rural setting is a strong predictor of future rural practice for physicians. This study reports on the fifteen-year decline in the number of rural medical students, culminating in rural students' representing less than 5 percent of all incoming medical students in 2017. Furthermore, students from underrepresented racial/ethnic minority groups in medicine (URM) with rural backgrounds made up less than 0.5 percent of new medical students in 2017. Both URM and non-URM students with rural backgrounds are substantially and increasingly underrepresented in medical school. If the number of rural students entering medical school were to become proportional to the share of rural residents in the US population, the number would have to quadruple. To date, medical schools' efforts to recognize and value a rural background have been insufficient to stem the decline in the number of rural medical students. Policy makers and other stakeholders should recognize the exacerbated risk to rural access created by this trend. Efforts to reinforce the rural pipeline into medicine warrant further investment and ongoing evaluation.

Geographic variation in spatial accessibility of U.S. healthcare providers.

BACKGROUND: Growing physician maldistribution and population demographic shifts have contributed to large geographic variation in healthcare access and the emergence of advanced practice providers as contributors to the healthcare workforce. Current estimates of geographic accessibility of physicians and advanced practice providers rely on outdated "provider per capita" estimates that have shortcomings. PURPOSE: To apply state of the art methods to estimate spatial accessibility of physician and non-physician clinician groups and to examine factors associated with higher accessibility. METHODS: We used a combination of provider location, medical claims, and U.S. Census data to perform a national study of health provider accessibility. The National Plan and Provider Enumeration System was used along with Medicare claims to identify providers actively caring for patients in 2014 including: primary care physicians (i.e., internal medicine and family medicine), specialists, nurse practitioners, and chiropractors. For each U.S. ZIP code tabulation area, we estimated provider accessibility using the Variable-distance Enhanced 2 step Floating Catchment Area method and performed a Getis-Ord Gi* analysis for each provider group. Generalized linear models were used to examine associations between population characteristics and provider accessibility. RESULTS: National spatial patterns of the provider groups differed considerably. Accessibility of internal medicine most resembled specialists with high accessibility in urban locales, whereas relative higher accessibility of family medicine physicians was concentrated in the upper Midwest. In our adjusted analyses independent factors associated with higher accessibility were very similar between internal medicine physicians and specialists-presence of a medical school in the county was associated with approximately 70% higher accessibility and higher accessibility was associated with urban locales. Nurse practitioners were similar to family medicine physicians with both having higher accessibility in rural locales. CONCLUSIONS: The Variable-distance Enhanced 2 step Floating Catchment Area method is a viable approach to measure spatial accessibility at the national scale.

Key characteristics of successful quality improvement curricula in physician education: a realist review.

PURPOSE: Quality improvement (QI) is a common competency that must be taught in all physician training programmes, yet, there is no clear best approach to teach this content in clinical settings. We conducted a realist systematic review of the existing literature in QI curricula within the clinical setting, highlighting examples of trainees learning QI by doing QI. METHOD: Candidate theories describing successful QI curricula were articulated a priori. We searched MEDLINE (1 January 2000 to 12 March 2013), the Cochrane Library (2013) and Web of Science (15 March 2013) and reviewed references of prior systematic reviews. Inclusion criteria included study design, setting, population, interventions, clinical and educational outcomes. The data abstraction tool included categories for setting, population, intervention, outcomes and qualitative comments. Themes were iteratively developed and synthesised using realist review methodology. A methodological quality tool assessed the biases, confounders, secular trends, reporting and study quality. RESULTS: Among 39 studies, most were before-after design with resident physicians as the primary population. Twenty-one described clinical interventions and 18 described educational interventions with a mean intervention length of 6.58 (SD=9.16) months. Twenty-eight reported successful clinical improvements; no studies reported clinical outcomes that worsened. Characteristics of successful clinical QI curricula include attention to the interface of educational and clinical systems, careful choice of QI work for the trainees and appropriately trained local faculty. CONCLUSIONS: This realist review identified success characteristics to guide training programmes, medical schools, faculty, trainees, accrediting organisations and funders to further develop educational and improvement resources in QI educational programmes.