A virtual mother-infant postpartum psychotherapy group for mothers with a history of adverse childhood experiences: open-label feasibility study.

OBJECTIVES: Mothers with a history of adverse childhood experiences (ACE) are at elevated risk for postpartum mental illness and impairment in the mother-infant relationship. Interventions attending to maternal-infant interactions may improve outcomes for these parents and their children, but barriers to accessing in-person postpartum care limit uptake. We adapted a postpartum psychotherapy group for mothers with mental illness (e.g., mood, anxiety, trauma-related disorders) and ACE for live video-based delivery, and evaluated feasibility, acceptability, and preliminary efficacy in an open-label pilot study. METHODS: We recruited adults with children (6-18 months) from a perinatal psychiatry program in Toronto, Canada. The intervention was a live video-based 12-week interactive psychotherapy group focused on maternal symptoms and maternal-infant relationships. The primary outcome was feasibility, including feasibility of recruitment and retention, fidelity of the intervention, and acceptability to patients and group providers. Maternal clinical outcomes were compared pre- to post-intervention, as secondary outcomes. RESULTS: We recruited 31 participants (mean age 36.5 years (SD 3.9)) into 6 groups; 93.6% (n = 29) completed post-group questionnaires, and n = 20 completed an optional post-group acceptability interview. Mean weekly group attendance was 83% (IQR 80-87); one participant (3.2%) dropped out. All group components were implemented as planned, except for dyadic exercises where facilitator observation of dyads was replaced with unobserved mother-infant exercises followed by in-group reflection. Participant acceptability was high (100% indicated the virtual group was easy to access, beneficial, and reduced barriers to care). Mean maternal depressive [Edinburgh Postnatal Depression Scale: 14.6 (SD 4.2) vs. 11.8 (SD 4.2), paired t, p = 0.005] and post-traumatic stress [Posttraumatic Stress Disorder Checklist for DSM-5: 35.5 (SD 19.0) vs. 27.1 (SD 16.7)], paired t, p = 0.01] symptoms were significantly lower post vs. pre-group. No differences were observed on mean measures of anxiety, emotion regulation or parenting stress. CONCLUSIONS: Recruitment and retention met a priori feasibility criteria. There were significant pre- to post-group reductions in maternal depressive and post-traumatic symptoms, supporting proceeding to larger-scale implementation and evaluation of the intervention, with adaptation of dyadic exercises.

Supporting and Incentivizing Peer Leaders for an Internet-Based Private Peer Community for Youths With Type 1 Diabetes: Social Network and Directed Content Analysis.

BACKGROUND: Youths with type 1 diabetes (T1D) frequently experience stigma. Internet-based peer communities can mitigate this through social support but require leaders to catalyze exchange. Whether nurturing potential leaders translates into a central role has not been well studied. Another issue understudied in such communities is lurking, the viewing of exchanges without commenting or posting. OBJECTIVE: We aimed to assess the centrality of the peer leaders we selected, trained, and incentivized within the Canadian Virtual Peer Network (VPN)-T1D. This is a private Facebook (Meta Platforms, Inc) group that we created for persons aged 14 to 24 years with T1D. We specifically sought to (1) compare a quantitative estimate of network centrality between peer leaders and regular members, (2) assess the proportions of network exchanges that were social support oriented, and (3) assess proportions of high engagement (posts, comments, reactions, and votes) and low engagement (lurking) exchanges. METHODS: We recruited peer leaders and members with T1D from prior study cohorts and clinics. We trained 10 leaders, provided them with a monthly stipend, and encouraged them to post on the private Facebook group we launched on June 21, 2017. We extracted all communications (posts, messages, reactions, polls, votes, and views) that occurred until March 20, 2020. We calculated each member's centrality (80% of higher engagement communications comprising posts, comments, and reactions plus 20% of members with whom they connected). We divided each member's centrality by the highest centrality to compute the relative centrality, and compared the mean values between leaders and members (linear regression). We calculated the proportions of communications that were posts, comments, reactions, and views without reaction. We performed content analysis with a social support framework (informational, emotional, esteem-related, network, and tangible support), applying a maximum of 3 codes per communication. RESULTS: VPN-T1D gained 212 regular members and 10 peer leaders over 33 months; of these 222 members, 26 (11.7%) exited. Peer leaders had 10-fold higher relative centrality than regular members (mean 0.53, SD 0.26 vs mean 0.04, SD 0.05; 0.49 difference; 95% CI 0.44-0.53). Overall, 91.4% (203/222) of the members connected at least once through posts, comments, or reactions. Among the 75,051 communications, there were 5109 (6.81%) posts, comments, and polls, 6233 (8.31%) reactions, and 63,709 (84.9%) views (lurking). Moreover, 54.9% (3430/6253) of codes applied were social support related, 66.4% (2277/3430) of which were informational (eg, insurance and travel preparation), and 20.4% (699/3430) of which were esteem related (eg, relieving blame). CONCLUSIONS: Designating, training, and incentivizing peer leaders may stimulate content exchange and creation. Social support was a key VPN-T1D deliverable. Although lurking accounted for a high proportion of the overall activity, even those demonstrating this type of passive participation likely derived benefits, given that the network exit rate was low. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/18714.

Patient-reported outcome measures for assessing health-related quality of life in people with type 2 diabetes: A systematic review.

Patient-Reported Outcome Measures (PROMs) are important tools to assess outcomes relevant to patients, with Health-Related Quality Of Life (HRQOL) as an important construct to be measured. Many different HRQOL PROMs are used in the type 2 diabetes field, however a complete overview of these PROMs is currently lacking. We therefore aimed to systematically describe and classify the content of all PROMs that have specifically been developed or validated to measure (aspects of) HRQOL in people with type 2 diabetes. A literature search was performed in PubMed and EMBASE until 31 December 2021. Studies on the development or validation of a PROM measuring HRQOL, or aspects of HRQOL, in people with type 2 diabetes were included. Title and abstract and full-text screening were conducted by two independent researchers and data extraction was performed independently by one of the researchers. Data were extracted on language in which the PROM was developed, target population, construct(s) being measured, names of (sub)scales and number of items per (sub)scale. In addition, all PROMs and subscales were classified according to specific aspects of HRQOL based on the Wilson & Cleary model (symptom status, functional status, general health perceptions) to aid researchers in PROM selection. In total 220 studies were identified that developed or validated PROMs that measure (aspects of) HRQOL in people with type 2 diabetes. Of the 116 unique HRQOL PROMs, 91 (of the subscales) measured symptom status, 60 measured functional status and 26 measured general health perceptions. In addition, 16 of the PROMs (subscales) measured global quality of life. 61 of the 116 PROMs (subscales) also include characteristics of the individual (e.g. aspects of personality, coping) or environment (e.g. social or financial support) and patient-reported experience measures (PREMs, e.g. measure of a patient's perception of their personal experience of the healthcare they have received, e.g. treatment satisfaction), which are not part of the HRQOL construct. Only 9 of the 116 PROMs measure all aspects of HRQOL based on the Wilson & Cleary model. Finally, 8 of the 116 PROMs stating to measure HRQOL, measured no HRQOL construct. In conclusion, a large number of PROMs are available for people with type 2 diabetes, which intend to measure (aspects of) HRQOL. These PROMs measure a large variety of (sub)constructs, which are not all HRQOL constructs, with a small amount of PROMs not measuring HRQOL at all. There is a need for consensus on which aspects of HRQOL should be measured in people with type 2 diabetes and which PROMs to use in research and daily practice. PROSPERO: CRD42017071012. COMET database: http://www.comet-initiative.org/studies/details/956 .

Outpatient visit trends for internal medicine ambulatory care sensitive conditions after the COVID-19 pandemic: a time-series analysis.

BACKGROUND: The COVID-19 pandemic led to a dramatic shift in the delivery of outpatient medicine with reduced in-person visits and a transition to predominantly virtual visits. We sought to understand trends in visit patterns for ambulatory care sensitive conditions (ACSCs) commonly seen in internal medicine clinics. METHODS: We included adult outpatients seen for an ACSC between March 15th, 2017 and March 14th, 2021 at a single-centre in Ontario, Canada. Monthly visits were assessed by visit type (new consultation, follow-up), diagnosis, and clinic. Time series analyses compared visit volumes pre- and post-pandemic. Proportion of virtual visits were compared before and during the pandemic. Patient and visit factors were compared between in-person and virtual visits. RESULTS: 8274 patients with 34,021 visits were included. Monthly visits increased by 15% during the pandemic (p <  0.0001). New consultations decreased by 10% (p = 0.0053) but follow-up visits increased by 21% (p <  0.0001). Monthly heart failure visits increased by 43% (p <  0.0001) whereas atrial fibrillation visits decreased. Pre- pandemic, < 1% of visits were virtual compared to 82% during the pandemic (p <  0.0001). Less than half of heart failure visits were virtual whereas > 95% of diabetes visits were virtual. CONCLUSIONS: We found a significant increase in overall visits to internal medicine clinics driven by increased volumes of follow-up visits, which more than offset decreased new consultations. There was variability in visit trends and uptake of virtual care by visit diagnosis, which may indicate challenges with delivery of virtual care for certain conditions.

Patient and Provider Experiences With Virtual Care in a Large, Ambulatory Care Hospital in Ontario, Canada During the COVID-19 Pandemic: Observational Study.

BACKGROUND: Virtual care use increased during the COVID-19 pandemic. The impact of that shift on patient and provider experiences is unclear. OBJECTIVE: We evaluated patient and provider experiences with virtual visits across an academic, ambulatory hospital in Toronto, Canada and assessed predictors of positive experience with virtual care. METHODS: Survey data were analyzed from consenting patients who attended at least one virtual visit (video or telephone) and from consenting providers who delivered at least one virtual visit. Distributions for demographic variables and responses to survey questions are reported, with statistical significance assessed using chi-square tests and t tests. Ordinal logistic regression analysis was used to identify any patient predictors of responses. RESULTS: During the study period, 253 patients (mean age 45.1, SD 15.6 years) completed 517 video visit surveys, and 147 patients (mean age 41.6, SD 16.4 years) completed 209 telephone visit surveys. A total of 75 and 94 providers completed the survey in June 2020 and June 2021, respectively. On a scale from 1 to 10 regarding likelihood to recommend virtual care to others, fewer providers rated a score of 8 or above compared with patients (providers: 62/94, 66% for video and 49/94, 52% for telephone; patients: 415/517, 80% for video and 150/209, 72% for telephone). Patients of non-White ethnicity had lower odds of rating a high score of 9 or 10 compared with White patients (odds ratio 0.52, 95% CI 0.28-0.99). CONCLUSIONS: Patient experiences with virtual care were generally positive, but provider experiences were less so. Findings suggest potential differences in patient experience by ethnicity, warranting further investigation into equity concerns with virtual care.

Operationalizing and Evaluating Synchronous Virtual Group Health Interventions: Wide-Scale Implementation at a Tertiary Care Academic Hospital.

Group-based health interventions are an important component of health promotion and management. To provide continuity of care throughout the COVID-19 pandemic, our institution undertook a rapid pivot to delivering group-based health interventions via a videoconferencing service which was securely embedded into both the electronic medical record and the patient portal to sustainably address immediate health service delivery needs during the pandemic and beyond. In this paper, we (1) describe the institutionally driven operationalization of a system to provide integrated synchronous video group visits across our hospital and (2) present a proposed strategy to comprehensively evaluate outcomes regarding their implementation, quality, and impact. Lessons for other institutions and the potential future role of synchronous video group visits to enhance how care can be scaled for delivery are discussed.

Pandemic Preparedness and Beyond: Person-Centred Care for Older Adults Living in Long-Term Care during the COVID-19 Pandemic.

The increasing complexity of residents' needs, emphasis on social distancing and limited access to high-quality support presented challenges to patient-centred care during the pandemic. Yet the pandemic created an opportunity to explore novel approaches to achieving person-centred care within long-term care (LTC). We share three projects designed to enhance care delivery in the context of the pandemic: to address personhood needs during outbreaks, to improve the quality of medical care and to deliver personalized palliative and end-of-life care using a prediction algorithm. These projects enabled better care during the pandemic and will continue to advance person-centred care beyond the pandemic.

Building Health Services in a Rapidly Changing Landscape: Lessons in Adaptive Leadership and Pivots in a COVID-19 Remote Monitoring Program.

Adaptive leadership has become an essential skill for leaders in health systems to respond to the COVID-19 pandemic as new knowledge emerges and case counts rise, fall, and rise again. This leadership approach has been described as an iterative process of taking a wide view of the situation, interpreting the meaning of incoming data from multiple directions, and taking real-time action. This process is also common in start-ups, which attempt to create new products or services of uncertain value for consumer markets that may not yet exist. Start-ups manage uncertainty through "pivots," which can include changes in the target group, need, features, or intended benefit of a product or service. Pivots are large changes that account for the high likelihood of getting something wrong during development, and they are distinct from the "tweaks" or small tests of change that define quality improvement methodology. This case study describes three pivots in the launch of a remote monitoring program for COVID-19. Adaptive leadership helped inform strategic decisions, with pivots providing a framework for internal and external stakeholders to articulate options for changes to address shifting needs. There is considerable uncertainty in the appropriate design and implementation of health services, and although this case example focuses on the use of adaptive leadership and pivots during a pandemic, these strategies are relevant for health care leaders at any time.

Correction: Building Health Services in a Rapidly Changing Landscape: Lessons in Adaptive Leadership and Pivots in a COVID-19 Remote Monitoring Program.

[This corrects the article DOI: 10.2196/25507.].

Impact of a transition program with navigator on loss to follow-up, medication adherence, and appointment attendance in hemoglobinopathies.

BACKGROUND: Transition from pediatric to adult care is a period of high risk for loss to follow-up, morbidity, and mortality in adolescents and young adults (AYA) with hemoglobinopathies. The purpose of this study was to determine whether a transition program with transition navigator (TN) reduced loss to follow-up and hospitalizations and improved medication adherence and appointment attendance compared with an unstructured transfer. PROCEDURE: A retrospective observational study compared all AYA with hemoglobinopathies who turned 18 one year prior to (n = 51) and one year after (n = 61) the initiation of the transition program. Data from one year prior to last pediatric appointment and one year following first adult appointment were collected from each patient. RESULTS: The transition program with TN reduced loss to follow-up from 29% to 7% (P = 0.034). A greater proportion of patients in the transition cohort maintained or improved adherence to hydroxyurea or iron chelation to ≥4 days/week; exposure to the program was independently associated with such improvement (P = 0.047). A trend toward improvement or maintenance of ≥90% attendance to appointments was observed (P = 0.096). Frequency of hospitalization was not significantly different between the two cohorts (P = 0.985). CONCLUSIONS: A transition program with TN significantly reduced loss to follow-up, and significantly improved and maintained fair to good medication adherence. Further analysis of economic benefit and patient satisfaction will be conducted.

Extending access to a web-based mental health intervention: who wants more, what happens to use over time, and is it helpful? Results of a concealed, randomized controlled extension study.

BACKGROUND: Web-based mental health applications may be beneficial, but adoption is often low leaving optimal implementation and payment models unclear. This study examined which users were interested in extended access to a web-based application beyond an initial 3-month trial period and evaluated if an additional 3 months of access was beneficial. METHODS: This study was a concealed extension of a multi-center, pragmatic randomized controlled trial that assessed the benefit of 3 months of access to the Big White Wall (BWW), an anonymous web-based moderated, multi-component mental health application offering self-directed activities and peer support. Trial participants were 16 years of age or older, recruited from hospital-affiliated mental health programs. Participants who received access to the intervention in the main trial and completed 3-month outcome assessments were offered participation. We compared those who were and were not interested in an extension of the intervention, and re-randomized consenting participants 1:1 to receive extended access or not over the subsequent 3 months. Use of the intervention was monitored in the extension group and outcomes were measured at 3 months after re-randomization in both groups. The primary outcome was mental health recovery as assessed by total score on the Recovery Assessment Scale (RAS-r), as in the main trial. Linear mixed models were used to examine the time by group interaction to assess for differences in responses over the 3-month extension study. RESULTS: Of 233 main trial participants who responded, 119 (51.1%) indicated an interest in receiving extended BWW access. Those who were interested had significantly higher baseline anxiety symptoms compared to those who were not interested. Of the 119, 112 were re-randomized (55 to extended access, 57 to discontinuation). Only 21 of the 55 extended access participants (38.2%) used the intervention during the extension period. Change in RAS-r scores over time was not significantly different between groups (time by group, F(1,77) = 1.02; P = .31). CONCLUSIONS: Only half of eligible participants were interested in extended access to the intervention with decreasing use over time, and no evidence of added benefit. These findings have implications for implementation and payment models for this type of web-based mental health intervention. TRIAL REGISTRATION: Clinicaltrials.gov NCT02896894 . Registered retrospectively on September 12, 2016.

Testing an audit and feedback-based intervention to improve glycemic control after transfer to adult diabetes care: protocol for a quasi-experimental pre-post design with a control group.

BACKGROUND: When young adults transfer from pediatric to adult diabetes care they are at risk for deterioration of glycemic control, putting them at an increased risk of developing both acute and chronic complications. Despite increased awareness of these risks, there are gaps in care delivery during this vulnerable time and variability in the implementation of recommended transition practice. Audit and feedback (AF) interventions have a positive but variable effect on implementation of best practices. An expert group identified specific suggestions for optimizing the effectiveness of AF interventions. We aim to test an AF-based intervention incorporating these specific suggestions to improve transition practices and glycemic control in the first year after transfer from pediatric to adult diabetes care. METHODS: This is a pragmatic quasi-experimental study; a series of three cohort studies (pre-implementation, early-implementation, and post-implementation) to compare the baseline adjusted hemoglobin A1c (HbA1c) in the 12 months after the final pediatric visit in five pediatric diabetes centres within the Ontario Pediatric Diabetes Network in Ontario, Canada. The intervention includes three components: 1) centre-level feedback reports compiling data from chart abstraction, linked provincial administrative datasets, and patient-reported experience measures; 2) webinars for facilitated conversations/coaching about the feedback; and 3) online repository of curated transition resources for providers. The primary outcome will be analyzed using a multivariable linear regression model. We will conduct a qualitative process evaluation to understand intervention fidelity and to provide insight into the mechanisms of action of our results. DISCUSSION: There is a need to develop an innovative system-level approach to improve outcomes and the quality of care for young adults with type 1 diabetes during the vulnerable time when they transfer to adult care. Our research team, a collaboration of health services, implementation science, and quality improvement researchers, are designing, implementing, and evaluating an AF-based intervention using recommendations about how to optimize effectiveness. This knowledge will be generalizable to other care networks that aim to deliver uniformly high-quality care in diverse care settings. TRIAL REGISTRATION: ClinicalTrials.gov NCT03781973. Registered 13 December 2018. Date of enrolment of the first participant to the trial: June 1, 2019.

A Web-Based Mental Health Platform for Individuals Seeking Specialized Mental Health Care Services: Multicenter Pragmatic Randomized Controlled Trial.

BACKGROUND: Web-based self-directed mental health applications are rapidly emerging to address health service gaps and unmet needs for information and support. OBJECTIVE: The aim of this study was to determine if a multicomponent, moderated Web-based mental health application could benefit individuals with mental health symptoms severe enough to warrant specialized mental health care. METHODS: A multicenter, pragmatic randomized controlled trial was conducted across several outpatient mental health programs affiliated with 3 hospital programs in Ontario, Canada. Individuals referred to or receiving treatment, aged 16 years or older, with access to the internet and an email address, and having the ability to navigate a Web-based mental health application were eligible. A total of 812 participants were randomized 2:1 to receive immediate (immediate treatment group, ITG) or delayed (delayed treatment group, DTG) access for 3 months to the Big White Wall (BWW), a multicomponent Web-based mental health intervention based in the United Kingdom and New Zealand. The primary outcome was the total score on the Recovery Assessment Scale, revised (RAS-r) which measures mental health recovery. Secondary outcomes were total scores on the Patient Health Questionnaire-9 item (PHQ-9), the Generalized Anxiety Disorder Questionnaire-7 item (GAD-7), the EuroQOL 5-dimension quality of life questionnaire (EQ-5D-5L), and the Community Integration Questionnaire. An exploratory analysis examined the association between actual BWW use (categorized into quartiles) and outcomes among study completers. RESULTS: Intervention participants achieved small, statistically significant increases in adjusted RAS-r score (4.97 points, 95% CI 2.90 to 7.05), and decreases in PHQ-9 score (-1.83 points, 95% CI -2.85 to -0.82) and GAD-7 score (-1.55 points, 95% CI -2.42 to -0.70). Follow-up was achieved for 55% (446/812) at 3 months, 48% (260/542) of ITG participants and 69% (186/270) of DTG participants. Only 58% (312/542) of ITG participants logged on more than once. Some higher BWW user groups had significantly greater improvements in PHQ-9 and GAD-7 relative to the lowest use group. CONCLUSIONS: The Web-based application may be beneficial; however, many participants did not engage in an ongoing way. This has implications for patient selection and engagement as well as delivery and funding structures for similar Web-based interventions. TRIAL REGISTRATION: ClinicalTrials.gov NCT02896894; https://clinicaltrials.gov/ct2/show/NCT02896894 (Archived by WebCite at http://www.webcitation.org/78LIpnuRO).

Engaging primary care physicians in care coordination for patients with complex medical conditions.

OBJECTIVE: To explore the dynamics of primary care physicians' (PCPs') engagement with the Seamless Care Optimizing the Patient Experience (SCOPE) project. DESIGN: Qualitative study using semistructured interviews. SETTING: Solo and small group primary care practices in urban Toronto, Ont. PARTICIPANTS: A total of 22 of the 29 SCOPE PCPs (75.8%) were interviewed 14 to 19 months after the initiation of SCOPE. METHODS: Qualitative semistructured interviews were conducted to examine influencing factors associated with PCPs' engagement in SCOPE. Transcripts were analyzed using a grounded theory-informed approach and key themes were identified. MAIN FINDINGS: The SCOPE project provided practical mechanisms through which PCPs could access information and connect with resources. Contextual and historical factors including strained relationships between hospital specialists and community PCPs and PCPs' feelings of responsibility, isolation, disconnection, and burnout influenced readiness to engage. Provision of clinically useful supports in a trusting, collaborative manner encouraged PCPs' engagement in newer, more collaborative ways of working. CONCLUSION: The SCOPE project provided an opportunity for PCPs to build meaningful relationships, reconnect to the broader health care system, and redefine their roles. For many PCPs, reestablishing connections reaffirmed their role in the system and enabled a more collaborative care model. Strategies for connecting community-based PCPs to the broader system need to consider contextual factors and the effects of new linkages and coordination on the identities and relationships of PCPs.

Developing a set of indicators to monitor quality in ambulatory diabetes care using a modified Delphi panel process.

OBJECTIVE: There is a large evidence to practice gap in diabetes care with limited performance assessments that capture the full spectrum of care delivery. Our study aimed to develop a set of ambulatory diabetes quality indicators across six domains (effectiveness, safety, patient-centered, timely, equitable and efficient) to provide a broad view of quality. DESIGN: A modified Delphi panel process was conducted. Phase I involved compiling a list of indicators through literature review and generation of patient and healthcare provider-derived indicators through interviews and surveys, respectively. Phase II involved panelists rating indicators using the Agency for Healthcare Research and Quality measure attributes on 9-point Likert scale, attending a face-to-face meeting followed by re-rating, and final ranking. SETTING: This study was conducted across five adult academic medical centers affiliated with the University of Toronto. PARTICIPANTS: A multi-disciplinary Delphi panel (n = 16) including patients was assembled. MAIN OUTCOME MEASURE: For indicator advancement for ranking, ≥75% of panelists' responses in the top tertile (between 7 and 9) with a median composite score of ≥7 was required. RESULTS: There were 202 indicators included in the Delphi panel process including 171 from a comprehensive literature review, 14 from patient interviews, and 17 from healthcare provider surveys. Following the first round, 40 indicators proceeded directly to ranking, while 162 indicators were re-rated and distilled down to 12 for ranking. In the final ranking round, the 52 indicators were reduced to 35 including 13 effective, 10 safe, 6 patient-centered, 1 equitable, 3 efficient and 2 timely indicators. CONCLUSION: Thirty-five selected indicators developed with broad stakeholder engagement can be used to monitor quality in diabetes care.

Communicating wisely: teaching residents to communicate effectively with patients and caregivers about unnecessary tests.

BACKGROUND: With rising healthcare costs and a focus on quality, there is a growing need to promote resource stewardship in medical education. Physicians need to be able to communicate effectively with patients/caregivers seeking tests and treatments that are unnecessary. This study aimed to evaluate the impact of an interactive workshop on residents' knowledge of resource stewardship and communication skills when counseling patients/caregivers about requests for unnecessary testing. METHODS: Participants were 83 Internal Medicine and Pediatrics residents at the University of Toronto in 2014-15. The evaluation compared resource stewardship knowledge and communication skills of 57 (69%) residents that attended the resource stewardship workshop to 26 residents (31%) who did not. Knowledge and communication skills assessment consisted of a written test and a structured assessment using standardized patient raters, respectively. A linear regression was applied to determine predictors of overall communication skills performance. RESULTS: Workshop attendance resulted in better performance on the knowledge test (4.3 ± 1.9 vs. 3.1 ± 1.7 out of 8, p = 0.01), but not better performance on the communication skills assessment (4.1 ± 0.8 vs. 4.0 ± 0.9 out of 5, p = 0.56). Higher training level (p = 0.01) and knowledge test scores (p = 0.046) were independent predictors of better overall communication skills, after adjusting for gender, training level, workshop attendance, knowledge and self-reported prior feedback on communication skills. CONCLUSIONS: An interactive workshop can improve knowledge of resource stewardship, but improving communication skills with patients/caregivers about unnecessary testing may require additional training or reinforcement in the clinical learning environment. These teaching and assessment approaches can support the integration of education on resource stewardship into medical education.

A pragmatic randomized control trial and realist evaluation on the implementation and effectiveness of an internet application to support self-management among individuals seeking specialized mental health care: a study protocol.

BACKGROUND: Mental illness is a substantial and rising contributor to the global burden of disease. Access to and utilization of mental health care, however, is limited by structural barriers such as specialist availability, time, out-of-pocket costs, and attitudinal barriers including stigma. Innovative solutions like virtual care are rapidly entering the health care domain. The advancement and adoption of virtual care for mental health, however, often occurs in the absence of rigorous evaluation and adequate planning for sustainability and spread. METHODS: A pragmatic randomized controlled trial with a nested comparative effectiveness arm, and concurrent realist process evaluation to examine acceptability, effectiveness, and cost-effectiveness of the Big White Wall (BWW) online platform for mental health self-management and peer support among individuals aged 16 and older who are accessing mental health services in Ontario, Canada. Participants will be randomized to 3 months of BWW or treatment as usual. At the end of the 3 months, participants in the intervention group will have the opportunity to opt-in to an intervention extension arm. Those who opt-in will be randomized to receive an additional 3 months of BWW or no additional intervention. The primary outcome is recovery at 3 months as measured by the Recovery Assessment Scale-revised (RAS-r). Secondary outcomes include symptoms of depression and anxiety measured with the Personal Health Questionnaire-9 item (PHQ-9) and the Generalized Anxiety Disorder Questionnaire-7 item (GAD-7) respectively, quality of life measured with the EQ-5D-5L, and community integration assessed with the Community Integration Questionnaire. Cost-effectiveness evaluations will account for the cost of the intervention and direct health care costs. Qualitative interviews with participants and stakeholders will be conducted throughout. DISCUSSION: Understanding the impact of virtual strategies, such as BWW, on patient outcomes and experience, and health system costs is essential for informing whether and how health system decision-makers can support these strategies system-wide. This requires clear evidence of effectiveness and an understanding of how the intervention works, for whom, and under what circumstances. This study will produce such effectiveness data for BWW, while simultaneously exploring the characteristics and experiences of users for whom this and similar online interventions could be helpful. TRIAL REGISTRATION: Clinicaltrials.gov NCT02896894 . Registered on 31 August 2016 (retrospectively registered).

Triple Aim in Canada: developing capacity to lead to better health, care and cost.

QUALITY PROBLEM: Many modern health systems strive for 'Triple Aim' (TA)-better health for populations, improved experience of care for patients and lower costs of the system, but note challenges in implementation. Outcomes of applying TA as a quality improvement framework (QI) have started to be realized with early lessons as to why some systems make progress while others do not. INITIAL ASSESSMENT: Limited evidence is available as to how organizations create the capacity and infrastructure required to design, implement, evaluate and sustain TA systems. CHOICE OF SOLUTION: To support embedding TA across Canada, the Canadian Foundation for Healthcare Improvement supported enrolment of nine Canadian teams to participate in the Institute for Healthcare Improvement's TA Improvement Community. IMPLEMENTATION: Structured support for TA design, implementation, evaluation and sustainability was addressed in a collaborative programme of webinars and action periods. Teams were coached to undertake and test small-scale improvements before attempting to scale. EVALUATION: A summative evaluation of the Canadian cohort was undertaken to assess site progress in building TA infrastructure across various healthcare settings. The evaluation explored the process of change, experiences and challenges and strategies for continuous QI. LESSONS LEARNED: Delivering TA requires a sustained and coordinated effort supported by strong leadership and governance, continuous QI, engaged interdisciplinary teams and partnering within and beyond the healthcare sector.

A randomized wait-list control trial to evaluate the impact of a mobile application to improve self-management of individuals with type 2 diabetes: a study protocol.

BACKGROUND: Management of diabetes through improved glycemic control and risk factor modification can help prevent long-term complications. Much diabetes management is self-management, in which healthcare providers play a supporting role. Well-designed e-Health solutions targeting behavior change can improve a range of measures, including glycemic control, perceived health, and a reduction in hospitalizations. METHODS: The primary objective of this study is to evaluate if a mobile application designed to improve self-management among patients with type 2 diabetes (T2DM) improves glycemic control compared to usual care. The secondary objectives are to determine the effects on patient experience and health system costs; evaluate how and why the intervention worked as observed; and gain insight into considerations for system-wide scale-up. This pragmatic, randomized, wait-list-control trial will recruit adult participants from three Diabetes Education Programs in Ontario, Canada. The primary outcome is glycemic control (measured by HbA1c). Secondary outcomes include patient-reported outcomes and patient-reported experience measures, health system utilization, and intervention usability. The primary outcome will be analyzed using an ANCOVA, with continuous secondary outcomes analyzed using Poisson regression. Direct observations will be conducted of the implementation and application-specific training sessions provided to each site. Semi-structured interviews will be conducted with participants, healthcare providers, organizational leaders, and system stakeholders as part of the embedded process evaluation. Thematic analysis will be applied to the qualitative data in order to describe the relationships between (a) key contextual factors, (b) the mechanisms by which they effect the implementation of the intervention, and (c) the impact on the outcomes of the intervention, according to the principles of Realist Evaluation. DISCUSSION: The use of mobile health and virtual tools is on the rise in health care, but the evidence of their effectiveness is mixed and their evaluation is often lacking key contextual data. Results from this study will provide much needed information about the clinical and cost-effectiveness of a mobile application to improve diabetes self-management. The process evaluation will provide valuable insight into the contextual factors that influence the application effectiveness, which will inform the potential for adoption and scale. TRIAL REGISTRATION: Clinicaltrials.gov NCT02813343 . Registered on 24 June 2016 (retrospectively registered). Trial Sponsor: Ontario Telemedicine Network.

Quality measures of virtual care in ambulatory healthcare environments: a scoping review.

OBJECTIVES: Delivery of virtual care increased throughout the COVID-19 pandemic and persisted after physical distancing measures ended. However, little is known about how to measure the quality of virtual care, as current measures focus on in-person care and may not apply to a virtual context. This scoping review aims to understand the connections between virtual care modalities used with ambulatory patient populations and quality measures across the Quintuple Aim (provider experience, patient experience, per capita cost, population health and health equity). DESIGN: Virtual care was considered any interaction between patients and/or their circle of care occurring remotely using any form of information technology. Five databases (MEDLINE, Embase, PsycInfo, Cochrane Library, JBI) and grey literature sources (11 websites, 3 search engines) were searched from 2015 to June 2021 and again in August 2022 for publications that analysed virtual care in ambulatory settings. Indicators were extracted, double-coded into the Quintuple Aim framework; patient and provider experience indicators were further categorised based on the National Academy of Medicine quality framework (safety, effectiveness, patient-centredness, timeliness, efficiency and equity). Sustainability was added to capture the potential for continued use of virtual care. RESULTS: 13 504 citations were double-screened resulting in 631 full-text articles, 66 of which were included. Common modalities included video or audio visits (n=43), remote monitoring (n=11) and mobile applications (n=11). The most common quality indicators were related to patient experience (n=58 articles), followed by provider experience (n=25 articles), population health outcomes (n=23 articles) and health system costs (n=19 articles). CONCLUSIONS: The connections between virtual care modalities and quality domains identified here can inform clinicians, administrators and other decision-makers how to monitor the quality of virtual care and provide insights into gaps in current quality measures. The next steps include the development of a balanced scorecard of virtual care quality indicators for ambulatory settings to inform quality improvement.