Interventions to improve cancer survivorship among Indigenous Peoples and communities: a systematic review with a narrative synthesis.

PURPOSE: The purpose of this systematic review is to synthesize the evidence on the types of interventions that have been utilized by Indigenous Peoples living with cancer, and report on their relevance to Indigenous communities and how they align with holistic wellness. METHODS: A systematic review with narrative synthesis was conducted. RESULTS: The search yielded 7995 unique records; 27 studies evaluating 20 interventions were included. The majority of studies were conducted in USA, with five in Australia and one in Peru. Study designs were cross-sectional (n=13); qualitative (n=5); mixed methods (n=4); experimental (n=3); and quasi-experimental (n=2). Relevance to participating Indigenous communities was rated moderate to low. Interventions were diverse in aims, ingredients, and outcomes. Aims involved (1) supporting the healthcare journey, (2) increasing knowledge, (3) providing psychosocial support, and (4) promoting dialogue about cancer. The main ingredients of the interventions were community meetings, patient navigation, arts, and printed/online/audio materials. Participants were predominately female. Eighty-nine percent of studies showed positive influences on the outcomes evaluated. No studies addressed all four dimensions of holistic wellness (physical, mental, social, and spiritual) that are central to Indigenous health in many communities. CONCLUSION: Studies we found represented a small number of Indigenous Nations and Peoples and did not meet relevance standards in their reporting of engagement with Indigenous communities. To improve the cancer survivorship journey, we need interventions that are relevant, culturally safe and effective, and honoring the diverse conceptualizations of health and wellness among Indigenous Peoples around the world.

Patient Perspectives on Managing Type 1 Diabetes During High-Performance Exercise: What Resources Do They Want?

OBJECTIVE: Athletes with type 1 diabetes face unique challenges that make it difficult for health care providers to offer concise recommendations for diabetes management. Moreover, little is known about patient preferences for diabetes management during high-level and competitive exercise. We undertook a qualitative study to understand patient perspectives on managing type 1 diabetes during exercise. METHODS: A qualitative design using focus groups was selected. Samples of 5-10 participants per group were recruited to participate in one of three 1.5-hour sessions focusing on experiences in managing diabetes, supports, and desired resources. Sessions were audiotaped and transcribed verbatim. Data were analyzed iteratively among team members. RESULTS: The study included 21 participants (10 male and 11 female) with a mean age of 41 years. Most participants used trial and error to manage their blood glucose around exercise. Frequent monitoring of blood glucose was a common strategy and a challenge during exercise. Hypoglycemia after exercise and adrenaline-fueled hyperglycemia during exercise were the most prevalent concerns. Most participants relied on themselves, an endocrinologist, or the Internet for support but said they would prefer to rely more on peers with type 1 diabetes and mobile apps. Peer support or mentorship was strongly supported with recommendations for moving forward. CONCLUSION: This study highlights the individualized nature of balancing glycemic control in athletes and athletes' heavy self-reliance to develop strategies. Expanding the availability of resources such as peer mentoring and mobile apps could potentially support athletes with type 1 diabetes.

Experiences of practice facilitators working on the Improved Delivery of Cardiovascular Care project: Retrospective case study.

OBJECTIVE: To examine the barriers to and facilitators of practice facilitation experienced by participants in the Improving Delivery of Cardiovascular Care (IDOCC) project. DESIGN: Case studies of practice facilitators' narrative reports. SETTING: Eastern Ontario. PARTICIPANTS: Primary care practices that participated in the IDOCC project. MAIN OUTCOME MEASURES: Cases were identified by calculating sum scores in order to determine practices' performance relative to their peers. Two case exemplars were selected that scored within ± 1 SD of the total mean score, and a qualitative analysis of practice facilitators' narrative reports was conducted using a 5-factor implementation framework to identify barriers and facilitators. Narratives were divided into 3 phases: planning, implementation, and sustainability. RESULTS: Barriers and facilitators fluctuated over the intervention's 3 phases. Site A reported more barriers (n = 47) than facilitators (n = 38), while site B reported a roughly equal number of barriers (n = 144) and facilitators (n = 136). In both sites, the most common barriers involved organizational and provider factors and the most common facilitators were associated with innovation and structural factors. CONCLUSION: Both practices encountered various barriers and facilitators throughout the IDOCC's 3 phases. The case studies reveal the complex interactions of these factors over time, and provide insight into the implementation of practice facilitation programs.

Honoring Indigenous culture-as-intervention: Development and validity of the Native Wellness AssessmentTM.

There is a need for Indigenous-centered research to appraise culture's role in wellness. Researchers described the development and validity of the Native Wellness Assessment (NWATM). The NWA has culture-as-intervention at its apex. Wellness, culture, and cultural intervention practices (CIPs) are explored from an Indigenous perspective. Indigenous clients completed matching self-report and observer versions of the NWA at three time points during addictions treatment. Statistically and psychometrically, the NWA content and structure performed well, demonstrating that culture is an effective and fair intervention for Indigenous peoples with addictions. The NWA can inform Indigenous health and community-based programs and policy.

Cultural competence and cultural safety in Canadian schools of nursing: a mixed methods study.

Cultural competence and cultural safety are essential knowledge in contemporary nursing care. Using a three-phase, mixed methods sequential triangulation design, this study examines the extent to which Anglophone Schools of Nursing in Canada have integrated cultural competence and/or cultural safety into the undergraduate nursing curricula. Factors that influence successful integration are identified through the lens of Donabedian's structure, process, and outcome model. Results suggest that several facilitating factors are present, such as leadership, partnerships and linkages, and educational supports for students. Of particular concern is the lack of policies to recruit and retain Aboriginal faculty, financial resources, and outcome evaluation indicators. A conceptual model of integration is offered to explain how Schools of Nursing function to support the implementation of these concepts into their curriculum. This study provides theoretical and practical implications for initiation and improvement of cultural competence and/or cultural safety integration strategies in Schools of Nursing.

The patient's voice: an exploratory study of the impact of a group self-management support program.

BACKGROUND: Given the potential value of self-management support programs for people with chronic diseases, it is vital to understand how they influence participants' health attitudes and behaviours. The Stanford Chronic Disease Self-Management Program (CDSMP), the most well-known and widely studied such program, is funded in many provinces and jurisdictions throughout Canada. However, there is little published evidence on its impact in the Canadian health-care system. We studied participants' reactions and perceived impacts of attending the Stanford program in one Ontario health region so we could assess its value to the health region. The study asked: What are participants' reactions and perceived impacts of attending the Stanford CDSMP? METHODS: This mixed methods exploratory study held four focus groups approximately one year after participants attended a Stanford program workshop. At the beginning of each session, participants filled out a survey on the type and frequency of community and health resources used for their self-management. During the sessions, a moderator guided the discussion, asking about such things as long-term impact of the program on their lives and barriers to self-management of their chronic conditions. RESULTS: Participants perceived diverse effects of the workshop: from having a profound impact on one area to affecting all aspects of their lives. A change in physical activity patterns was the most prominent behaviour change, noted by over half the participants. Other recurrent effects included an improved sense of social connection and better coping skills. Barriers to self-management were experienced by almost all participants with several dominant themes emerging including problems with the health system and patient-physician interaction. Participants reported a wide variety of resources used in their self-management, and in some cases, an increase in use was noted for some resources. CONCLUSIONS: Self-management support is, at its core, a complex and patient-centred concept, so a diversity of outcomes to match the diversity of participants should be expected. As these interventions move into different target populations and communities, it is essential that we continue to explore through multiple research methods, the effects, and their meaning to participants, ensuring the optimal investment of resources for the very individuals these interventions aim to serve.

Understanding whole systems change in health care: the case of nurse practitioners in Canada.

Nurse practitioners (NPs) were introduced into the Canadian health system almost half a century ago. Despite early evidence of their effectiveness, it took decades to establish a substantial critical mass of NPs. Using the NP as a case study exemplar, we adopted a whole system change perspective to understand what else besides evidence was needed to ensure the success of desirable health systems innovations. We identified elements of whole systems change to analyze literature on the NP movement in terms of leverages, blockages, and system dynamics. Results suggest that evidence was only one of many factors shaping the uptake of NP services as part of larger, ongoing, adaptive whole systems change. The changes required to integrate the NP role within the health system reflect a socio-ecological perspective that may be used to understand sustainable health systems innovation and improvement.

A rapid evidence-based service by librarians provided information to answer primary care clinical questions.

BACKGROUND: A librarian consultation service was offered to 88 primary care clinicians during office hours. This included a streamlined evidence-based process to answer questions in fewer than 20 min. This included a contact centre accessed through a Web-based platform and using hand-held devices and computers with Web access. Librarians were given technical training in evidence-based medicine, including how to summarise evidence. OBJECTIVES: To describe the process and lessons learned from developing and operating a rapid response librarian consultation service for primary care clinicians. METHODS: Evaluation included librarian interviews and a clinician exit satisfaction survey. RESULTS: Clinicians were positive about its impact on their clinical practice and decision making. The project revealed some important 'lessons learned' in the clinical use of hand-held devices, knowledge translation and training for clinicians and librarians. CONCLUSIONS: The Just-in-Time Librarian Consultation Service showed that it was possible to provide evidence-based answers to clinical questions in 15 min or less. The project overcame a number of barriers using innovative solutions. There are many opportunities to build on this experience for future joint projects of librarians and healthcare providers.

The role of nursing best practice champions in diffusing practice guidelines: a mixed methods study.

BACKGROUND: While the importance of nursing best practice champions has been widely promoted in the diffusion of evidence-based practice, there has been little research about their role. By learning more about what champions do in guideline diffusion, the nursing profession can more proactively manage and facilitate the role of champions while capitalizing on their potential to be effective leaders of the health care system. AIM: To determine how nursing best practice champions influence the diffusion of Best Practice Guideline recommendations. METHODS: A mixed method sequential triangulation design was used involving two phases: (1) key informant interviews with 23 champions between February and July 2006 and (2) a survey of champions (N= 191) and administrators (N= 41) from September to October 2007. Qualitative findings informed the development of surveys and were used in interpreting quantitative information collected in phase 2. RESULTS: Most interview and survey participants were female, employed full-time, and had worked in practice for over 20 years. Qualitative and quantitative findings suggest that champions influence the use of Best Practice Guideline recommendations most readily through: (1) dissemination of information about clinical practice guidelines, specifically through education and mentoring; (2) being persuasive practice leaders at interdisciplinary committees; and (3) tailoring the guideline implementation strategies to the organizational context. CONCLUSIONS AND IMPLICATIONS: Our research suggests that nursing best practice champions have a multidimensional role that is well suited to navigating the complexities of a dynamic health system to create positive change. Understanding of this role can help service organizations and the nursing profession more fully capitalize on the potential of champions to influence and implement evidence-based practices to advance positive patient, organizational, and system outcomes.

Transition from specialist to primary diabetes care: a qualitative study of perspectives of primary care physicians.

BACKGROUND: The growing prevalence of diabetes and heightened awareness of the benefits of early and intensive disease management have increased service demands and expectations not only of primary care physicians but also of diabetes specialists. While research has addressed issues related to referral into specialist care, much less has been published about the transition from diabetes specialists back to primary care. Understanding the concerns of family physicians related to discharge of diabetes care from specialist centers can support the development of strategies that facilitate this transition and result in broader access to limited specialist services. This study was undertaken to explore primary care physician (PCP) perspectives and concerns related to reassuming responsibility for diabetes care after referral to a specialized diabetes center. METHODS: Qualitative data were collected through three focus groups. Sessions were audio-taped and transcribed verbatim. Data were coded and sorted with themes identified using a constant comparison method. The study was undertaken through the regional academic referral center for adult diabetes care in Ottawa, Canada. Participants included 22 primary care physicians representing a variety of referral frequencies, practice types and settings. RESULTS: Participants described facilitators and barriers to successful transition of diabetes care at the provider, patient and systems level. Major facilitators included clear communication of a detailed, structured plan of care, ongoing access to specialist services for advice or re-referral, continuing education and mentoring for PCPs. Identified provider barriers were gaps in PCP knowledge and confidence related to diabetes treatment, excessive workload and competing time demands. Systems deterrents included reimbursement policies for health professionals and inadequate funding for diabetes medications and supplies. At the PCP-patient interface, insufficient patient confidence or trust in PCP's ability to manage diabetes, poor motivation and "non-compliance" emerged as potential patient barriers to transition. Incongruence between PCP attitudes and expectations related to diabetes self-management and those of patients who had attended a multidisciplinary specialist center was also observed. CONCLUSION: This study underlines the breadth of PCP concerns related to transition of diabetes care and the importance of this topic to them. While tools that promote timely information flow and care planning are cornerstones to successful transition, and may be sufficient for some practitioners, appropriately resourced decision support and education strategies should also be available to enhance PCP capacity and readiness to resume diabetes care after referral to a specialist center. Characteristics of the patient-care provider relationship that impact discharge were identified and are worthy of further research.

Improved Delivery of Cardiovascular Care (IDOCC): Findings from Narrative Reports by Practice Facilitators.

Practice facilitation can help family physicians adopt evidence-based guidelines. However, many practices struggle to effectively implement practice changes that result in meaningful improvement. Building on our previous research, we examined the barriers to and enablers of implementation perceived by practice facilitators (PF) in helping practices to adopt the Improved Delivery of Cardiovascular Care (IDOCC) program, which took place at 84 primary care practices in Ottawa, Canada between April 2008 and March 2012. We conducted a qualitative analysis of PFs' narrative reports using a multiple case study design. We used a combined purposeful sampling approach to identify cases that 1) reflected experiences typical of the broader sample and 2) presented sufficient breadth of experience from each project step and family practice model. Sampling continued until data saturation was reached. Team members conducted a qualitative analysis of reports using an open and axial coding style and a constant comparative approach. Barriers and enablers were divided into five constructs: structural, organizational, provider, patient, and innovation. Narratives from 13 practice sites were reviewed. A total of 8 barriers and 11 enablers were consistently identified across practices. Barriers were most commonly reported at the organizational (n = 3) and structural level, (n = 2) while enablers were most common at the innovation level (n = 6). While physicians responded positively to PFs' presence and largely supported their recommendations for practice change, organizational and structural aspects such as lack of time, minimal staff engagement, and provider reimbursement remained too great for practices to successfully implement practice-level changes. Trial Registration: ClinicalTrials.gov, NCT00574808.

Family physicians' reactions to performance assessment feedback.

OBJECTIVE: To explore and describe family physicians' personal and professional responses to performance assessment feedback. DESIGN: Qualitative study using one-on-one semistructured interviews after feedback on performance. SETTING: Fee-for-service family practices in eastern Ontario. PARTICIPANTS: Eight physicians out of 25 physicians in the control group of a previous randomized controlled trial who received performance assessment feedback were purposefully selected using maximum variation sampling to represent various levels of performance. Five female physicians (2 part-time and 3 full-time) and 3 male physicians (all full-time) were interviewed. These physicians had practised family medicine for an average of 18.5 years (range 9 to 32 years). METHOD: Semistructured one-on-one interviews were conducted to determine what physicians thought and felt about their private feedback sessions and to solicit their opinions on performance assessment in general. Information was analyzed using an open coding style and a constant comparative method of analysis. MAIN FINDINGS: Two major findings were central to the core elements of medical professionalism and perceived accountability. Physicians indicated that the private feedback they received was a valuable and necessary part of medical professionalism; however, they were reluctant to share this feedback with patients. Physicians described various layers of accountability from the most important inner layer, patients, to the least important outer layer, those funding the system. CONCLUSION: Performance feedback was viewed as important to family physicians for maintaining medical professionalism and accountability.

Models of primary care service delivery in Ontario: why such diversity?

A surprisingly large and ever-growing number of alternative models of primary care service delivery have been developed in Ontario. The models are relatively poorly understood, and it is unclear why there are so many of them. What needs of providers and of government as payer are they attempting to address? Through a literature review and interviews with key informants, we sought to explain why there are so many models.

Research as Cultural Renewal: Applying Two-Eyed Seeing in a Research Project about Cultural Interventions in First Nations Addictions Treatment.

This article explores the application of two-eyed seeing in the first year of a three-year study about the effectiveness of cultural interventions in First Nations alcohol and drug treatment in Canada. Two-eyed seeing is recognized by Canada's major health research funder as a starting point for bringing together the strengths of Indigenous and Western ways of knowing. With the aim of developing a culture-based measurement tool, our team carried out an Indigenous-centred research process with our interpretation of two-eyed seeing as a guiding principle. This enabled us to engage in a decolonizing project that prioritized Indigenous methodologies and ways of knowing and knowledge alongside those of Western science. By concentrating on Indigenous governance in the research process, our project supported efforts at Indigenous cultural renewal. Two illustrations are offered, our team's reconceptualization of Western derived understandings of data collection through Indigenous storytelling and our research grant timeframe with Indigenous knowledge gardening. This article contributes to the Indigenous research and policy literature which is lacking documentation about how Indigenous communities and research teams are benefitting from two-eyed seeing.

A scoping study of cultural interventions to treat addictions in Indigenous populations: methods, strategies and insights from a Two-Eyed Seeing approach.

BACKGROUND: This paper describes the methods, strategies and insights gained from a scoping study using a "Two-Eyed Seeing" approach. An evolving technique, Two-Eyed Seeing respects and integrates the strengths of Indigenous knowledge and Western sciences, often "weaving back and forth" between the two worldviews. The scoping study was used to inform a tool for measuring the impact of culturally based addictions treatment services on wellness in Indigenous populations. It formed part of a three-year study, Honouring Our Strengths: Indigenous Culture as Intervention in Addictions Treatment. The scoping study identified and mapped literature on cultural interventions in addictions treatment, and described the nature, extent and gaps in literature. METHODS: Using a Two-Eyed Seeing approach, we adapted, applied and enhanced a common framework of scoping studies. In the end stage of the scoping review process, an Ad Hoc Review Group, led by our project Elder, reviewed and interpreted Indigenous and Western understandings within the mapped information. Elements of the scoping study were joined with results from community focus groups with staff at treatment centres. RESULTS: Two-Eyed Seeing contributed differently at each stage of the scoping study. In early stages, it clarified team expertise and potential contributions. At the mid-point, it influenced our shift from a systematic to a scoping review. Near the end, it incorporated Western and Indigenous knowledge to interpret and synthesize evidence from multiple sources. CONCLUSIONS: This paper adds to the collective work on augmenting the methodology of scoping studies. Despite the challenges of a Two-Eyed Seeing approach, it enables researchers using scoping studies to develop knowledge that is better able to translate into meaningful findings for Indigenous communities.

Upholding the principles of primary care in preceptors' practices.

BACKGROUND AND OBJECTIVES: Family medicine preceptorships are crucial to educating future physicians, but there is a lack of research on how well preceptors are following the principles of primary care. This study used the Primary Care Assessment Tool (PCAT)-Provider Edition to determine how well medical preceptors provide quality medical care. METHODS: A total of 134 family medicine preceptors in the Maritime provinces of Canada answered questions about their practice behaviors, along with background information about themselves, their practice, and their practice population. RESULTS: The highest scores were for "coordination: integration of care," and the lowest were for "cultural competence." PCAT scores improved with the number of patients seen weekly. Scores for first contact accessibility were higher for females and for those with 11-20 years experience as a preceptor, who saw more patients weekly, and in urban centers. "Longitudinality: relationship" scores were higher among those with at least 11 years of practice experience and who saw more patients weekly. "Community orientation" scores were higher for preceptors who saw more patients weekly and accepted new patients. "Cultural competence" scores were higher for preceptors with a culturally diverse practice population and who accepted new patients. "Coordination: integration of care" scores were higher among rural practices. "Coordination: medical records continuity" scores were higher in practices with less than 5 years' experience. CONCLUSIONS: Maritime preceptors report providing quality primary care, and the PCAT can be used to benchmark the quality of primary care provided by preceptors.

Patient perspectives on discharge from specialist type 2 diabetes care back to primary care: a qualitative study.

BACKGROUND: Timely access to specialist care remains a barrier for both patients with type 2 diabetes and their primary care physicians. To improve access to specialists for new patients, an efficient and appropriate discharge process is required. Consideration of patient perspectives is central to developing a smooth care transition, and currently, research in this area is limited. The aim of this study was to explore patients' expectations and experiences surrounding discharge from a specialized diabetes centre back to primary care. METHODS: A qualitative approach was used involving data from one-to-one semistructured interviews. Participants were 12 patients with type 2 diabetes who had been discharged from the Tertiary Care Diabetes Referral Centre in Ottawa, Canada. RESULTS: Participants were uncertain in their initial expectations of specialist care duration. Patients expressed that an explicit discussion of the discharge process had not occurred, and many were unclear about the reason for discharge and plans for appropriate primary care physician follow up. Patients' psychological preparedness for discharge existed on a spectrum from low to high readiness. Many articulated a desire for improved communication surrounding the discharge plan, and some wished to have input into the discharge decision. Although most described their primary care physician positively, some expressed concern over cessation of specialist care. CONCLUSIONS: It is important to prepare patients for discharge from care, and to recognize that individual patients have varying needs and preferences. Further research is warranted to develop effective interventions for improving the discharge process for patients.

Cultural interventions to treat addictions in Indigenous populations: findings from a scoping study.

BACKGROUND: Cultural interventions offer the hope and promise of healing from addictions for Indigenous people.a However, there are few published studies specifically examining the type and impact of these interventions. Positioned within the Honouring Our Strengths: Culture as Intervention project, a scoping study was conducted to describe what is known about the characteristics of culture-based programs and to examine the outcomes collected and effects of these interventions on wellness. METHODS: This review followed established methods for scoping studies, including a final stage of consultation with stakeholders. The data search and extraction were also guided by the "PICO" (Patient/population, Intervention, Comparison, and Outcome) method, for which we defined each element, but did not require direct comparisons between treatment and control groups. Twelve databases from the scientific literature and 13 databases from the grey literature were searched up to October 26, 2012. RESULTS: The search strategy yielded 4,518 articles. Nineteen studies were included from the United States (58%) and Canada (42%), that involved residential programs (58%), and all (100%) integrated Western and culture-based treatment services. Seventeen types of cultural interventions were found, with sweat lodge ceremonies the most commonly (68%) enacted. Study samples ranged from 11 to 2,685 clients. Just over half of studies involved quasi-experimental designs (53%). Most articles (90%) measured physical wellness, with fewer (37%) examining spiritual health. Results show benefits in all areas of wellness, particularly by reducing or eliminating substance use problems in 74% of studies. CONCLUSIONS: Evidence from this scoping study suggests that the culture-based interventions used in addictions treatment for Indigenous people are beneficial to help improve client functioning in all areas of wellness. There is a need for well-designed studies to address the question of best relational or contextual fit of cultural practices given a particular place, time, and population group. Addiction researchers and treatment providers are encouraged to work together to make further inroads into expanding the study of culture-based interventions from multiple perspectives and locations.

Building access to specialist care through e-consultation.

BACKGROUND: Limited access to specialist care remains a major barrier to health care in Canada, affecting patients and primary care providers alike, in terms of both long wait times and inequitable availability. We developed an electronic consultation system, based on a secure web-based tool, as an alternative to face-to-face consultations, and ran a pilot study to evaluate its effectiveness and acceptability to practitioners. METHODS: In a pilot program conducted over 15 months starting in January 2010, the e-consultation system was tested with primary care providers and specialists in a large health region in Eastern Ontario, Canada. We collected utilization data from the electronic system itself (including quantitative data from satisfaction surveys) and qualitative information from focus groups and interviews with providers. RESULTS: Of 18 primary care providers in the pilot program, 13 participated in focus groups and 9 were interviewed; in addition, 10 of the 11 specialists in the program were interviewed. Results of our evaluation showed good uptake, high levels of satisfaction, improvement in the integration of referrals and consultations, and avoidance of unnecessary specialist visits. A total of 77 e-consultation requests were processed from 1 Jan. 2010 to 1 Apr. 2011. Less than 10% of the referrals required face-to-face follow-up. The most frequently noted benefits for patients (as perceived by providers) included improved access to specialist care and reduced wait times. Primary care providers valued the ability to assist with patient assessment and management by having access to a rapid response to clinical questions, clarifying the need for diagnostic tests or treatments, and confirming the need for a formal consultation. Specialists enjoyed the improved interaction with primary care providers, as well as having some control in the decision on which patients should be referred. INTERPRETATION: This low-cost referral system has potential for broader implementation, once payment models for physicians are adapted to cover e-consultation.

An innovative medical and dental hygiene clinic for street youth: results of a process evaluation.

Canada has a noteworthy reputation for high quality health care. Nonetheless, street youth are one of our most vulnerable yet underserved populations. Consequently, a medical and dental clinic was created in downtown Ottawa, Ontario to respond to their needs. The purpose of this study is to describe a process evaluation of the clinic during its first year of operation with a focus on program fidelity, dose, reach, and satisfaction. A mixed methods approach was used involving interviews with providers, focus groups with street youth, analysis of Electronic Medical Record (EMR) data, and supplemental information such as document reviews. The evaluation identified areas that were working well along with challenges to program implementation. Areas of concerns and possible solutions were presented to the management team that then helped to plan and make improvements to the clinic. Our evaluation design and working relationship with clinic management promoted the integration of real-time evidence into program improvements.