The development of a guideline implementability tool (GUIDE-IT): a qualitative study of family physician perspectives.

BACKGROUND: The potential of clinical practice guidelines has not been realized due to inconsistent adoption in clinical practice. Optimising intrinsic characteristics of guidelines (e.g., its wording and format) that are associated with uptake (as perceived by their end users) may have potential. Using findings from a realist review on guideline uptake and consultation with experts in guideline development, we designed a conceptual version of a future tool called Guideline Implementability Tool (GUIDE-IT). The tool will aim to involve family physicians in the guideline development process by providing a process to assess draft guideline recommendations. This feedback will then be given back to developers to consider when finalizing the recommendations. As guideline characteristics are best assessed by end-users, the objectives of the current study were to explore how family physicians perceive guideline implementability, and to determine what components should comprise the final GUIDE-IT prototype. METHODS: We conducted a qualitative study with family physicians in Toronto, Ontario. Two experienced investigators conducted one-hour interviews with family physicians using a semi-structured interview guide to 1) elicit feedback on perceptions on guideline implementability; 2) to generate a discussion in response to three draft recommendations; and 3) to provide feedback on the conceptual GUIDE-IT. Sessions were audio taped and transcribed verbatim. Data collection and analysis were guided by content analyses. RESULTS: 20 family physicians participated. They perceived guideline uptake according to facilitators and barriers across 6 categories of guideline implementability (format, content, language, usability, development, and the practice environment). Participants' feedback on 3 draft guideline recommendations were grouped according to guideline perception, cognition, and agreement. When asked to comment on GUIDE-IT, most respondents believed that the tool would be useful, but urged to involve "regular" or community family physicians in the process, and suggested that an online system would be the most efficient way to deliver it. CONCLUSIONS: Our study identified facilitators and barriers of guideline implementability from the perspective of community and academic family physicians that will be used to build our GUIDE-IT prototype. Our findings build on current knowledge by showing that family physicians perceive guideline uptake mostly according to factors that are in the control of guideline developers.

Premature return to play and return to learn after a sport-related concussion: physician's chart review.

OBJECTIVE: To determine what proportion of patients experience an exacerbation of their symptoms as a result of premature return to play (RTP) and return to learn (RTL) following sport-related concussions. DESIGN: Retrospective study of electronic medical records from the office-based practice of one family and sport medicine physician who had systematically provided recommendations for cognitive and physical rest based on existing consensus recommendations. Two blinded authors independently reviewed each chart, which included Sport Concussion Assessment Tool (SCAT) and SCAT2 symptom self-report forms to determine whether an athlete had returned to play or learn prematurely. If there was a discrepancy between the 2 reviewers then a third author reviewed the charts. SETTING: A sport medicine and family practice in Ontario. The physician assessed sport-related concussions after self-referral or referral from other primary care physicians, teams, and schools. PARTICIPANTS: A total of 170 charts of 159 patients were assessed for sport-related concussion during a 5-year period (April 2006 to March 2011). All participants were students who were participating in sports at the time of injury. There were 41 concussions in elementary students, 95 concussions in high school students, and 34 concussions in college or university students. MAIN OUTCOME MEASURES: Premature RTP and RTL were defined as chart records documenting the recurrence or worsening of symptoms that accompanied the patients' RTP or RTL. Measures were compared using the earliest available SCAT forms and self-reporting. RESULTS: In 43.5% of concussion cases, the patient returned to sport too soon and in 44.7% of concussion cases, the patient returned to school too soon. Patients with a history of previous concussion required more days of rest before being permitted to participate in any physical activity than those patients without a previous history of concussion. Elementary school students required fewer days of rest before being permitted to return to any physical activity compared with high school students and college or university students. CONCLUSION: Currently, physicians recommend restrictions on mental and physical activity following sport-related concussion. This is done without clear guidelines as to what cognitive rest entails for students. Further research is required to determine how to implement a management plan for student athletes to facilitate complete recovery after concussion.

Making sense of complex data: a mapping process for analyzing findings of a realist review on guideline implementability.

BACKGROUND: Realist reviews offer a rigorous method to analyze heterogeneous data emerging from multiple disciplines as a means to develop new concepts, understand the relationships between them, and identify the evidentiary base underpinning them. However, emerging synthesis methods such as the Realist Review are not well operationalized and may be difficult for the novice researcher to grasp. The objective of this paper is to describe the development of an analytic process to organize and synthesize data from a realist review. METHODS: Clinical practice guidelines have had an inconsistent and modest impact on clinical practice, which may in part be due to limitations in their design. This study illustrates the development of a transparent method for organizing and analyzing a complex data set informed by a Realist Review on guideline implementability to better understand the characteristics of guidelines that affect their uptake in practice (e.g., clarity, format). The data organization method consisted of 4 levels of refinement: 1) extraction and 2) organization of data; 3) creation of a conceptual map of guideline implementability; and 4) the development of a codebook of definitions. RESULTS: This new method is comprised of four steps: data extraction, data organization, development of a conceptual map, and operationalization vis-a-vis a codebook. Applying this method, we extracted 1736 guideline attributes from 278 articles into a consensus-based set of categories, and collapsed them into 5 core conceptual domains for our guideline implementability map: Language, Format, Rigor of development, Feasibility, Decision-making. CONCLUSIONS: This study advances analysis methods by offering a systematic approach to analyzing complex data sets where the goals are to condense, organize and identify relationships.

Format guidelines to make them vivid, intuitive, and visual: use simple formatting rules to optimize usability and accessibility of clinical practice guidelines.

AIM: We present simple formatting rules derived from an extensive literature review that can improve the format of clinical practice guidelines (CPGs), and potentially increase the likelihood of being used. METHODS: We recently conducted a review of the literature from medicine, psychology, design, and human factors engineering on characteristics of guidelines that are associated with their use in practice, covering both the creation and communication of content. The formatting rules described in this article are derived from that review. RESULTS: The formatting rules are grouped into three categories that can be easily applied to CPGs: first, Vivid: make it stand out; second, Intuitive: match it to the audience's expectations, and third, Visual: use alternatives to text. We highlight rules supported by our broad literature review and provide specific 'how to' recommendations for individuals and groups developing evidence-based materials for clinicians. CONCLUSION: The way text documents are formatted influences their accessibility and usability. Optimizing the formatting of CPGs is a relatively inexpensive intervention and can be used to facilitate the dissemination of evidence in healthcare. Applying simple formatting principles to make documents more vivid, intuitive, and visual is a practical approach that has the potential to influence the usability of guidelines and to influence the extent to which guidelines are read, remembered, and used in practice.

Guideline uptake is influenced by six implementability domains for creating and communicating guidelines: a realist review.

OBJECTIVES: To identify factors associated with the implementability of clinical practice guidelines (CPGs) and to determine what characteristics improve their uptake. STUDY DESIGN AND SETTING: We conducted a realist review, which involved searching multiple sources (eg, databases, experts) to determine what about guideline implementability works, for whom, and under what circumstances. Two sets of reviewers independently screened abstracts and extracted data from 278 included studies. Analysis involved the development of a codebook of definitions, validation of data, and development of hierarchical narratives to explain guideline implementability. RESULTS: We found that guideline implementability is associated with two broad goals in guideline development: (1) creation of guideline content, which involves addressing the domains of stakeholder involvement in CPGs, evidence synthesis, considered judgment (eg, clinical applicability), and implementation feasibility and (2) the effective communication of this content, which involves domains related to fine-tuning the CPG's message (using simple, clear, and persuasive language) and format. CONCLUSION: Our work represents a comprehensive and interdisciplinary effort toward better understanding, which attributes of guidelines have the potential to improve uptake in clinical practice. We also created codebooks and narratives of key concepts, which can be used to create tools for developing better guidelines to promote better care.