Exploiting the power of information in medical education.

The explosion of medical information demands a thorough reconsideration of medical education, including what we teach and assess, how we educate, and whom we educate. Physicians of the future will need to be self-aware, self-directed, resource-effective team players who can synthesize and apply summarized information and communicate clearly. Training in metacognition, data science, informatics, and artificial intelligence is needed. Education programs must shift focus from content delivery to providing students explicit scaffolding for future learning, such as the Master Adaptive Learner model. Additionally, educators should leverage informatics to improve the process of education and foster individualized, precision education. Finally, attributes of the successful physician of the future should inform adjustments in recruitment and admissions processes. This paper explores how member schools of the American Medical Association Accelerating Change in Medical Education Consortium adjusted all aspects of educational programming in acknowledgment of the rapid expansion of information.

ACC/AHA Special Report: Clinical Practice Guideline Implementation Strategies: A Summary of Systematic Reviews by the NHLBI Implementation Science Work Group: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines.

BACKGROUND: In 2008, the National Heart, Lung, and Blood Institute convened an Implementation Science Work Group to assess evidence-based strategies for effectively implementing clinical practice guidelines. This was part of a larger effort to update existing clinical practice guidelines on cholesterol, blood pressure, and overweight/obesity. OBJECTIVES: Review evidence from the published implementation science literature and identify effective or promising strategies to enhance the adoption and implementation of clinical practice guidelines. METHODS: This systematic review was conducted on 4 critical questions, each focusing on the adoption and effectiveness of 4 intervention strategies: (1) reminders, (2) educational outreach visits, (3) audit and feedback, and (4) provider incentives. A scoping review of the Rx for Change database of systematic reviews was used to identify promising guideline implementation interventions aimed at providers. Inclusion and exclusion criteria were developed a priori for each question, and the published literature was initially searched up to 2012, and then updated with a supplemental search to 2015. Two independent reviewers screened the returned citations to identify relevant reviews and rated the quality of each included review. RESULTS: Audit and feedback and educational outreach visits were generally effective in improving both process of care (15 of 21 reviews and 12 of 13 reviews, respectively) and clinical outcomes (7 of 12 reviews and 3 of 5 reviews, respectively). Provider incentives showed mixed effectiveness for improving both process of care (3 of 4 reviews) and clinical outcomes (3 reviews equally distributed between generally effective, mixed, and generally ineffective). Reminders showed mixed effectiveness for improving process of care outcomes (27 reviews with 11 mixed and 3 generally ineffective results) and were generally ineffective for clinical outcomes (18 reviews with 6 mixed and 9 generally ineffective results). Educational outreach visits (2 of 2 reviews), reminders (3 of 4 reviews), and provider incentives (1 of 1 review) were generally effective for cost reduction. Educational outreach visits (1 of 1 review) and provider incentives (1 of 1 review) were also generally effective for cost-effectiveness outcomes. Barriers to clinician adoption or adherence to guidelines included time constraints (8 reviews/overviews); limited staffing resources (2 overviews); timing (5 reviews/overviews); clinician skepticism (5 reviews/overviews); clinician knowledge of guidelines (4 reviews/overviews); and higher age of the clinician (1 overview). Facilitating factors included guideline characteristics such as format, resources, and end-user involvement (6 reviews/overviews); involving stakeholders (5 reviews/overviews); leadership support (5 reviews/overviews); scope of implementation (5 reviews/overviews); organizational culture such as multidisciplinary teams and low-baseline adherence (9 reviews/overviews); and electronic guidelines systems (3 reviews). CONCLUSION: The strategies of audit and feedback and educational outreach visits were generally effective in improving both process of care and clinical outcomes. Reminders and provider incentives showed mixed effectiveness, or were generally ineffective. No general conclusion could be reached about cost effectiveness, because of limitations in the evidence. Important gaps exist in the evidence on effectiveness of implementation interventions, especially regarding clinical outcomes, cost effectiveness and contextual issues affecting successful implementation.

Academic-community partnership development lessons learned: evidence-based interventions to increase screening mammography in rural communities.

Early detection of breast cancer leads to higher survival; yet, women who live in rural areas have lower screening rates and receive diagnosis at later stages. Effective screening approaches have been published in scientific journals but are not easily available to and understandable by community members. This article describes the development of an academic-community collaboration to implement evidence-based interventions to increase screening.

Early Intervention Referral Information, Transmission, and Sources-A Survey of State Part C Coordinators and Analysis of Referral Forms.

OBJECTIVE: Early Intervention (EI) referral is a key connector between health care and early childhood systems serving children with developmental risks. This study aimed to describe the US network of EI referrals by answering the following: "What information is sent to EI?", "Who sends it?", and "How is it sent?" METHOD: This study combined an analysis of national document-based and website-based referral forms with a survey of state Part C Coordinators (PCCs). Data on referral forms were systematically collected from state agency websites. PCCs from 52 jurisdictions were surveyed to assess current EI referral practices. Descriptive statistics were used for responses to multiple-choice items; free-text answers were condensed into key study themes. RESULTS: EI referral forms came as e-documents (81%) or websites (35%), and 72% were in English alone. They emphasized family and referral source contact information and reason for the referral. The survey results indicated that health care (45%) sends the most referrals, followed by families (30%). EI agencies received referrals by phone (38%), electronically (23%), e-mail (17%), and fax (17%), and PCCs valued this diversity of methods. Few states received referral data directly from electronic health records (EHRs); however, PCCs hope to eventually receive referrals through websites, mobile devices, and EHRs. CONCLUSION: EI referral data flow is complex, with opportunities for loss of children to follow-up. This study describes how EI referrals occur and provides examples of how communication and access to information may be improved.

Priorities of Hybrid Clinician-Managers: A Qualitative Study of How Managers Balance Clinical Quality Among Competing Responsibilities.

OBJECTIVE: Oversight of clinical quality is only one of physical therapy managers' multiple responsibilities. With the move to value-based care, organizations need sound management to navigate this evolving reimbursement landscape. Previous research has not explored how competing priorities affect physical therapy managers' oversight of clinical quality. The purpose of this study was to create a preliminary model of the competing priorities, motivations, and responsibilities of managers while overseeing clinical quality. METHODS: This qualitative study used the Rapid Qualitative Inquiry method. A purposive sample of 40 physical therapy managers and corporate leaders was recruited. A research team performed semi-structured interviews and observations in outpatient practices. The team used a grounded theory-based immersion/crystallization analysis approach. Identified themes delineated the competing priorities and workflows these managers use in their administrative duties. RESULTS: Six primary themes were identified that illustrate how managers: (1) balance managerial and professional priorities; (2) are susceptible to stakeholder influences; (3) experience internal conflict; (4) struggle to measure and define quality objectively; (5) are influenced by the culture and structure of their respective organizations; and (6) have professional needs apart from the needs of their clinics. CONCLUSION: Generally, managers' focus on clinical quality is notably less comprehensive than their focus on clinical operations. Additionally, the complex role of hybrid clinician-manager leaves limited time beyond direct patient care for administrative duties. Managers in organizations that hold them accountable to quality-based metrics have more systematic clinical quality oversight processes. IMPACT: This study gives physical therapy organizations a framework of factors that can be influenced to better facilitate managers' effective oversight of clinical quality. Organizations offering support for those managerial responsibilities will be well positioned to thrive in the new fee-for-value care structure.

Assessing the Transition of Training in Health Systems Science From Undergraduate to Graduate Medical Education.

BACKGROUND: The American Medical Association Accelerating Change in Medical Education (AMA-ACE) consortium proposes that medical schools include a new 3-pillar model incorporating health systems science (HSS) and basic and clinical sciences. One of the goals of AMA-ACE was to support HSS curricular innovation to improve residency preparation. OBJECTIVE: This study evaluates the effectiveness of HSS curricula by using a large dataset to link medical school graduates to internship Milestones through collaboration with the Accreditation Council for Graduate Medical Education (ACGME). METHODS: ACGME subcompetencies related to the schools' HSS curricula were identified for internal medicine, emergency medicine, family medicine, obstetrics and gynecology (OB/GYN), pediatrics, and surgery. Analysis compared Milestone ratings of ACE school graduates to non-ACE graduates at 6 and 12 months using generalized estimating equation models. RESULTS: At 6 months both groups demonstrated similar HSS-related levels of Milestone performance on the selected ACGME competencies. At 1 year, ACE graduates in OB/GYN scored minimally higher on 2 systems-based practice (SBP) subcompetencies compared to non-ACE school graduates: SBP01 (1.96 vs 1.82, 95% CI 0.03-0.24) and SBP02 (1.87 vs 1.79, 95% CI 0.01-0.16). In internal medicine, ACE graduates scored minimally higher on 3 HSS-related subcompetencies: SBP01 (2.19 vs 2.05, 95% CI 0.04-0.26), PBLI01 (2.13 vs 2.01; 95% CI 0.01-0.24), and PBLI04 (2.05 vs 1.93; 95% CI 0.03-0.21). For the other specialties examined, there were no significant differences between groups. CONCLUSIONS: Graduates from schools with training in HSS had similar Milestone ratings for most subcompetencies and very small differences in Milestone ratings for only 5 subcompetencies across 6 specialties at 1 year, compared to graduates from non-ACE schools. These differences are likely not educationally meaningful.

Registered Nurse Strain Detection Using Ambient Data: An Exploratory Study of Underutilized Operational Data Streams in the Hospital Workplace.

BACKGROUND: Registered nurses (RNs) regularly adapt their work to ever-changing situations but routine adaptation transforms into RN strain when service demand exceeds staff capacity and patients are at risk of missed or delayed care. Dynamic monitoring of RN strain could identify when intervention is needed, but comprehensive views of RN work demands are not readily available. Electronic care delivery tools such as nurse call systems produce ambient data that illuminate workplace activity, but little is known about the ability of these data to predict RN strain. OBJECTIVES: The purpose of this study was to assess the utility of ambient workplace data, defined as time-stamped transaction records and log file data produced by non-electronic health record care delivery tools (e.g., nurse call systems, communication devices), as an information channel for automated sensing of RN strain. METHODS: In this exploratory retrospective study, ambient data for a 1-year time period were exported from electronic nurse call, medication dispensing, time and attendance, and staff communication systems. Feature sets were derived from these data for supervised machine learning models that classified work shifts by unplanned overtime. Models for three timeframes -8, 10, and 12 hours-were created to assess each model's ability to predict unplanned overtime at various points across the work shift. RESULTS: Classification accuracy ranged from 57 to 64% across three analysis timeframes. Accuracy was lowest at 10 hours and highest at shift end. Features with the highest importance include minutes spent using a communication device and percent of medications delivered via a syringe. CONCLUSION: Ambient data streams can serve as information channels that contain signals related to unplanned overtime as a proxy indicator of RN strain as early as 8 hours into a work shift. This study represents an initial step toward enhanced detection of RN strain and proactive prevention of missed or delayed patient care.

Tiering drug-drug interaction alerts by severity increases compliance rates.

OBJECTIVE: Few data exist measuring the effect of differentiating drug-drug interaction (DDI) alerts in computerized provider order entry systems (CPOE) by level of severity ("tiering"). We sought to determine if rates of provider compliance with DDI alerts in the inpatient setting differed when a tiered presentation was implemented. DESIGN: We performed a retrospective analysis of alert log data on hospitalized patients at two academic medical centers during the period from 2/1/2004 through 2/1/2005. Both inpatient CPOE systems used the same DDI checking service, but one displayed alerts differentially by severity level (tiered presentation, including hard stops for the most severe alerts) while the other did not. Participants were adult inpatients who generated a DDI alert, and providers who wrote the orders. Alerts were presented during the order entry process, providing the clinician with the opportunity to change the patient's medication orders to avoid the interaction. MEASUREMENTS: Rate of compliance to alerts at a tiered site compared to a non-tiered site. RESULTS: We reviewed 71,350 alerts, of which 39,474 occurred at the non-tiered site and 31,876 at the tiered site. Compliance with DDI alerts was significantly higher at the site with tiered DDI alerts compared to the non-tiered site (29% vs. 10%, p < 0.001). At the tiered site, 100% of the most severe alerts were accepted, vs. only 34% at the non-tiered site; moderately severe alerts were also more likely to be accepted at the tiered site (29% vs. 10%). CONCLUSION: Tiered alerting by severity was associated with higher compliance rates of DDI alerts in the inpatient setting, and lack of tiering was associated with a high override rate of more severe alerts.

Designing a "Thinking System" to Reduce the Human Burden of Care Delivery.

Cancer patients interact with clinicians who are distributed across locations and organizations. This makes it difficult to coordinate care and adds to the burden of cancer care delivery. Failures in care coordination can harm patients. The rapid growth in the number of cancer survivors and the increasing complexity of cancer care has kindled an interest in new care delivery models. Information technology (IT) is an important component of care delivery. While IT can potentially enhance collaborative work among people distributed across locations, organizations and time, the current design and implementation of health IT adds to the human burden and often makes it a part of the problem instead of the solution. A new paradigm is needed, therefore, to drive innovations that reframe health IT as an enabler (and a component) of a "thinking system," in which patients, caregivers, and clinicians, even when distributed across locations and time, can collaborate to deliver high-quality care while decreasing the burden of care delivery. In a thinking system, the design of collaborative work in health care delivery is based on an understanding of complex interplay among social and technological components. We propose six core design properties for a thinking system: task coordination; information curation; creative and flexible organizing; establishing a common ground; continuity and connection; and co-production. A thinking system is needed to address the complexity of coordination, meet the rising expectation of personalized care, relieve the human burden in care delivery, and to deliver the best quality care that modern science can provide.

Subtle cues: Qualitative elicitation of signs of capacity strain in the hospital workplace.

Through everyday care experiences, nurses develop expertise in recognition of capacity strain in hospital workplaces. Through qualitative interview, experienced nurses identify common activity changes and adaptive work strategies that may signal an imbalance between patient demand and service supply at the bedside. Activity change examples include nurse helping behaviors across patient assignments, increased volume of nurse calls from patient rooms, and decreased presence of staff at the nurses' station. Adaptive work strategies encompass actions taken to recruit resources, move work in time, reduce work demands, or reduce thoroughness of task performance. Nurses' knowledge of perceptible signs of strain provides a foundation for future exploration and development of real-time indicators of capacity strain in hospital-based work systems.

Distributed cognition: an alternative model of cognition for medical informatics.

BACKGROUND: Medical informatics has been guided by an individual-centered model of human cognition, inherited from classical theory of mind, in which knowledge, problem-solving, and information-processing responsible for intelligent behavior all derive from the inner workings of an individual agent. OBJECTIVES AND RESULTS: In this paper we argue that medical informatics commitment to the classical model of cognition conflates the processing performed by the minds of individual agents with the processing performed by the larger distributed activity systems within which individuals operate. We review trends in cognitive science that seek to close the gap between general-purpose models of cognition and applied considerations of real-world human performance. One outcome is the theory of distributed cognition, in which the unit of analysis for understanding performance is the activity system which comprises a group of human actors, their tools and environment, and is organized by a particular history of goal-directed action and interaction. CONCLUSION: We describe and argue for the relevance of distributed cognition to medical informatics, both for the study of human performance in healthcare and for the design of technologies meant to enhance this performance.

Empiric Antibiotic Prescribing Decisions Among Medical Residents: The Role of the Antibiogram.

OBJECTIVETo assess general medical residents' familiarity with antibiograms using a self-administered surveyDESIGNCross-sectional, single-center surveyPARTICIPANTSResidents in internal medicine, family medicine, and pediatrics at an academic medical centerMETHODSParticipants were administered an anonymous survey at our institution during regularly scheduled educational conferences between January and May 2012. Questions collected data regarding demographics, professional training; further open-ended questions assessed knowledge and use of antibiograms regarding possible pathogens, antibiotic regimens, and prescribing resources for 2 clinical vignettes; a series of directed, closed-ended questions followed. Bivariate analyses to compare responses between residency programs were performed.RESULTSOf 122 surveys distributed, 106 residents (87%) responded; internal medicine residents accounted for 69% of responses. More than 20% of residents could not accurately identify pathogens to target with empiric therapy or select therapy with an appropriate spectrum of activity in response to the clinical vignettes; correct identification of potential pathogens was not associated with selecting appropriate therapy. Only 12% of respondents identified antibiograms as a resource when prescribing empiric antibiotic therapy for scenarios in the vignettes, with most selecting the UpToDate online clinical decision support resource or The Sanford Guide. When directly questioned, 89% reported awareness of institutional antibiograms, but only 70% felt comfortable using them and only 44% knew how to access them.CONCLUSIONSWhen selecting empiric antibiotics, many residents are not comfortable using antibiograms as part of treatment decisions. Efforts to improve antibiotic use may benefit from residents being given additional education on both infectious diseases pharmacotherapy and antibiogram utilization.Infect Control Hosp Epidemiol 2018;39:578-583.

Distributed cognition in the heart room: how situation awareness arises from coordinated communications during cardiac surgery.

To help ensure successful outcomes of open-heart surgery, surgeon and perfusionist must coordinate their activities during management of cardioplegia. This research aims to understand the basis for this coordination. We employed the framework of distributed cognition and the methodology of cognitive ethnography to describe how cognitive resources are configured and utilized to accomplish successful cardioplegia management. Analysis identified six types of surgeon-perfusionist verbal exchange which collectively enable robust system performance through (a) making the current situation clear and mutually understood; (b) making goals and envisioned future situations clear and thereby anticipated; and (c) expanding upon the activity system's knowledge base through discovery and sharing of experience. We argue for the "activity system" as the appropriate unit of analysis, and distributed cognition as a powerful theoretical framework for studying the socio-technical work of health care.

Clinical decisions support malfunctions in a commercial electronic health record.

OBJECTIVES: Determine if clinical decision support (CDS) malfunctions occur in a commercial electronic health record (EHR) system, characterize their pathways and describe methods of detection. METHODS: We retrospectively examined the firing rate for 226 alert type CDS rules for detection of anomalies using both expert visualization and statistical process control (SPC) methods over a five year period. Candidate anomalies were investigated and validated. RESULTS: Twenty-one candidate CDS anomalies were identified from 8,300 alert-months. Of these candidate anomalies, four were confirmed as CDS malfunctions, eight as false-positives, and nine could not be classified. The four CDS malfunctions were a result of errors in knowledge management: 1) inadvertent addition and removal of a medication code to the electronic formulary list; 2) a seasonal alert which was not activated; 3) a change in the base data structures; and 4) direct editing of an alert related to its medications. 154 CDS rules (68%) were amenable to SPC methods and the test characteristics were calculated as a sensitivity of 95%, positive predictive value of 29% and F-measure 0.44. DISCUSSION: CDS malfunctions were found to occur in our EHR. All of the pathways for these malfunctions can be described as knowledge management errors. Expert visualization is a robust method of detection, but is resource intensive. SPC-based methods, when applicable, perform reasonably well retrospectively. CONCLUSION: CDS anomalies were found to occur in a commercial EHR and visual detection along with SPC analysis represents promising methods of malfunction detection.

ACC/AHA Special Report: Clinical Practice Guideline Implementation Strategies: A Summary of Systematic Reviews by the NHLBI Implementation Science Work Group: A Report of the American College of Cardiology/American Heart Association Task Force on Clinical Practice Guidelines.

BACKGROUND: In 2008, the National Heart, Lung, and Blood Institute convened an Implementation Science Work Group to assess evidence-based strategies for effectively implementing clinical practice guidelines. This was part of a larger effort to update existing clinical practice guidelines on cholesterol, blood pressure, and overweight/obesity. OBJECTIVES: Review evidence from the published implementation science literature and identify effective or promising strategies to enhance the adoption and implementation of clinical practice guidelines. METHODS: This systematic review was conducted on 4 critical questions, each focusing on the adoption and effectiveness of 4 intervention strategies: (1) reminders, (2) educational outreach visits, (3) audit and feedback, and (4) provider incentives. A scoping review of the Rx for Change database of systematic reviews was used to identify promising guideline implementation interventions aimed at providers. Inclusion and exclusion criteria were developed a priori for each question, and the published literature was initially searched up to 2012, and then updated with a supplemental search to 2015. Two independent reviewers screened the returned citations to identify relevant reviews and rated the quality of each included review. RESULTS: Audit and feedback and educational outreach visits were generally effective in improving both process of care (15 of 21 reviews and 12 of 13 reviews, respectively) and clinical outcomes (7 of 12 reviews and 3 of 5 reviews, respectively). Provider incentives showed mixed effectiveness for improving both process of care (3 of 4 reviews) and clinical outcomes (3 reviews equally distributed between generally effective, mixed, and generally ineffective). Reminders showed mixed effectiveness for improving process of care outcomes (27 reviews with 11 mixed and 3 generally ineffective results) and were generally ineffective for clinical outcomes (18 reviews with 6 mixed and 9 generally ineffective results). Educational outreach visits (2 of 2 reviews), reminders (3 of 4 reviews), and provider incentives (1 of 1 review) were generally effective for cost reduction. Educational outreach visits (1 of 1 review) and provider incentives (1 of 1 review) were also generally effective for cost-effectiveness outcomes. Barriers to clinician adoption or adherence to guidelines included time constraints (8 reviews/overviews); limited staffing resources (2 overviews); timing (5 reviews/overviews); clinician skepticism (5 reviews/overviews); clinician knowledge of guidelines (4 reviews/overviews); and higher age of the clinician (1 overview). Facilitating factors included guideline characteristics such as format, resources, and end-user involvement (6 reviews/overviews); involving stakeholders (5 reviews/overviews); leadership support (5 reviews/overviews); scope of implementation (5 reviews/overviews); organizational culture such as multidisciplinary teams and low-baseline adherence (9 reviews/overviews); and electronic guidelines systems (3 reviews). CONCLUSION: The strategies of audit and feedback and educational outreach visits were generally effective in improving both process of care and clinical outcomes. Reminders and provider incentives showed mixed effectiveness, or were generally ineffective. No general conclusion could be reached about cost effectiveness, because of limitations in the evidence. Important gaps exist in the evidence on effectiveness of implementation interventions, especially regarding clinical outcomes, cost effectiveness and contextual issues affecting successful implementation.

Advancing biomedical image retrieval: development and analysis of a test collection.

OBJECTIVE: Develop and analyze results from an image retrieval test collection. METHODS: After participating research groups obtained and assessed results from their systems in the image retrieval task of Cross-Language Evaluation Forum, we assessed the results for common themes and trends. In addition to overall performance, results were analyzed on the basis of topic categories (those most amenable to visual, textual, or mixed approaches) and run categories (those employing queries entered by automated or manual means as well as those using visual, textual, or mixed indexing and retrieval methods). We also assessed results on the different topics and compared the impact of duplicate relevance judgments. RESULTS: A total of 13 research groups participated. Analysis was limited to the best run submitted by each group in each run category. The best results were obtained by systems that combined visual and textual methods. There was substantial variation in performance across topics. Systems employing textual methods were more resilient to visually oriented topics than those using visual methods were to textually oriented topics. The primary performance measure of mean average precision (MAP) was not necessarily associated with other measures, including those possibly more pertinent to real users, such as precision at 10 or 30 images. CONCLUSIONS: We developed a test collection amenable to assessing visual and textual methods for image retrieval. Future work must focus on how varying topic and run types affect retrieval performance. Users' studies also are necessary to determine the best measures for evaluating the efficacy of image retrieval systems.

Primary Care Physician Designation and Response to Clinical Decision Support Reminders: A Cross-Sectional Study.

OBJECTIVE: Clinical decision support (CDS) has been shown to improve process outcomes, but over-alerting may not produce incremental benefits. We analyzed providers' response to preventive care reminders to determine if reminder response rates varied when a primary care provider (PCP) saw their own patients as compared with a partner's patients. Secondary objectives were to describe variation in PCP identification in the electronic health record (EHR) across sites, and to determine its accuracy. METHODS: We retrospectively analyzed response to preventive care reminders during visits to outpatient primary care sites over a three-month period where an EHR was used. Data on clinician requests for reminders, viewing of preventive care reminders, and response rates were stratified by whether the patient visited their own PCP, the PCP's partner, or where no PCP was listed in the EHR. We calculated the proportion of PCP identification across sites and agreement of identified PCP with an external standard. RESULTS: Of 84,937 visits, 58,482 (68.9%) were with the PCP, 10,259 (12.1%) were with the PCP's partner, and 16,196 (19.1%) had no listed PCP. Compared with PCP partner visits, visits with the patient's PCP were associated with more requested reminders (30.9% vs 22.9%), viewed reminders (29.7% vs 20.7%), and responses to reminders (28.7% vs 12.6%), all comparisons p<0.001. Visits with no listed PCP had the lowest rates of requests, views, and responses. There was good agreement between the EHR-listed PCP and the provider seen for a plurality of visits over the last year (κ=0.917). CONCLUSIONS: A PCP relationship during a visit was associated with higher use of preventive care reminders and a lack of PCP was associated with lower use of CDS. Targeting reminders to the PCP may be desirable, but further studies are needed to determine which strategy achieves better patient care outcomes.

Barriers and facilitators to exchanging health information: a systematic review.

OBJECTIVES: We conducted a systematic review of studies assessing facilitators and barriers to use of health information exchange (HIE). METHODS: We searched MEDLINE, PsycINFO, CINAHL, and the Cochrane Library databases between January 1990 and February 2015 using terms related to HIE. English-language studies that identified barriers and facilitators of actual HIE were included. Data on study design, risk of bias, setting, geographic location, characteristics of the HIE, perceived barriers and facilitators to use were extracted and confirmed. RESULTS: Ten cross-sectional, seven multiple-site case studies, and two before-after studies that included data from several sources (surveys, interviews, focus groups, and observations of users) evaluated perceived barriers and facilitators to HIE use. The most commonly cited barriers to HIE use were incomplete information, inefficient workflow, and reports that the exchanged information that did not meet the needs of users. The review identified several facilitators to use. DISCUSSION: Incomplete patient information was consistently mentioned in the studies conducted in the US but not mentioned in the few studies conducted outside of the US that take a collective approach toward healthcare. Individual patients and practices in the US may exercise the right to participate (or not) in HIE which effects the completeness of patient information available to be exchanged. Workflow structure and user roles are key but understudied. CONCLUSIONS: We identified several facilitators in the studies that showed promise in promoting electronic health data exchange: obtaining more complete patient information; thoughtful workflow that folds in HIE; and inclusion of users early in implementation.

Computerized physician order entry in U.S. hospitals: results of a 2002 survey.

OBJECTIVE: To determine the availability of inpatient computerized physician order entry in U.S. hospitals and the degree to which physicians are using it. DESIGN: Combined mail and telephone survey of 964 randomly selected hospitals, contrasting 2002 data and results of a survey conducted in 1997. AVAILABILITY: computerized order entry has been installed and is available for use by physicians; inducement: the degree to which use of computers to enter orders is required of physicians; participation: the proportion of physicians at an institution who enter orders by computer; and saturation: the proportion of total orders at an institution entered by a physician using a computer. RESULTS: The response rate was 65%. Computerized order entry was not available to physicians at 524 (83.7%) of 626 hospitals responding, whereas 60 (9.6%) reported complete availability and 41 (6.5%) reported partial availability. Of 91 hospitals providing data about inducement/requirement to use the system, it was optional at 31 (34.1%), encouraged at 18 (19.8%), and required at 42 (46.2%). At 36 hospitals (45.6%), more than 90% of physicians on staff use the system, whereas six (7.6%) reported 51-90% participation and 37 (46.8%) reported participation by fewer than half of physicians. Saturation was bimodal, with 25 (35%) hospitals reporting that more than 90% of all orders are entered by physicians using a computer and 20 (28.2%) reporting that less than 10% of all orders are entered this way. CONCLUSION: Despite increasing consensus about the desirability of computerized physician order entry (CPOE) use, these data indicate that only 9.6% of U.S. hospitals presently have CPOE completely available. In those hospitals that have CPOE, its use is frequently required. In approximately half of those hospitals, more than 90% of physicians use CPOE; in one-third of them, more than 90% of orders are entered via CPOE.

A cross-site qualitative study of physician order entry.

OBJECTIVE: To describe the perceptions of diverse professionals involved in computerized physician order entry (POE) at sites where POE has been successfully implemented and to identify differences between teaching and nonteaching hospitals. DESIGN: A multidisciplinary team used observation, focus groups, and interviews with clinical, administrative, and information technology staff to gather data at three sites. Field notes and transcripts were coded using an inductive approach to identify patterns and themes in the data. MEASUREMENTS: Patterns and themes concerning perceptions of POE were identified. RESULTS: Four high-level themes were identified: (1) organizational issues such as collaboration, pride, culture, power, politics, and control; (2) clinical and professional issues involving adaptation to local practices, preferences, and policies; (3) technical/implementation issues, including usability, time, training and support; and (4) issues related to the organization of information and knowledge, such as system rigidity and integration. Relevant differences between teaching and nonteaching hospitals include extent of collaboration, staff longevity, and organizational missions. CONCLUSION: An organizational culture characterized by collaboration and trust and an ongoing process that includes active clinician engagement in adaptation of the technology were important elements in successful implementation of physician order entry at the institutions that we studied.