Commentaries on "Informatics and medicine: from molecules to populations".

OBJECTIVE: To discuss interdisciplinary research and education in the context of informatics and medicine by commenting on the paper of Kuhn et al. "Informatics and Medicine: From Molecules to Populations". METHOD: Inviting an international group of experts in biomedical and health informatics and related disciplines to comment on this paper. RESULTS AND CONCLUSIONS: The commentaries include a wide range of reasoned arguments and original position statements which, while strongly endorsing the educational needs identified by Kuhn et al., also point out fundamental challenges that are very specific to the unusual combination of scientific, technological, personal and social problems characterizing biomedical informatics. They point to the ultimate objectives of managing difficult human health problems, which are unlikely to yield to technological solutions alone. The psychological, societal, and environmental components of health and disease are emphasized by several of the commentators, setting the stage for further debate and constructive suggestions.

A systems science perspective on the capacity for change in public hospitals.

Many types of organisation are difficult to change, mainly due to structural, cultural and contextual barriers. Change in public hospitals is arguably even more problematic than in other types of hospitals, due to features such as structural dysfunctionalities and bureaucracy stemming from being publicly-run institutions. The main goals of this commentary are to bring into focus and highlight the "3 + 3 Decision Framework" proposed by Edwards and Saltman. This aims to help guide policymakers and managers implementing productive change in public hospitals. However, while change from the top is popular, there are powerful front-line clinicians, especially doctors, who can act to counterbalance top-down efforts. Front-line clinicians have cultural characteristics and power that allows them to influence or reject managerial decisions. Clinicians in various lower-level roles can also influence other clinicians to resist or ignore management requirements. The context is further complicated by multi-stakeholder agendas, differing goals, and accumulated inertia. The special status of clinicians, along with other system features of public hospitals, should be factored into efforts to realise major system improvements and progressive change.

A New Informatics Geography.

INTRODUCTION: Anyone with knowledge of information systems has experienced frustration when it comes to system implementation or use. Unanticipated challenges arise frequently and unanticipated consequences may follow. OBJECTIVE: Working from first principles, to understand why information technology (IT) is often challenging, identify which IT endeavors are more likely to succeed, and predict the best role that technology can play in different tasks and settings. RESULTS: The fundamental purpose of IT is to enhance our ability to undertake tasks, supplying new information that changes what we decide and ultimately what occurs in the world. The value of this information (VOI) can be calculated at different stages of the decision-making process and will vary depending on how technology is used. We can imagine a task space that describes the relative benefits of task completion by humans or computers and that contains specific areas where humans or computers are superior. There is a third area where neither is strong and a final joint workspace where humans and computers working in partnership produce the best results. CONCLUSION: By understanding that information has value and that VOI can be quantified, we can make decisions about how best to support the work we do. Evaluation of the expected utility of task completion by humans or computers should allow us to decide whether solutions should depend on technology, humans, or a partnership between the two.

The Unintended Consequences of Health Information Technology Revisited.

INTRODUCTION: The introduction of health information technology into clinical settings is associated with unintended negative consequences, some with the potential to lead to error and patient harm. As adoption rates soar, the impact of these hazards will increase. OBJECTIVE: Over the last decade, unintended consequences have received great attention in the medical informatics literature, and this paper seeks to identify the major themes that have emerged. RESULTS: Rich typologies of the causes of unintended consequences have been developed, along with a number of explanatory frameworks based on socio-technical systems theory. We however still have only limited data on the frequency and impact of these events, as most studies rely on data sets from incident reporting or patient chart reviews, rather than undertaking detailed observational studies. Such data are increasingly needed as more organizations implement health information technologies. When outcome studies have been done in different organizations, they reveal different outcomes for identical systems. From a theoretical perspective, recent advances in the emerging discipline of implementation science have much to offer in explaining the origin, and variability, of unintended consequences. CONCLUSION: The dynamic nature of health care service organizations, and the rapid development and adoption of health information technologies means that unintended consequences are unlikely to disappear, and we therefore must commit to developing robust systems to detect and manage them.

Surgical site infection-a population-based study in Australian adults measuring the compliance with and correct timing of appropriate antibiotic prophylaxis.

Prophylaxis for surgical site infection (SSI) is often at variance with guidelines, despite the prevalence of SSI and its associated cost, morbidity, and mortality. The CareTrack Australia study, undertaken by a number of the authors, demonstrated that appropriate care (in line with evidence- or consensus-based guidelines) was provided at 38% of eligible SSI healthcare encounters. Here, we report the indicator-level CareTrack Australia findings for SSI prophylaxis. Indicators were extracted from Australian and international clinical guidelines and ratified by clinical experts. A sample designed to be representative of the Australian population was recruited (n=1154). Participants' medical records were reviewed and analysed for compliance with the five SSI indicators. The main outcome measure was the percentage of eligible healthcare encounters with documented compliance with indicators for appropriate SSI prophylaxis. Of the 35,145 CareTrack Australia encounters, 702 (2%) were eligible for scoring against the SSI indicators. Where antibiotics were recommended, compliance was 49% for contaminated surgery, 57% for clean-contaminated surgery and 85% for surgery involving a prosthesis: these fell to 8%, 10% and 14%, respectively (an average of 11%), when currently recommended timing of antibiotic administration was included. Where antibiotics were not indicated, 72% of patients still received them. SSI prophylaxis in our sample was poor; over two-thirds of patients were given antibiotics, whether indicated or not, mainly at the wrong time. There is a need for national agreement on clinical standards, indicators and tools to guide, document and monitor SSI prophylaxis, with both local and national measures to increase and monitor their uptake.

Treat or test first? Decision analysis of empirical antiviral treatment of influenza virus infection versus treatment based on rapid test results.

BACKGROUND: neuraminidase (NA) inhibitors have recently become available for treatment of influenza. Rapid antigen detection assays at 'point-of-care' may improve the accuracy of clinical diagnosis, but the value of these techniques in assisting with the appropriate use of antivirals remains controversial. OBJECTIVE: to compare the diagnostic utilities of two management strategies for influenza, empirical antiviral therapy versus therapy based on a positive rapid test result in pre-epidemic and epidemic periods. STUDY DESIGN: a threshold decision analytic model was designed to compare these competing strategies and sensitivity analysis performed to examine the impact of diagnostic variables on the expected utility of the decision with a range of prior probabilities of infection between 1 and 50%. RESULTS: on the basis of the calculated sensitivity (77%) and specificity (95%) of a point-of-care test for influenza, pre-treatment testing was preferred and cost-effective in non-epidemic stage of the influenza cycle. The alternative strategy of empirical treatment produces a higher utility value during epidemics, but may result in overuse of antivirals for low-risk populations. The two strategies had equivalent efficacy when the probability of influenza was 42%. CONCLUSIONS: Patients with flu-like illness, who present outside the influenza outbreak and are considered to be at low risk for influenza-related complications, should be tested to confirm the diagnosis before starting antiviral treatment with a NA inhibitor. The most important variables in the model were the accuracy of the clinical diagnosis and the pre-test probability of influenza. A threshold probability of influenza of 42% would dictate changing from the rapid testing strategy to a 'treat regardless' strategy.

Information economics and the Internet.

Information economics offers insights into the dynamics of information across networked systems like the Internet. An information marketplace is different from other marketplaces because an information good is not actually consumed and can be reproduced and distributed at almost no cost. For information producers to remain profitable, they will need to minimize their exposure to competition. For example, information can be sold by charging site access rather than information access fees, or it can be bundled with other information or "versioned." For information consumers, a variation of Malthus' law predicts that the exponential growth in information will mean that specific information will become increasingly expensive to find, because search costs will grow but human attention will remain limited. Furthermore, the low cost of creating poor-quality information on the Web means that the low-quality information may eventually swamp high-quality resources. The use of reputable information portals on the Web, or smart search technologies, may help in the short run, but it is unclear whether an "information famine" is avoidable in the longer term.

When conversation is better than computation.

While largely ignored in informatics thinking, the clinical communication space accounts for the major part of the information flow in health care. Growing evidence indicates that errors in communication give rise to substantial clinical morbidity and mortality. This paper explores the implications of acknowledging the primacy of the communication space in informatics and explores some solutions to communication difficulties. It also examines whether understanding the dynamics of communication between human beings can also improve the way we design information systems in health care. Using the concept of common ground in conversation, proposals are suggested for modeling the common ground between a system and human users. Such models provide insights into when communication or computational systems are better suited to solving information problems.

Artificial intelligence in medicine: the challenges ahead.

The modern study of artificial intelligence in medicine (AIM) is 25 years old. Throughout this period, the field has attracted many of the best computer scientists, and their work represents a remarkable achievement. However, AIM has not been successful-if success is judged as making an impact on the practice of medicine. Much recent work in AIM has been focused inward, addressing problems that are at the crossroads of the parent disciplines of medicine and artificial intelligence. Now, AIM must move forward with the insights that it has gained and focus on finding solutions for problems at the heart of medical practice. The growing emphasis within medicine on evidence-based practice should provide the right environment for that change.

Improving clinical communication: a view from psychology.

Recent research has studied the communication behaviors of clinical hospital workers and observed a tendency for these workers to use communication behaviors that were often inefficient. Workers were observed to favor synchronous forms of communication, such as telephone calls and chance face-to-face meetings with colleagues, even when these channels were not effective. Synchronous communication also contributes to a highly interruptive working environment, increasing the potential for clinical errors to be made. This paper reviews these findings from a cognitive psychological perspective, focusing on current understandings of how human memory functions and on the potential consequences of interruptions on the ability to work effectively. It concludes by discussing possible communication technology interventions that could be introduced to improve the clinical communication environment and suggests directions for future research.

Communication behaviours in a hospital setting: an observational study.

OBJECTIVE: An exploratory study to identify patterns of communication behaviour among hospital based healthcare workers. DESIGN: Non-participatory, qualitative observational study. SETTING: British district general hospital. SUBJECTS: Eight doctors and two nurses. RESULTS: Communication behaviours resulted in an interruptive workplace, which seemed to contribute to inefficiency in work practice. Medical staff generated twice as many interruptions via telephone and paging systems as they received. Hypothesised causes for this level of interruption include a bias by staff to interruptive communication methods, a tendency to seek information from colleagues in preference to printed materials, and poor provision of information in support of contacting individuals in specific roles. Staff were observed to infer the intention of messages based on insufficient information, and clinical teams demonstrated complex communication patterns, which could lead to inefficiency. CONCLUSION: The results suggest a number of improvements to processes or technologies. Staff may need instruction in appropriate use of communication facilities. Further, excessive emphasis on information technology may be misguided since much may be gained by supporting information exchange through communication technology. Voicemail and email with acknowledgment, mobile communication, improved support for role based contact, and message screening may be beneficial in the hospital environment.

The role and impact of research agendas on the comparative-effectiveness research among antihyperlipidemics.

Although it is well established that funding source influences the publication of clinical trials, relatively little is known about how funding influences trial design. We examined a public trial registry to determine how funding source shapes trial design among trials involving antihyperlipidemics. We used an automated process to identify and analyze 809 trials from a set of 72,564. Three networks representing industry-, collaboratively, and non-industry-funded trials were constructed. Each network comprised 18 drugs as nodes connected according to the number of comparisons made between them. The results indicated that industry-funded trials were more likely to compare across drugs and examine dyslipidemia as a condition, and less likely to register safety outcomes. The source of funding for clinical trials had a measurable effect on trial design, which helps quantify differences in research agendas. Improved monitoring of current clinical trials may be used to more closely align research agendas to clinical needs.

Clinician preferences for verbal communication compared to EHR documentation in the ICU.

BACKGROUND: Effective communication is essential to safe and efficient patient care. Additionally, many health information technology (HIT) developments, innovations, and standards aim to implement processes to improve data quality and integrity of electronic health records (EHR) for the purpose of clinical information exchange and communication. OBJECTIVE: We aimed to understand the current patterns and perceptions of communication of common goals in the ICU using the distributed cognition and clinical communication space theoretical frameworks. METHODS: We conducted a focus group and 5 interviews with ICU clinicians and observed 59.5 hours of interdisciplinary ICU morning rounds. RESULTS: Clinicians used an EHR system, which included electronic documentation and computerized provider order entry (CPOE), and paper artifacts for documentation; yet, preferred the verbal communication space as a method of information exchange because they perceived that the documentation was often not updated or efficient for information retrieval. These perceptions that the EHR is a "shift behind" may lead to a further reliance on verbal information exchange, which is a valuable clinical communication activity, yet, is subject to information loss. CONCLUSIONS: Electronic documentation tools that, in real time, capture information that is currently verbally communicated may increase the effectiveness of communication.

How online crowds influence the way individual consumers answer health questions: an online prospective study.

OBJECTIVE: To investigate whether strength of social feedback, i.e. other people who concur (or do not concur) with one's own answer to a question, influences the way one answers health questions. METHODS: Online prospective study. Two hundred and twenty-seven undergraduate students were recruited to use an online search engine to answer six health questions. Subjects recorded their pre- and post-search answers to each question and their level of confidence in these answers. After answering each question post-search, subjects were presented with a summary of post-search answers provided by previous subjects and were asked to answer the question again. RESULTS: There was a statistically significant relationship between the absolute number of others with a different answer (the crowd's opinion volume) and the likelihood of an individual changing an answer (P<0.001). For most questions, no subjects changed their answer until the first 10-35 subjects completed the study. Subjects' likelihood of changing answer increased as the percentage of others with a different answer (the crowd's opinion density) increased (P=0.047). Overall, 98.3% of subjects did not change their answer when it concurred with the majority (i.e. >50%) of subjects, and that 25.7% of subjects changed their answer to the majority response when it did not concur with the majority. When subjects had a post-search answer that did not concur with the majority, they were 24% more likely to change answer than those with answers that concurred (P<0.001). CONCLUSION: This study provides empirical evidence that crowd influence, in the form of online social feedback, affects the way consumers answer health questions.

Market-based control mechanisms for patient safety.

A new model is proposed for enhancing patient safety using market-based control (MBC), inspired by successful approaches to environmental governance. Emissions trading, enshrined in the Kyoto protocol, set a carbon price and created a carbon market--is it possible to set a patient safety price and let the marketplace find ways of reducing clinically adverse events? To "cap and trade," a regulator would need to establish system-wide and organisation-specific targets, based on the cost of adverse events, create a safety market for trading safety credits and then police the market. Organisations are given a clear policy signal to reduce adverse event rates, are told by how much, but are free to find mechanisms best suited to their local needs. The market would inevitably generate novel ways of creating safety credits, and accountability becomes hard to evade when adverse events are explicitly measured and accounted for in an organisation's bottom line.