Harmonization process for the identification of medical events in eight European healthcare databases: the experience from the EU-ADR project.

OBJECTIVE: Data from electronic healthcare records (EHR) can be used to monitor drug safety, but in order to compare and pool data from different EHR databases, the extraction of potential adverse events must be harmonized. In this paper, we describe the procedure used for harmonizing the extraction from eight European EHR databases of five events of interest deemed to be important in pharmacovigilance: acute myocardial infarction (AMI); acute renal failure (ARF); anaphylactic shock (AS); bullous eruption (BE); and rhabdomyolysis (RHABD). DESIGN: The participating databases comprise general practitioners' medical records and claims for hospitalization and other healthcare services. Clinical information is collected using four different disease terminologies and free text in two different languages. The Unified Medical Language System was used to identify concepts and corresponding codes in each terminology. A common database model was used to share and pool data and verify the semantic basis of the event extraction queries. Feedback from the database holders was obtained at various stages to refine the extraction queries. MEASUREMENTS: Standardized and age specific incidence rates (IRs) were calculated to facilitate benchmarking and harmonization of event data extraction across the databases. This was an iterative process. RESULTS: The study population comprised overall 19 647 445 individuals with a follow-up of 59 929 690 person-years (PYs). Age adjusted IRs for the five events of interest across the databases were as follows: (1) AMI: 60-148/100 000 PYs; (2) ARF: 3-49/100 000 PYs; (3) AS: 2-12/100 000 PYs; (4) BE: 2-17/100 000 PYs; and (5) RHABD: 0.1-8/100 000 PYs. CONCLUSIONS: The iterative harmonization process enabled a more homogeneous identification of events across differently structured databases using different coding based algorithms. This workflow can facilitate transparent and reproducible event extractions and understanding of differences between databases.

Design and validation of an automated method to detect known adverse drug reactions in MEDLINE: a contribution from the EU-ADR project.

OBJECTIVES: The aim of this research was to automate the search of publications concerning adverse drug reactions (ADR) by defining the queries used to search MEDLINE and by determining the required threshold for the number of extracted publications to confirm the drug/event association in the literature. METHODS: We defined an approach based on the medical subject headings (MeSH) 'descriptor records' and 'supplementary concept records' thesaurus, using the subheadings 'chemically induced' and 'adverse effects' with the 'pharmacological action' knowledge. An expert-built validation set of true positive and true negative drug/adverse event associations (n=61) was used to validate our method. RESULTS: Using a threshold of three of more extracted publications, the automated search method presented a sensitivity of 90% and a specificity of 100%. For nine different drug/event pairs selected, the recall of the automated search ranged from 24% to 64% and the precision from 93% to 48%. CONCLUSIONS: This work presents a method to find previously established relationships between drugs and adverse events in the literature. Using MEDLINE, following a MeSH approach to filter the signals, is a valid option. Our contribution is available as a web service that will be integrated in the final European EU-ADR project (Exploring and Understanding Adverse Drug Reactions by integrative mining of clinical records and biomedical knowledge) automated system.

An open repositories network development for medical teaching resources.

The lack of interoperability between repositories of heterogeneous and geographically widespread data is an obstacle to the diffusion, sharing and reutilization of those data. We present the development of an open repositories network taking into account both the syntactic and semantic interoperability of the different repositories and based on international standards in this field. The network is used by the medical community in France for the diffusion and sharing of digital teaching resources. The syntactic interoperability of the repositories is managed using the OAI-PMH protocol for the exchange of metadata describing the resources. Semantic interoperability is based, on one hand, on the LOM standard for the description of resources and on MESH for the indexing of the latter and, on the other hand, on semantic interoperability management designed to optimize compliance with standards and the quality of the metadata.

Design and evaluation of a semantic approach for the homogeneous identification of events in eight patient databases: a contribution to the European EU-ADR project.

The overall objective of the EU-ADR project is the design, development, and validation of a computerised system that exploits data from electronic health records and biomedical databases for the early detection of adverse drug reactions. Eight different databases, containing health records of more than 30 million European citizens, are involved in the project. Unique queries cannot be performed across different databases because of their heterogeneity: Medical record and Claims databases, four different terminologies for coding diagnoses, and two languages for the information described in free text. The aim of our study was to provide database owners with a common basis for the construction of their queries. Using the UMLS, we provided a list of medical concepts, with their corresponding terms and codes in the four terminologies, which should be considered to retrieve the relevant information for the events of interest from the databases.

Open source challenges for hospital information system (HIS) in developing countries: a pilot project in Mali.

BACKGROUND: We are currently witnessing a significant increase in use of Open Source tools in the field of health. Our study aims to research the potential of these software packages for developing countries. Our experiment was conducted at the Centre Hospitalier Mere Enfant in Mali. METHODS: After reviewing several Open Source tools in the field of hospital information systems, Mediboard software was chosen for our study. To ensure the completeness of Mediboard in relation to the functionality required for a hospital information system, its features were compared to those of a well-defined comprehensive record management tool set up at the University Hospital "La Timone" of Marseilles in France. It was then installed on two Linux servers: a first server for testing and validation of different modules, and a second one for the deployed full implementation. After several months of use, we have evaluated the usability aspects of the system including feedback from end-users through a questionnaire. RESULTS: Initial results showed the potential of Open Source in the field of health IT for developing countries like Mali.Five main modules have been fully implemented: patient administrative and medical records management of hospital activities, tracking of practitioners' activities, infrastructure management and the billing system. This last component of the system has been fully developed by the local Mali team.The evaluation showed that the system is broadly accepted by all the users who participated in the study. 77% of the participants found the system useful; 85% found it easy; 100% of them believe the system increases the reliability of data. The same proportion encourages the continuation of the experiment and its expansion throughout the hospital. CONCLUSIONS: In light of the results, we can conclude that the objective of our study was reached. However, it is important to take into account the recommendations and the challenges discussed here to avoid several potential pitfalls specific to the context of Africa.Our future work will target the full integration of the billing module in Mediboard and an expanded implementation throughout the hospital.

Implementing electronic medical records in a psychiatric hospital: A qualitative study.

Abstract The objective of this study is to examine health care professionals' opinions of the critical events (opportunities and barriers) surrounding EMR implementation in a French teaching psychiatric hospital. This qualitative study was based on semi-structured interviews with 115 health care professionals: 16 psychiatrists, 84 nurses, six psychologists or social assistants and nine secretaries or administrative professionals. Interviews were thematically analysed. Most responders (96%) used EMR. Among these EMR users, 70% perceived EMR positively. Concerning the opportunities from implementing an EMR, the most represented theme was "the improved access to medical record information" (75%), followed by "the strategy to guarantee the adhesion of professionals and the use of EMR" (69%), and "the technological performances of EMR" (49%). Concerning the barriers to implementation, four themes emerged, as follows: "the workflow and efficiency decrease" (73%), "the triangulation of the patient-professional relationship" (47%), "the information sharing and confidentiality" (32%), and "the ambiguity of EMR" (26%), which answers both to the production of care and to an economic issue. In conclusion, EMR implementation involved several critical components, and the strategy of implementation is particularly important. Implementing an EMR should be considered a continuous process, and the principle and theory of continuous quality improvement appears pertinent for addressing this problem.

A semantic approach for the homogeneous identification of events in eight patient databases: a contribution to the European eu-ADR project.

The overall objective of the eu-ADR project is the design, development, and validation of a computerised system that exploits data from electronic health records and biomedical databases for the early detection of adverse drug reactions. Eight different databases, containing health records of more than 30 million European citizens, are involved in the project. Unique queries cannot be performed across different databases because of their heterogeneity: Medical record and Claims databases, four different terminologies for coding diagnoses, and two languages for the information described in free text. The aim of our study was to provide database owners with a common basis for the construction of their queries. Using the UMLS, we provided a list of medical concepts, with their corresponding terms and codes in the four terminologies, which should be considered to retrieve the relevant information for the events of interest from the databases.

Assisting the translation of SNOMED CT into French using UMLS and four representative French-language terminologies.

OBJECTIVE: To provide a semantics-based method to assist the translation of SNOMED CT into French. To do so, we selected four French-language terminologies: ICD-10, SNOMED International, MedDRA, MeSH, as they are dedicated to different uses - epidemiology, clinical medicine, adverse reactions, medical literature, respectively - in order to map them to SNOMED Clinical Terms (CT), and thus associate French terms with SNOMED CT concepts. In this way, we measured the number of SNOMED CT concepts to be found in French-language terminologies. MATERIAL AND METHOD: We used the UMLS Metathesaurus. The mapping method was based on the coincidence of identifiers and on the explicit mappings present in the Metathesaurus. RESULTS: The study dealt exclusively with preferred terms (PTs) in the terminologies. The terminologies are mapped with varying success as regards PTs mapped to SNOMED terms (from 52% to 96%). Conversely, 45% of SNOMED CT terms are mapped by uniting the four terminologies. DISCUSSION: A more effective mapping technique than the current method is under consideration. CONCLUSION: The method presented will be refined. It could certainly provide useful assistance in the translation of SNOMED CT into French. Due to its general nature, it could be used to translate SNOMED CT into other languages than French.

Improving the quality of the coding of primary diagnosis in standardized discharge summaries.

We propose to design and test an information-processing model to participate in appraising the quality and the consistency of the coding, for billing, of Standardized Discharge Summaries (SDSs). We designed a model using both symbolic knowledge extracted from the NLM's UMLS and statistical knowledge. The aim is to retrieve from the ICD-10 terms recorded in a SDS the Principal Diagnosis (PD) at the time of coding. In 90% of cases the PD was retrieved 1st or 2nd in SDS including three ICD-10 codes or more. This model could contribute as part of an automated quality control process in a hospital information system by checking consistency in coded SDSs and improve the income of the hospital.

Using knowledge for indexing health web resources in a quality-controlled gateway.

OBJECTIVES: The aim of this study is to provide to indexers MeSH terms to be considered as major ones in a list of terms automatically extracted from a document. MATERIAL AND METHODS: We propose a method combining symbolic knowledge - the UMLS Metathesaurus and Semantic Network - and statistical knowledge drawn from co-occurrences of terms in the CISMeF database (a French-language quality-controlled health gateway) using data mining measures. The method was tested on CISMeF corpus of 293 resources. RESULTS: There was a proportion of 0.37+/-0.26 major terms in the processed records. The method produced lists of terms with a proportion of terms initially pointed out as major of 0.54+/-0.31. DISCUSSION: The method we propose reduces the number of terms, which seem not useful for content description of resources, such as "check tags", but retains the most descriptive ones. Discarding these terms is accounted for by: 1) the removal by using semantic knowledge of associations of concepts bearing no real medical significance, 2) the removal by using statistical knowledge of nonstatistically significant associations of terms. CONCLUSION: This method can assist effectively indexers in their daily work and will be soon applied in the CISMeF system.

WRAPIN: a tool for patient empowerment within EHR.

Legal and technologic trends are making medical records progressively more patient-accessible. In the near future, information technology may make it even easier to provide patients a chance to review their records. One may wonder, however, about the practical use of this technology by patients. Understanding his/her own health record will certainly be one of the main concerns of patients. WRAPIN has been designed to provide patients and citizens with trusted health information. It will help to determine the reliability of documents by checking the ideas contained against established benchmarks, and enable users to determine the relevance of a given document from a page of search results. First, we present what is, in our opinion, the most original and important patient-centred WRAPIN characteristics and functionalities. Then, we compare these characteristics with those of representatives of two main trends in information retrieval: systems based on the popularity of web sites, and on the clustering of web sites. This comparison shows that, even though patients are tempted to use popular search engines, these are not sufficiently specialized in the medical domain to help them understand their own HER.. Finally, we discuss the complexity of medical readings over the Internet and the efforts that are still required in this domain.

From the description of activities to the identification of risks for clinical management: a proposal of building, merging and sharing knowledge representations of care processes.

Management of clinical processes and hospital activities takes advantage of business process reengineering methodology. It is now recognized that care process modeling must integrate the definition of goals and the assessment of risk. Two kinds of issues have been outlined: 1) the lack of an integrated model to identify and describe processes and their components according to a functional point of view; and 2) an increasing amount of documents that hospital staff members have to create, collect, index and maintain. As initial models focused only on a structural view of activities, we reviewed different sources of standards and norms to extract and classify a set of metadata aimed at describing any activity and its outcomes. The model includes links to structured terminologies to name attributes or value them. An object-oriented information model has been created and implemented to test the relevance and the feasibility of the modeling approach. Conceptually speaking, this model gives opportunity to bridge tacit and explicit knowledge. Practically speaking, limits to generalization remain partly due to the lack of a template processes database.

Proposal of a French health identification number interoperable at the European level.

The French ministry of Health is setting up the Personal Medical Record (PMR). This innovative tool has long been expected by French Health Authorities, Associations of Patients, other Health's associations, those defending Individual Liberties and the French National Data Protection Authority. The PMR will lead to improvements in many areas such as Diagnosis (Research and monitoring) Healthcare (Management of emergencies, urgent situations, Temporal health monitoring and evaluation), Therapy (Cohorts of patients for Clinical trials and epidemiological studies). The PMR will foster safe healthcare management, clinical research and epidemiological studies. Nevertheless, it raises many important questions regarding duplicates and the quality, precision and coherence of the linkage with other health data coming from different sources. The currently planned identifying process raises many questions with regard to its ability to deal with potential duplicates and to perform data linkage with other health data sources. Through this article, using the electronic health records, we develop and propose an identification process to improve the French PMR. Our proposed unique patient identifier will guarantee the security, confidentiality and privacy of the personal data, and will prove to be particularly useful for health planning, health policies and research as well as clinical and epidemiological studies. Finally, it will certainly be interoperable with other European health information systems. We propose here an alternative identification procedure that would allow France to broaden the scope of its PMR project by making it possible to contribute to public health research and policy while increasing interoperability with European health information systems and preserving the confidentiality of the data.

Collaborative and workflow-oriented digital portfolio: Creating a web-based tool to support a nationwide program of practices evaluation in the blood transfusion area.

PURPOSE: The French National Blood Transfusion Institute received approval from the French National Health Authority to organize a nationwide program for the evaluation of professional practices in the area of blood transfusion. Major issues of the project were: (1) managing numerous physicians spread nationwide; (2) tracking and storing the physician's entire process (from his/her enrollment to his/her lifelong follow-up); (3) creating a collaborative technique for processing an evaluation program; (4) enhancing exchanges between participants; (5) proposing effective implementation of the assessment. METHODS: As faculty members with experience in distance learning, we considered the digital/electronic portfolio to be one of the most suitable techniques to support such a project. Due to the lack of methods and tools to meet users' expectations, the decision was made to prototype a new and innovative assessment environment. A team was formed to complete the design phase within 6 months (information content, roles and functions). Implementation of the prototype, which includes tests, was also planned over a 6-month period. The methodology involves two approaches: one concerns business process modelling; the other is related to object-oriented methods for design and implementation. RESULTS: This primary work was aimed at describing a specific object, the evaluation program, which can be shared between players within a web-based collaborative platform. Four types of players were identified: (1) physicians enrolled into the assessment program; (2) tutors assigned to follow physicians' assessment process; (3) program directors who manage the content of the assessment program and the application of follow-up rules; (4) supervisors who administrate the global system. The evaluation program is composed of a set of actions, which has to be performed by the physicians. These actions are directly related to the activities of the business processes to which the candidate belongs. For each action, elements of proof have to be uploaded by the physician, according to a predefined schedule. The status of this object and its changes are followed and managed by a workflow engine. Implementation of the system required an object-oriented content management system (Zope/Plone). CONCLUSION: The object-oriented approach helped us to focus on the topic of interest, the assessment program, without being concerned by the whole environment. The assessment model we designed attempts to make a link with the business process performed in daily routine. This article explores the way business process modelling can contribute to the modelling of a professional practices assessment system. Apart from the modelling and technical aspects, this nationwide project contains major challenges: to enroll all physicians on an individualized basis and to create appropriate conditions for the extension of the evaluation program and device to other specialties.

A model for indexing medical documents combining statistical and symbolic knowledge.

OBJECTIVES: To develop and evaluate an information processing method based on terminologies, in order to index medical documents in any given documentary context. METHODS: We designed a model using both symbolic general knowledge extracted from the Unified Medical Language System (UMLS) and statistical knowledge extracted from a domain of application. Using statistical knowledge allowed us to contextualize the general knowledge for every particular situation. For each document studied, the extracted terms are ranked to highlight the most significant ones. The model was tested on a set of 17,079 French standardized discharge summaries (SDSs). RESULTS: The most important ICD-10 term of each SDS was ranked 1st or 2nd by the method in nearly 90% of the cases. CONCLUSIONS: The use of several terminologies leads to more precise indexing. The improvement achieved in the models implementation performances as a result of using semantic relationships is encouraging.

[Public access to information about the services and quality of care in public hospitals: the need for methodologic clarity. A survey of 44 university hospital directors and administrators]. / Accès du public aux informations sur les prestations et la qualité des soins dans les établissements publics de santé. Enquête auprès de 44 décideurs de CHU.

INTRODUCTION: For the past eight years, the Ministry of Health has released information about the services and quality of care in public hospitals, in response to the increasing concern about hospital performance expressed by patient associations. The press publishes hospital ratings based on this information. This survey asked hospital administrators about their views of communication on this topic. METHODS: This survey, conducted from 7 October through 20 November 2004, sent a two-page open questionnaire to a variety of hospital executive personnel - medical directors, chief administrators, medical school deans, and public information officers - to determine their views on this subject. RESULTS: The response rate was 34%. Without contesting either the legitimacy of the expectation for information or the transparency owed to patients, health professionals expressed the need to know in advance the "rules of the game" and the methodology of the rating techniques to be used. Most reported few changes in their professional behavior due to these publications, the methodology and criteria of which they contested. They suggested changes including different criteria and indicators for the rating, the ability to contest the conclusions drawn from the PMSI data, and the need for preliminary work to define criteria by working groups composed of physicians, other professionals, and even those outside the health field. On the other hand, only half were willing to participate in such a working group. CONCLUSION: These hospital managers see a need for specialists in the analysis of hospital data, who can clarify the meaning of the statistics and improve the public's understanding of them, now shaped by the mass media's failure to provide meaningful analysis.

Health search engine with e-document analysis for reliable search results.

OBJECTIVE: After a review of the existing practical solution available to the citizen to retrieve eHealth document, the paper describes an original specialized search engine WRAPIN. METHOD: WRAPIN uses advanced cross lingual information retrieval technologies to check information quality by synthesizing medical concepts, conclusions and references contained in the health literature, to identify accurate, relevant sources. Thanks to MeSH terminology [1] (Medical Subject Headings from the U.S. National Library of Medicine) and advanced approaches such as conclusion extraction from structured document, reformulation of the query, WRAPIN offers to the user a privileged access to navigate through multilingual documents without language or medical prerequisites. RESULTS: The results of an evaluation conducted on the WRAPIN prototype show that results of the WRAPIN search engine are perceived as informative 65% (59% for a general-purpose search engine), reliable and trustworthy 72% (41% for the other engine) by users. But it leaves room for improvement such as the increase of database coverage, the explanation of the original functionalities and an audience adaptability. CONCLUSION: Thanks to evaluation outcomes, WRAPIN is now in exploitation on the HON web site (http://www.healthonnet.org), free of charge. Intended to the citizen it is a good alternative to general-purpose search engines when the user looks up trustworthy health and medical information or wants to check automatically a doubtful content of a Web page.

Textual guidelines versus computable guidelines: a comparative study in the framework of the PRESGUID project in order to appreciate the impact of guideline format on physician compliance.

BACKGROUND: The compliance of physicians with the clinical practice guidelines (CPG) is insufficient and needs to be improved. OBJECTIVE: To determine whether standalone computerized CPG within the PRESGUID project could improve compliance with the recommendations than the use of CPG in textual format. METHOD: Comparative analyses of the responses made by two groups of resident physicians to a set of clinical cases. One group of residents had access to the CPG exclusively in textual format (paper document) while the second group had access to the CPG exclusively in computerized format within the PRESGUID software applications. RESULTS: The computable CPG are more efficient than the paper-based CPG regarding responses in compliance with the recommendations especially those judged to be relevant by an expert. CONCLUSION: These results should encourage the bodies responsible for diffusing CPG to promote the computable format and to facilitate the computerization process.

Contribution to an automated indexing of French-language health web sites.

OBJECTIVES: to improve the indexing of French-language health web sites by emphasizing the major terms that best describe them. MATERIAL AND METHODS: this study exploits both UMLS knowledge sources and results of previous research. It proposes a method for ranking MeSH terms taken from each record in order of relevance. The method is tested on a corpus of records taken from the French-language health gateway CISMeF. RESULTS: the results of the experiment are compared to those of a preliminary study performed on a corpus taken from MEDLINE. DISCUSSION: the ultimate objective of this work is to interface the developed tools with an automated MeSH term extractor in order to propose an automated indexing engine for French-language health web sites.