Correction: Evaluating the extent of reusability of CYP2C19 genotype data among patients genotyped for antiplatelet therapy selection.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Evaluating the extent of reusability of CYP2C19 genotype data among patients genotyped for antiplatelet therapy selection.

PURPOSE: Genotype-guided antiplatelet therapy is increasingly being incorporated into clinical care. The purpose of this study is to determine the extent to which patients initially genotyped for CYP2C19 to guide antiplatelet therapy were prescribed additional medications affected by CYP2C19. METHODS: We assembled a cohort of patients from eight sites performingCYP2C19 genotyping to inform antiplatelet therapy. Medication orders were evaluated from time of genotyping through one year. The primary endpoint was the proportion of patients prescribed two or more CYP2C19 substrates. Secondary endpoints were the proportion of patients with a drug-genotype interaction and time to receiving a CYP2C19 substrate. RESULTS: Nine thousand one hundred ninety-one genotyped patients (17% nonwhite) with a mean age of 68 ± 3 years were evaluated; 4701 (51%) of patients received two or more CYP2C19 substrates and 3835 (42%) of patients had a drug-genotype interaction. The average time between genotyping and CYP2C19 substrate other than antiplatelet therapy was 25 ± 10 days. CONCLUSIONS: More than half of patients genotyped in the setting of CYP2C19-guided antiplatelet therapy received another medication impacted by CYP2C19 in the following year. Given that genotype is stable for a patient's lifetime, this finding has implications for cost effectiveness, patient care, and treatment outcomes beyond the indication for which it was originally performed.

Unveiling the Structure in Mental Disorder Presentations.

Importance: DSM criteria are polythetic, allowing for heterogeneity of symptoms among individuals with the same disorder. In empirical research, most combinations were not found or only rarely found, prompting criticism of this heterogeneity. Objective: To elaborate how symptom-based definitions and assessments contribute to a distinct probability pattern for the occurrence of symptom combinations. Design, Setting, and Participants: This cross-sectional study involved a theoretical argument, simulation, and secondary data analysis of 4 preexisting datasets, each consisting of symptoms from 1 of the following syndromes: posttraumatic stress disorder, depression, schizophrenia, and anxiety. Data were obtained from various sources, including the National Institute of Mental Health Data Archive and Department of Veteran Affairs. A total of 155 474 participants were included (individual studies were 3930 to 63 742 individuals in size). Data were analyzed between July 2021 and January 2024. Exposure: For each participant, the presence or absence of each assessed symptom and their combination was determined. The number of all combinations and their individual frequencies were assessed. Main Outcome and Measure: Probability or frequency of unique symptom combinations and their distribution. Results: Among the 155 474 participants, the mean (SD) age was 47.5 (14.8) years; 33 933 (21.8%) self-identified as female and 121 541 (78.2%) as male. Because of the interrelation between symptoms, some symptom combinations were significantly more likely than others. The distribution of the combinations' probability was heavily skewed with most combinations having a very low probability. Across all 4 empirical samples, the 1% most common combinations were prevalent in a total of 33.1% to 78.6% of the corresponding sample. At the same time, many combinations (ranging from 41.7% to 99.8%) were reported by less than 1% of the sample. Conclusions and Relevance: This study found that within-disorder symptom heterogeneity followed a specific pattern consisting of few prevalent, prototypical combinations and numerous combinations with a very low probability of occurrence. Future discussions about the revision of diagnostic criteria should take this specific pattern into account by focusing not only on the absolute number of symptom combinations but also on their individual and cumulative probabilities. Findings from clinical populations using common diagnostic criteria may have limited generalizability to the large group of individuals with a low-probability symptom combination.

The development of a posttraumatic stress disorder (PTSD) consultation program to support system-wide implementation of high-quality PTSD care for veterans.

Among veterans, there is a 7% lifetime prevalence of posttraumatic stress disorder (PTSD; Goldstein et al., 2016), with this diagnosis being linked to poor health and quality of life (Goldstein et al., 2016; Schnurr et al., 2009). Veterans with PTSD may present for treatment in a variety of health care settings, meaning that providers across all of these settings need information about how to care for veterans with PTSD. Despite a number of ongoing efforts to ensure that veterans have access to effective, recovery-oriented treatments for PTSD within Veterans Affairs (VA), there is a need for further improvement and likely an even greater need for improvement in non-VA settings. A variety of consultation and technical assistance models exist, though research has lagged in this area. This article reports the rationale, development, and initial outcomes of the PTSD Consultation Program, a centralized consultation program started in 2011, which is available to all providers offering care to veterans with PTSD on an "on-request" basis. From 2011 to 2022, there have been 17,417 consultation requests, with about three quarters coming from VA providers, most often related to resources or treatment questions. The program has also flexibly responded to current events and crises. Survey feedback indicates high satisfaction. Data indicate that this type of on-request consultation may be an effective method to utilize the expertise of a few providers to help support a broader range of providers in implementing high-quality PTSD-or other types of specialty-care. Future research can link these data to more distal outcomes. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Deploying a national clinical text processing infrastructure.

OBJECTIVES: Clinical text processing offers a promising avenue for improving multiple aspects of healthcare, though operational deployment remains a substantial challenge. This case report details the implementation of a national clinical text processing infrastructure within the Department of Veterans Affairs (VA). METHODS: Two foundational use cases, cancer case management and suicide and overdose prevention, illustrate how text processing can be practically implemented at scale for diverse clinical applications using shared services. RESULTS: Insights from these use cases underline both commonalities and differences, providing a replicable model for future text processing applications. CONCLUSIONS: This project enables more efficient initiation, testing, and future deployment of text processing models, streamlining the integration of these use cases into healthcare operations. This project implementation is in a large integrated health delivery system in the United States, but we expect the lessons learned to be relevant to any health system, including smaller local and regional health systems in the United States.

Randomized Controlled Comparative Effectiveness Trial of Risk Model-Guided Clinical Decision Support for Suicide Screening.

Suicide prevention requires risk identification, appropriate intervention, and follow-up. Traditional risk identification relies on patient self-reporting, support network reporting, or face-to-face screening with validated instruments or history and physical exam. In the last decade, statistical risk models have been studied and more recently deployed to augment clinical judgment. Models have generally been found to be low precision or problematic at scale due to low incidence. Few have been tested in clinical practice, and none have been tested in clinical trials to our knowledge. Methods: We report the results of a pragmatic randomized controlled trial (RCT) in three outpatient adult Neurology clinic settings. This two-arm trial compared the effectiveness of Interruptive and Non-Interruptive Clinical Decision Support (CDS) to prompt further screening of suicidal ideation for those predicted to be high risk using a real-time, validated statistical risk model of suicide attempt risk, with the decision to screen as the primary end point. Secondary outcomes included rates of suicidal ideation and attempts in both arms. Manual chart review of every trial encounter was used to determine if suicide risk assessment was subsequently documented. Results: From August 16, 2022, through February 16, 2023, our study randomized 596 patient encounters across 561 patients for providers to receive either Interruptive or Non-Interruptive CDS in a 1:1 ratio. Adjusting for provider cluster effects, Interruptive CDS led to significantly higher numbers of decisions to screen (42%=121/289 encounters) compared to Non-Interruptive CDS (4%=12/307) (odds ratio=17.7, p-value <0.001). Secondarily, no documented episodes of suicidal ideation or attempts occurred in either arm. While the proportion of documented assessments among those noting the decision to screen was higher for providers in the Non-Interruptive arm (92%=11/12) than in the Interruptive arm (52%=63/121), the interruptive CDS was associated with more frequent documentation of suicide risk assessment (63/289 encounters compared to 11/307, p-value<0.001). Conclusions: In this pragmatic RCT of real-time predictive CDS to guide suicide risk assessment, Interruptive CDS led to higher numbers of decisions to screen and documented suicide risk assessments. Well-powered large-scale trials randomizing this type of CDS compared to standard of care are indicated to measure effectiveness in reducing suicidal self-harm. ClinicalTrials.gov Identifier: NCT05312437.

Exploring the frontier of electronic health record surveillance: the case of postoperative complications.

BACKGROUND: The aim of this study was to build electronic algorithms using a combination of structured data and natural language processing (NLP) of text notes for potential safety surveillance of 9 postoperative complications. METHODS: Postoperative complications from 6 medical centers in the Southeastern United States were obtained from the Veterans Affairs Surgical Quality Improvement Program (VASQIP) registry. Development and test datasets were constructed using stratification by facility and date of procedure for patients with and without complications. Algorithms were developed from VASQIP outcome definitions using NLP-coded concepts, regular expressions, and structured data. The VASQIP nurse reviewer served as the reference standard for evaluating sensitivity and specificity. The algorithms were designed in the development and evaluated in the test dataset. RESULTS: Sensitivity and specificity in the test set were 85% and 92% for acute renal failure, 80% and 93% for sepsis, 56% and 94% for deep vein thrombosis, 80% and 97% for pulmonary embolism, 88% and 89% for acute myocardial infarction, 88% and 92% for cardiac arrest, 80% and 90% for pneumonia, 95% and 80% for urinary tract infection, and 77% and 63% for wound infection, respectively. A third of the complications occurred outside of the hospital setting. CONCLUSIONS: Computer algorithms on data extracted from the electronic health record produced respectable sensitivity and specificity across a large sample of patients seen in 6 different medical centers. This study demonstrates the utility of combining NLP with structured data for mining the information contained within the electronic health record.

Leveraging available metadata in VA PTSD clinics and generating benchmarks for clinically significant change.

OBJECTIVE: Measurement-based care is designed to track symptom levels during treatment and leverage clinically significant change benchmarks to improve quality and outcomes. Though the Veterans Health Administration promotes monitoring progress within posttraumatic stress disorder (PTSD) clinical teams, actionability of data is diminished by a lack of population-based benchmarks for clinically significant change. We reported the state of repeated measurement within PTSD clinical teams, generated benchmarks, and examined outcomes based on these benchmarks. METHOD: PTSD Checklist for the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition data were culled from the Corporate Data Warehouse from the pre-COVID-19 year for Veterans who received at least eight sessions in 14 weeks (episode of care [EOC] cohort) and those who received sporadic care (modal cohort). We used the Jacobson and Truax (1991) approach to generate clinically significant change benchmarks at clinic, regional, and national levels and calculated the frequency of cases that deteriorated, were unchanged, improved, or probably recovered, using our generated benchmarks and benchmarks from a recent study, for both cohorts. RESULTS: Both the number of repeated measurements and the cases who had multisession care in the Corporate Data Warehouse were very low. Clinically significant change benchmarks were similar across locality levels. The modal cohort had worse outcomes than the EOC cohort. CONCLUSIONS: National benchmarks for clinically significant change could improve the actionability of assessment data for measurement-based care. Benchmarks created using data from Veterans who received multisession care had better outcomes than those receiving sporadic care. Measurement-based care in PTSD clinical teams is hampered by low rates of repeated assessments of outcome. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

An examination of the criterion-related validity of varying methods of indexing clinically significant change in posttraumatic stress disorder treatment.

OBJECTIVE: Clinicians, patients, and researchers need benchmarks to index individual-level clinically significant change (CSC) to guide decision making and inferences about treatment efficacy. Yet, there is no consensus best practice for determining CSC for posttraumatic stress disorder (PTSD) treatments. We examined criterion-related validity of the most common approach-Jacobson and Truax's (J&T; 1991) procedures for indexing CSC. We generated and compared four methods of calculating the J&T indices of CSC (two sets of sample-specific inputs, putatively norm-referenced benchmarks, and a combination of sample-specific and norm-referenced criteria) with respect to their association with a criterion index of quality of life (QoL). METHOD: Participants were 91 women Veterans enrolled in a randomized clinical trial for PTSD who completed self-report measures on PTSD symptoms and various domains of QoL and functioning, pre- and posttreatment. For each of the four methods used to calculate CSC, the QoL composite was regressed onto the CSC categories. RESULTS: All methods explained large variance in change in QoL. Across all methods, participants categorized as unchanged had smaller changes in QoL, compared with those who improved or had probable recovery. The norm-referenced benchmarks accounted for the relatively largest amount of variance in QoL, but categorized the fewest patients as having made CSC. CONCLUSIONS: The J&T methodology for indexing CSC in PTSD symptoms has criterion-related validity, and a norm-referenced benchmark appears to be the most potent. However, the norm-referenced parameters may be overly specific, potentially leading to an underestimate of improvement. Research is needed to test the generalizability of these results. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Expected symptom change trajectories for the early identification of probable treatment nonresponse in VA PTSD specialty care clinics: A proof-of-concept.

The purpose of measurement-based care (MBC) is to detect treatment nonresponse sufficiently early in treatment to adjust treatment plans and prevent failure or dropout. Thus, the potential of MBC is to provide the infrastructure for a flexible, patient-centered approach to evidence-based care. However, MBC is underutilized across the Department of Veterans Affairs (VA) posttraumatic stress disorder (PTSD) specialty clinics, likely because no actionable, empirically determined guidelines for using repeated measurement effectively are currently available to clinicians. With data collected as part of routine care in VA PTSD specialty clinics across the United States in the year prior to COVID-19 (n = 2,182), we conducted a proof-of-concept for a method of generating session-by-session benchmarks of probable patient nonresponse to treatment, which can be visualized alongside individual patient data using the most common measure of PTSD symptoms used in VA specialty clinics, the PTSD Checklist for Diagnostic and Statistical Manual of Mental Disorders, 5th Edition (PCL-5). Using survival analysis, we first identified the probability of cases reaching clinically significant change at each session, as well as any significant moderators of treatment response. We then generated a multilevel model with initial symptom burden predicting the trajectory of PCL-5 scores across sessions. Finally, we determined the slowest changing 50% and 60% of all cases to generate benchmarks at each session for each level of the predictor(s) and then assessed the accuracy of these benchmarks at each session for classifying treatment responders and nonresponders. The final models were able to accurately identify nonresponders as early as the sixth session of treatment. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Integration of Face-to-Face Screening With Real-time Machine Learning to Predict Risk of Suicide Among Adults.

Importance: Understanding the differences and potential synergies between traditional clinician assessment and automated machine learning might enable more accurate and useful suicide risk detection. Objective: To evaluate the respective and combined abilities of a real-time machine learning model and the Columbia Suicide Severity Rating Scale (C-SSRS) to predict suicide attempt (SA) and suicidal ideation (SI). Design, Setting, and Participants: This cohort study included encounters with adult patients (aged ≥18 years) at a major academic medical center. The C-SSRS was administered during routine care, and a Vanderbilt Suicide Attempt and Ideation Likelihood (VSAIL) prediction was generated in the electronic health record. Encounters took place in the inpatient, ambulatory surgical, and emergency department settings. Data were collected from June 2019 to September 2020. Main Outcomes and Measures: Primary outcomes were the incidence of SA and SI, encoded as International Classification of Diseases codes, occurring within various time periods after an index visit. We evaluated the retrospective validity of the C-SSRS, VSAIL, and ensemble models combining both. Discrimination metrics included area under the receiver operating curve (AUROC), area under the precision-recall curve (AUPR), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Results: The cohort included 120 398 unique index visits for 83 394 patients (mean [SD] age, 51.2 [20.6] years; 38 107 [46%] men; 45 273 [54%] women; 13 644 [16%] Black; 63 869 [77%] White). Within 30 days of an index visit, the combined models had higher AUROC (SA: 0.874-0.887; SI: 0.869-0.879) than both the VSAIL (SA: 0.729; SI: 0.773) and C-SSRS (SA: 0.823; SI: 0.777) models. In the highest risk-decile, ensemble methods had PPV of 1.3% to 1.4% for SA and 8.3% to 8.7% for SI and sensitivity of 77.6% to 79.5% for SA and 67.4% to 70.1% for SI, outperforming VSAIL (PPV for SA: 0.4%; PPV for SI: 3.9%; sensitivity for SA: 28.8%; sensitivity for SI: 35.1%) and C-SSRS (PPV for SA: 0.5%; PPV for SI: 3.5%; sensitivity for SA: 76.6%; sensitivity for SI: 68.8%). Conclusions and Relevance: In this study, suicide risk prediction was optimal when leveraging both in-person screening (for acute measures of risk in patient-reported suicidality) and historical EHR data (for underlying clinical factors that can quantify a patient's passive risk level). To improve suicide risk classification, prediction systems could combine pretrained machine learning with structured clinician assessment without needing to retrain the original model.

Prospective Validation of an Electronic Health Record-Based, Real-Time Suicide Risk Model.

Importance: Numerous prognostic models of suicide risk have been published, but few have been implemented outside of integrated managed care systems. Objective: To evaluate performance of a suicide attempt risk prediction model implemented in a vendor-supplied electronic health record to predict subsequent (1) suicidal ideation and (2) suicide attempt. Design, Setting, and Participants: This observational cohort study evaluated implementation of a suicide attempt prediction model in live clinical systems without alerting. The cohort comprised patients seen for any reason in adult inpatient, emergency department, and ambulatory surgery settings at an academic medical center in the mid-South from June 2019 to April 2020. Main Outcomes and Measures: Primary measures assessed external, prospective, and concurrent validity. Manual medical record validation of coded suicide attempts confirmed incident behaviors with intent to die. Subgroup analyses were performed based on demographic characteristics, relevant clinical context/setting, and presence or absence of universal screening. Performance was evaluated using discrimination (number needed to screen, C statistics, positive/negative predictive values) and calibration (Spiegelhalter z statistic). Recalibration was performed with logistic calibration. Results: The system generated 115 905 predictions for 77 973 patients (42 490 [54%] men, 35 404 [45%] women, 60 586 [78%] White, 12 620 [16%] Black). Numbers needed to screen in highest risk quantiles were 23 and 271 for suicidal ideation and attempt, respectively. Performance was maintained across demographic subgroups. Numbers needed to screen for suicide attempt by sex were 256 for men and 323 for women; and by race: 373, 176, and 407 for White, Black, and non-White/non-Black patients, respectively. Model C statistics were, across the health system: 0.836 (95% CI, 0.836-0.837); adult hospital: 0.77 (95% CI, 0.77-0.772); emergency department: 0.778 (95% CI, 0.777-0.778); psychiatry inpatient settings: 0.634 (95% CI, 0.633-0.636). Predictions were initially miscalibrated (Spiegelhalter z = -3.1; P = .001) with improvement after recalibration (Spiegelhalter z = 1.1; P = .26). Conclusions and Relevance: In this study, this real-time predictive model of suicide attempt risk showed reasonable numbers needed to screen in nonpsychiatric specialty settings in a large clinical system. Assuming that research-valid models will translate without performing this type of analysis risks inaccuracy in clinical practice, misclassification of risk, wasted effort, and missed opportunity to correct and prevent such problems. The next step is careful pairing with low-cost, low-harm preventive strategies in a pragmatic trial of effectiveness in preventing future suicidality.

Are posttraumatic stress disorder mental health terms found in SNOMED-CT medical terminology.

The authors sought to evaluate how well the Systematized Nomenclature of Medicine-Clinical Terms (SNOMED-CT) controlled vocabulary represents terms commonly used clinically when documenting posttraumatic stress disorder (PTSD). A list was constructed based on the PTSD criteria in the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV; American Psychiatric Association, 1994), symptom assessment instruments, and publications. Although two teams mapping the terms to SNOMED-CT differed in their approach, the consensus mapping accounted for 91% of the 153 PTSD terms. They found that the words used by clinicians in describing PTSD symptoms are represented in SNOMED-CT. These results can be used to codify mental health text reports for health information technology applications such as automated chart abstraction, algorithms for identifying documentation of symptoms representing PTSD in clinical notes, and clinical decision support.

Using patient-reported outcome measures for program evaluation: Design and findings on intention-to-treat outcomes from the Veterans Outcome Assessment survey.

The Veterans Outcomes Assessment (VOA) program surveys Veteran Health Administration (VHA) patients when they begin mental health treatment and at follow-up at three months to obtain patient-reported outcomes measures (PROM). It complements VA's evolving program in measurement-based care by providing additional data that can be useful for program evaluation including assessments of patients who have not been seen for ongoing mental health care. In principle, it provides data on intention-to-treat outcomes for program evaluation to complement the outcomes for patients who are receiving ongoing treatment that can be derived from measurement-based care. VOA findings confirm differences in outcomes between patients who have continued to be seen for treatment and those who have not. Patients in general mental health clinics with no encounters between the baseline and follow-up assessments who reported discontinuing care because they did not want or need treatment improved more, and those who discontinued due to problems improved less than those who remained in treatment. Experience with VOA has identified a number of issues that must be addressed before it is possible to use intention-to-treat outcomes for program evaluation.

eQuality: electronic quality assessment from narrative clinical reports.

OBJECTIVE: To evaluate an electronic quality (eQuality) assessment tool for dictated disability examination records. METHODS: We applied automated concept-based indexing techniques to automated quality screening of Department of Veterans Affairs spine disability examinations that had previously undergone gold standard quality review by human experts using established quality indicators. We developed automated quality screening rules and refined them iteratively on a training set of disability examination reports. We applied the resulting rules to a novel test set of spine disability examination reports. The initial data set was composed of all electronically available examination reports (N=125,576) finalized by the Veterans Health Administration between July and September 2001. RESULTS: Sensitivity was 91% for the training set and 87% for the test set (P-.02). Specificity was 74% for the training set and 71% for the test set (P=.44). Human performance ranged from 4% to 6% higher (P<.001) than the eQuality tool in sensitivity and 13% to 16% higher in specificity (P<.001). In addition, the eQuality tool was equivalent or higher in sensitivity for 5 of 9 individual quality indicators. CONCLUSION: The results demonstrate that a properly authored computer-based expert systems approach can perform quality measurement as well as human reviewers for many quality indicators. Although automation will likely always rely on expert guidance to be accurate and meaningful, eQuality is an important new method to assist clinicians in their efforts to practice safe and effective medicine.

Serial cerebrospinal fluid tryptophan and 5-hydroxy indoleacetic acid concentrations in healthy human subjects.

The role of the serotonergic system in the pathogenesis of behavioral disorders such as depression, alcoholism, obsessive-compulsive disorder, and violence is not completely understood. Measurement of the concentration of neurotransmitters and their metabolites in cerebrospinal fluid (CSF) is considered among the most valid, albeit indirect, methods of assessing central nervous system function in man. However, most studies in humans have measured lumbar CSF concentrations only at single time points, thus not taking into account rhythmic or episodic variations in levels of neurotransmitters, precursors, or metabolites. We have continuously sampled lumbar CSF via subarachnoid catheter in 12 healthy volunteers, aged 20-65 years. One ml (every 10 min) CSF samples were collected at a rate of 0.1ml/min for 24-hour (h), and the levels of tryptophan (TRP) and 5-hydroxy indoleacetic acid (5-HIAA) were measured. Variability across all 12 subjects was significantly greater (P < 0.0001) than the variability seen in repeated analysis of a reference CSF sample for both 5-HIAA (32.0% vs 7.9%) and TRP (25.4% vs 7.0%), confirming the presence of significant biological variability during the 24-hr period examined. This variability could not be explained solely by meal related effects. Cosinor analysis of the 24-hr TRP concentrations from all subjects revealed a significant diurnal pattern in CSF TRP levels, whereas the 5-HIAA data were less consistent. These studies indicate that long-term serial CSF sampling reveals diurnal and biological variability not evident in studies based on single CSF samples.

Detection of infectious symptoms from VA emergency department and primary care clinical documentation.

OBJECTIVE: The majority of clinical symptoms are stored as free text in the clinical record, and this information can inform clinical decision support and automated surveillance efforts if it can be accurately processed into computer interpretable data. METHODS: We developed rule-based algorithms and evaluated a natural language processing (NLP) system for infectious symptom detection using clinical narratives. Training (60) and testing (444) documents were randomly selected from VA emergency department, urgent care, and primary care records. Each document was processed with NLP and independently manually reviewed by two clinicians with adjudication by referee. Infectious symptom detection rules were developed in the training set using keywords and SNOMED-CT concepts, and subsequently evaluated using the testing set. RESULTS: Overall symptom detection performance was measured with a precision of 0.91, a recall of 0.84, and an F measure of 0.87. Overall symptom detection with assertion performance was measured with a precision of 0.67, a recall of 0.62, and an F measure of 0.64. Among those instances in which the automated system matched the reference set determination for symptom, the system correctly detected 84.7% of positive assertions, 75.1% of negative assertions, and 0.7% of uncertain assertions. CONCLUSION: This work demonstrates how processed text could enable detection of non-specific symptom clusters for use in automated surveillance activities.

Detection of blood culture bacterial contamination using natural language processing.

Microbiology results are reported in semi-structured formats and have a high content of useful patient information. We developed and validated a hybrid regular expression and natural language processing solution for processing blood culture microbiology reports. Multi-center Veterans Affairs training and testing data sets were randomly extracted and manually reviewed to determine the culture and sensitivity as well as contamination results. The tool was iteratively developed for both outcomes using a training dataset, and then evaluated on the test dataset to determine antibiotic susceptibility data extraction and contamination detection performance. Our algorithm had a sensitivity of 84.8% and a positive predictive value of 96.0% for mapping the antibiotics and bacteria with appropriate sensitivity findings in the test data. The bacterial contamination detection algorithm had a sensitivity of 83.3% and a positive predictive value of 81.8%.

eQuality for all: Extending automated quality measurement of free text clinical narratives.

INTRODUCTION: Electronic quality monitoring(eQuality) from clinical narratives may advance current manual quality measurement techniques.We evaluated automated eQuality measurement tools on clinical narratives of veterans' disability examinations. METHODS: We used a general purpose indexing engine to encode clinical concepts with SNOMED CT. We developed computer usable quality assessment rules from established quality indicators and evaluated the automated approach against a gold standard of double independent human expert review. Rules were iteratively improved using a training set of 1446 indexed exam reports and evaluated on a test set of 1454 indexed exam reports. RESULTS: The eQuality system achieved 86%sensitivity (recall), 62% specificity, and 96%positive predictive value (precision) for automated quality assessment of veterans' disability exams. Summary data for each exam type and detailed data for joint exam quality assessments are presented. DISCUSSION: The current results generalize our previous results to ten exam types covering over 200 diagnostic codes. eQuality measurement from narrative clinical documents has the potential to improve healthcare quality and safety.

Direct comparison of MEDCIN and SNOMED CT for representation of a general medical evaluation template.

BACKGROUND: Two candidate terminologies to support entry of general medical data are SNOMED CT and MEDCIN. We compare the ability of SNOMED CT and MEDCIN to represent concepts and interface terms from a VA general medical examination template. METHODS: We parsed the VA general medical evaluation template and mapped the resulting expressions into SNOMED CT and MEDCIN. Internists conducted double independent reviews on 864 expressions. Exact concept level matches were used to evaluate reference coverage. Exact term level matches were required for interface terms. RESULTS: Sensitivity of SNOMED CT as a reference terminology was 83% vs. 25% for MEDCIN (p<0.001). The sensitivity of SNOMED CT as an interface terminology was 53% vs. 7% for MEDCIN (P< 0.001). DISCUSSION: The content coverage of SNOMED CT as a reference terminology and as an interface terminology outperformed MEDCIN. We did not evaluate other aspects of interface terminologies such as richness of clinical linkages.