Derivation and external validation of a portable method to identify patients with pulmonary embolism from radiology reports: The READ-PE algorithm.

BACKGROUND: Identification of pulmonary embolism (PE) across a cohort currently requires burdensome manual review. Previous approaches to automate capture of PE diagnosis have either been too complex for widespread use or have lacked external validation. We sought to develop and validate the Regular Expression Aided Determination of PE (READ-PE) algorithm, which uses a portable text-matching approach to identify PE in reports from computed tomography with angiography (CTA). METHODS: We identified derivation and validation cohorts of final radiology reports for CTAs obtained on adults (≥ 18 years) at two independent, quaternary academic emergency departments (EDs) in the United States. All reports were in the English language. We manually reviewed CTA reports for PE as a reference standard. In the derivation cohort, we developed the READ-PE algorithm by iteratively combining regular expressions to identify PE. We validated the READ-PE algorithm in an independent cohort, and compared performance against three prior algorithms with sensitivity, specificity, positive-predictive-value (PPV), negative-predictive-value (NPV), and the F1 score. RESULTS: Among 2948 CTAs in the derivation cohort 10.8 % had PE and the READ-PE algorithm reached 93 % sensitivity, 99 % specificity, 94 % PPV, 99 % NPV, and 0.93 F1 score, compared to F1 scores ranging from 0.50 to 0.85 for three prior algorithms. Among 1206 CTAs in the validation cohort 9.2 % had PE and the algorithm had 98 % sensitivity, 98 % specificity, 85 % PPV, 100 % NPV, and 0.91 F1 score. CONCLUSIONS: The externally validated READ-PE algorithm identifies PE in English-language reports from CTAs obtained in the ED with high accuracy. This algorithm may be used in the electronic health record to accurately identify PE for research or surveillance. If implemented at other EDs, it should first undergo local validation and may require maintenance over time.

The utility of urine sodium-guided diuresis during acute decompensated heart failure.

Diuresis to achieve decongestion is a central aim of therapy in patients hospitalized for acute decompensated heart failure (ADHF). While multiple approaches have been tried to achieve adequate decongestion rapidly while minimizing adverse effects, no single diuretic strategy has shown superiority, and there is a paucity of data and guidelines to utilize in making these decisions. Observational cohort studies have shown associations between urine sodium excretion and outcomes after hospitalization for ADHF. Urine chemistries (urine sodium ± urine creatinine) may guide diuretic titration during ADHF, and multiple randomized clinical trials have been designed to compare a strategy of urine chemistry-guided diuresis to usual care. This review will summarize current literature for diuretic monitoring and titration strategies, outline evidence gaps, and describe the recently completed and ongoing clinical trials to address these gaps in patients with ADHF with a particular focus on the utility of urine sodium-guided strategies.

Emergency department diagnosis and management of acute pulmonary embolism.

Despite advances in clinical decision support, the diagnosis, prognostic risk stratification, treatment and disposition of emergency department patients with pulmonary embolism remain challenging. The use of diagnostic risk stratification tools and D-dimer can decrease unnecessary exposure to radiation and intravenous contrast; however, D-dimer is elevated in many conditions including normal pregnancy, so imaging is often indicated. Once diagnosed, prognostic risk stratification tools can inform treatment decisions across the risk spectrum, including identifying low-risk patients with pulmonary embolism who can safely be treated at home. For patients requiring hospitalization, alternatives to unfractionated heparin can improve time to therapeutic anticoagulation and reduce treatment-related bleeding risk.

Characteristics and Health Care Utilization of Patients With Housing Insecurity in the ED.

Importance: Unstable housing and homelessness can exacerbate adverse health outcomes leading to increased risk of chronic disease, injury, and disability. However, emergency departments (EDs) have no universal method to identify those at risk of or currently experiencing homelessness. Objective: To describe the extent of housing insecurity among patients who seek care in an urban ED, including chief concerns, demographics, and patterns of health care utilization. Design, Setting, and Participants: This cross-sectional study included all adult patients presenting to the ED at Vanderbilt University Medical Center (VUMC), an urban tertiary care, level I trauma center in the Southeast US, from January 5 to May 16, 2023. Main Outcomes and Measures: The primary outcome was the proportion of ED visits at which patients screened positive for housing insecurity. Secondary outcomes included prevalence of insecurity by chief concerns, demographics, and patterns of health care utilization. Results: Of all 23 795 VUMC ED visits with screenings for housing insecurity (12 465 visits among women [52%]; median age, 47 years [IQR, 32-48 years]), in 1185 (5%), patients screened positive for current homelessness or housing insecurity (660 unique patients); at 22 610 visits (95%), the screening result was negative. Of visits with positive results, the median age of patients was 46 years (IQR, 36-55 years) and 829 (70%) were among male patients. Suicide and intoxication were more common chief concerns among visits at which patients screened positive (132 [11%] and 118 [10%], respectively) than among those at which patients screened negative (220 [1%] and 335 [2%], respectively). Visits with positive results were more likely to be among patients who were uninsured (395 [33%] vs 2272 [10%]) and had multiple visits during the study period. A higher proportion of positive screening results occurred between 8 pm and 6 am. The social work team assessed patients at 919 visits (78%) with positive screening results. Conclusions and Relevance: In this cross-sectional study of 23 795 ED visits, at 5% of visits, patients screened positive for housing insecurity and were more likely to present with a chief concern of suicide, to be uninsured, and to have multiple visits during the study period. This analysis provides a call for other institutions to introduce screening and create tailored care plans for patients experiencing housing insecurity to achieve equitable health care.

Characteristics and outcomes of prehospital and emergency department surgical airways.

Objectives: The surgical airway is a high acuity, low occurrence procedure. Data on the complications and outcomes of surgical airways are limited. Our primary objective was to describe immediate complications, late complications, and clinical outcomes of patients who underwent a surgical airway procedure in the prehospital or emergency department (ED) setting. Methods: We conducted a retrospective chart review of patients ≥14 years at an academic medical center who underwent a surgical airway procedure in the ED, the prehospital setting, or at a referring ED prior to interfacility transfer. We identified cases from keyword searches of prehospital text pages and hospital electronic medical records from June 1, 2008 to July 1, 2022. Manual chart review was used to confirm inclusion and determine patient and procedure characteristics. Outcomes included immediate complications, delayed in-hospital complications, and neurologic disability as defined by Modified Rankin Score (mRS) at discharge. Results: We identified 63 patients (34 prehospital, 11 ED, and 18 referring ED). Immediate complications included mainstem intubation (46.0%) and bleeding that required direct pressure (23.4%). Overall, 29 patients (46%) died after arrival to the hospital. Of the patients surviving to hospital admission, 25 (48%) had an airway-related complication. Nine complications were deemed directly related to technical components of the procedure. Of the patients who survived to discharge, 18 (52.9%) had poor neurologic function (mRS 4-5). Conclusion: Procedural complications, mortality, and poor neurologic function were common following a surgical airway procedure in the prehospital or ED setting. Most patients surviving to discharge had a moderate to severe neurologic disability.

Injuries From Legal Interventions Involving Conducted Energy Devices.

This cross-sectional study evaluates emergency department visits for physical injuries from use of conducted energy devices by police departments.

Frequency of cardiotoxicity following intramuscular administration of epinephrine in emergency department patients with anaphylaxis.

Objectives: Epinephrine can be a life-saving treatment for patients with anaphylaxis. Potential cardiovascular side effects of epinephrine may contribute to clinician hesitancy to use it. However, the frequency of cardiotoxicity resulting from epinephrine treatment for anaphylaxis is not well described. We sought to describe the frequency of cardiotoxicity following intramuscular (IM) administration of epinephrine in adult emergency department (ED) patients with anaphylaxis. Methods: We conducted a retrospective observational study at a single, quaternary care academic ED in Tennessee. We identified consecutive ED visits with the diagnosis of anaphylaxis from 2017 to 2021 who received at least one intramuscular (IM) dose of epinephrine in the ED. Analysis was primarily descriptive. The primary outcome was cardiotoxicity, the occurrence of any of the following after epinephrine administration: ischemic electrocardiogram changes, systolic blood pressure >200 mmHg, or cardiac arrest ≤4 h; elevated troponin ≤12 h; or percutaneous coronary intervention or depressed ejection fraction ≤72 h. Results: Among 338 included patients, 16 (4.7%; 95%CI: 2.8-7.6%) experienced cardiotoxicity. Cardiotoxic events included eight (2.4%) ischemic electrocardiogram changes, six (1.8%) episodes of elevated troponin, five (1.5%) atrial arrhythmias, one (0.3%) ventricular arrythmia, and one (0.3%) depressed ejection fraction. Patients with cardiotoxicity were significantly older, had more comorbidities, and were more likely to have received multiple doses of epinephrine or an epinephrine infusion compared with a single IM dose of epinephrine. Conclusions: Among 338 consecutive adult ED patients who received IM epinephrine for anaphylaxis during a recent 4-year period, cardiotoxic side effects were observed in approximately 5% of patients.

Cefepime vs Piperacillin-Tazobactam in Adults Hospitalized With Acute Infection: The ACORN Randomized Clinical Trial.

Importance: Cefepime and piperacillin-tazobactam are commonly administered to hospitalized adults for empirical treatment of infection. Although piperacillin-tazobactam has been hypothesized to cause acute kidney injury and cefepime has been hypothesized to cause neurological dysfunction, their comparative safety has not been evaluated in a randomized clinical trial. Objective: To determine whether the choice between cefepime and piperacillin-tazobactam affects the risks of acute kidney injury or neurological dysfunction. Design, Setting, and Participants: The Antibiotic Choice on Renal Outcomes (ACORN) randomized clinical trial compared cefepime vs piperacillin-tazobactam in adults for whom a clinician initiated an order for antipseudomonal antibiotics within 12 hours of presentation to the hospital in the emergency department or medical intensive care unit at an academic medical center in the US between November 10, 2021, and October 7, 2022. The final date of follow-up was November 4, 2022. Interventions: Patients were randomized in a 1:1 ratio to cefepime or piperacillin-tazobactam. Main Outcomes and Measures: The primary outcome was the highest stage of acute kidney injury or death by day 14, measured on a 5-level ordinal scale ranging from no acute kidney injury to death. The 2 secondary outcomes were the incidence of major adverse kidney events at day 14 and the number of days alive and free of delirium and coma within 14 days. Results: There were 2511 patients included in the primary analysis (median age, 58 years [IQR, 43-69 years]; 42.7% were female; 16.3% were Non-Hispanic Black; 5.4% were Hispanic; 94.7% were enrolled in the emergency department; and 77.2% were receiving vancomycin at enrollment). The highest stage of acute kidney injury or death was not significantly different between the cefepime group and the piperacillin-tazobactam group; there were 85 patients (n = 1214; 7.0%) in the cefepime group with stage 3 acute kidney injury and 92 (7.6%) who died vs 97 patients (n = 1297; 7.5%) in the piperacillin-tazobactam group with stage 3 acute kidney injury and 78 (6.0%) who died (odds ratio, 0.95 [95% CI, 0.80 to 1.13], P = .56). The incidence of major adverse kidney events at day 14 did not differ between groups (124 patients [10.2%] in the cefepime group vs 114 patients [8.8%] in the piperacillin-tazobactam group; absolute difference, 1.4% [95% CI, -1.0% to 3.8%]). Patients in the cefepime group experienced fewer days alive and free of delirium and coma within 14 days (mean [SD], 11.9 [4.6] days vs 12.2 [4.3] days in the piperacillin-tazobactam group; odds ratio, 0.79 [95% CI, 0.65 to 0.95]). Conclusions and Relevance: Among hospitalized adults in this randomized clinical trial, treatment with piperacillin-tazobactam did not increase the incidence of acute kidney injury or death. Treatment with cefepime resulted in more neurological dysfunction. Trial Registration: ClinicalTrials.gov Identifier: NCT05094154.

Using intervention mapping to design and implement a multicomponent intervention to improve antibiotic and NSAID prescribing.

Successfully changing prescribing behavior to reduce inappropriate antibiotic and nonsteroidal anti-inflammatory drug (NSAID) prescriptions often requires combining components into a multicomponent intervention. However, multicomponent interventions often fail because of development and implementation complexity. To increase the likelihood of successfully changing prescribing behavior, we applied a systematic process to design and implement a multicomponent intervention. We used Intervention Mapping to create a roadmap for a multicomponent intervention in unscheduled outpatient care settings in the Veterans Health Administration. Intervention Mapping is a systematic process consisting of six steps that we grouped into three phases: (i) understand behavioral determinants and barriers to implementation, (ii) develop the intervention, and (iii) define evaluation plan and implementation strategies. A targeted literature review, combined with 25 prescriber and 25 stakeholder interviews, helped identify key behavioral determinants to inappropriate prescribing (e.g. perceived social pressure from patients to prescribe). We targeted three desired prescriber behaviors: (i) review guideline-concordant prescribing and patient outcomes, (ii) manage diagnostic and treatment uncertainty, and (iii) educate patients and caregivers. The intervention consisted of components for academic detailing, prescribing feedback, and alternative prescription order sets. Implementation strategies consisted of preparing clinical champions, conducting readiness assessments, and incentivizing use of the intervention. We chose a mixed-method study design with a commonly used evaluation framework to assess effectiveness and implementation outcomes in a subsequent trial. This study furthers knowledge about causes of inappropriate antibiotic and NSAID prescribing and demonstrates how theoretical, empirical, and practical information can be systematically applied to develop a multicomponent intervention to help address these causes.

Reducing adverse drug events from antibiotics and nonsteroidal anti-inflammatory drugs (NSAIDs) is a patient safety priority. Successfully changing prescribing behavior to reduce inappropriate prescriptions can require combining intervention components, each with different mechanisms for behavior change, into a multicomponent intervention. However, multicomponent interventions often fail because of development and implementation complexity. To increase the chance of successfully changing antibiotic and NSAID prescribing, the objective this study was to apply a systematic process to design and implement a multicomponent intervention. Three desired prescriber behaviors were targeted: (i) review guideline-concordant prescribing and patient outcomes, (ii) manage diagnostic and treatment uncertainty, and (iii) educate patients and caregivers. The designed intervention consisted of components for prescribing feedback, academic detailing, and alternative prescription order sets. Strategies to improve use of the intervention consisted of preparing clinical champions, conducting readiness assessments prior to study onset, and incentivizing use of the intervention. We chose a mixed-method study design with a commonly used evaluation framework to assess effectiveness and implementation outcomes of the multicomponent intervention in a subsequent trial.

Limitations in the use of automated mental status detection for clinical decision support.

BACKGROUND: Clinical decision support (CDS) tools improve adherence to evidence-based practices but are dependent upon data quality in the electronic health record (EHR). Mental status is an integral component of many risk stratification scores, but it is not known whether EHR-measures of altered mental status are reliable. The Glasgow Coma Scale (GCS) is a measure of altered mentation that is widely adopted and entered in the EHR in structured format. We sought to determine the accuracy GCS < 15 as an EHR-measure of altered mentation compared to ED provider documentation. METHODS: In patients presenting to an academic Emergency Department (ED) with pneumonia we abstracted GCS values entered by nurses during routine care and in a randomly selected subset manually reviewed provider documentation for evidence of altered mental status. We defined eConfusion as present if GCS < 15 at any point during the ED encounter. We then calculated the CURB-65 score and corresponding suggested disposition using each method. Performance of eConfusion and corresponding CURB-65 compared to manual versions was measured using agreement (Cohen's K), sensitivity, and specificity. RESULTS: Among 300 randomly selected encounters, 47 (16 %) had eConfusion present and 46 (15 %) had evidence of altered mental status in provider documentation with Cohen's K 0.73. eConfusion had 78 % sensitivity and 96 % specificity for provider documented altered mental status. When input into CURB-65 to recommend inpatient disposition, eConfusion had 95 % sensitivity, and recommended discordant disposition for 3 %. CONCLUSIONS: There was modest agreement between eConfusion and provider documentation of altered mental status. eConfusion had good specificity but low sensitivity which resulted in under-estimation of the CURB-65 score and occasional inappropriate disposition recommendations compared to provider documentation. These data do not support the use of GCS as a measure for altered mentation for use in CDS tools in the ED.

Randomized controlled trial of urinE chemiStry guided aCute heArt faiLure treATmEnt (ESCALATE): Rationale and design.

Diuresis to achieve decongestion is a central aim of therapy in patients hospitalized for acute decompensated heart failure (ADHF). While multiple clinical trials have investigated initial diuretic strategies for a designated period of time, there is a paucity of evidence to guide diuretic titration strategies continued until decongestion is achieved. The use of urine chemistries (urine sodium and creatinine) in a natriuretic response prediction equation accurately estimates natriuresis in response to diuretic dosing, but a randomized clinical trial is needed to compare a urine chemistry-guided diuresis strategy with a strategy of usual care. The urinE chemiStry guided aCute heArt faiLure treATmEnt (ESCALATE) trial is designed to test the hypothesis that protocolized diuretic therapy guided by spot urine chemistry through completion of intravenous diuresis will be superior to usual care and improve outcomes over the 14 days following randomization. ESCALATE will randomize and obtain complete data on 450 patients with acute heart failure to a diuretic strategy guided by urine chemistry or a usual care strategy. Key inclusion criteria include an objective measure of hypervolemia with at least 10 pounds of estimated excess volume, and key exclusion criteria include significant valvular stenosis, hypotension, and a chronic need for dialysis. Our primary outcome is days of benefit over the 14 days after randomization. Days of benefit combines patient symptoms captured by global clinical status with clinical state quantifying the need for hospitalization and intravenous diuresis. CLINICAL TRIAL REGISTRATION: NCT04481919.

Trends in paediatric firearm-related encounters during the COVID-19 pandemic by age group, race/ethnicity and schooling mode in Tennessee.

BACKGROUND: Increases in paediatric firearm-related injuries during the COVID-19 pandemic may be due to changes in where children and adolescents spent their time. This study examines changes in the frequency of paediatric firearm-related encounters as a function of schooling mode overall and by race/ethnicity and age group at a large trauma centre through 2021. METHODS: We use data from a large paediatric and adult trauma centre in Tennessee from January 2018 to December 2021 (N=211 encounters) and geographically linked schooling mode data. We use Poisson regressions to estimate smoothed monthly paediatric firearm-related encounters as a function of schooling mode overall and stratified by race and age. RESULTS: Compared with pre pandemic, we find a 42% increase in paediatric encounters per month during March 2020 to August 2020, when schools were closed, no significant increase during virtual/hybrid instruction, and a 23% increase in encounters after schools returned to in-person instruction. The effects of schooling mode are heterogeneous by patient race/ethnicity and age. Encounters increased among non-Hispanic black children across all periods relative to pre pandemic. Among non-Hispanic white children, encounters increased during the closure period and decreased on return to in-person instruction. Compared with pre pandemic, paediatric firearm-related encounters increased 205% for children aged 5-11 and 69% for adolescents aged 12-15 during the school closure period. CONCLUSION: COVID-19-related changes to school instruction mode in 2020 and 2021 are associated with changes in the frequency and composition of paediatric firearm-related encounters at a major trauma centre in Tennessee.

Protocol and statistical analysis plan for the Antibiotic Choice On ReNal outcomes (ACORN) randomised clinical trial.

INTRODUCTION: Antibiotics are time-critical in the management of sepsis. When infectious organisms are unknown, patients are treated with empiric antibiotics to include coverage for gram-negative organisms, such as antipseudomonal cephalosporins and penicillins. However, in observational studies, some antipseudomonal cephalosporins (eg, cefepime) are associated with neurologic dysfunction while the most common antipseudomonal penicillin (piperacillin-tazobactam) is associated with acute kidney injury (AKI). No randomised control trials have compared these regimens. This manuscript describes the protocol and analysis plan for a trial designed to compare the effects of antipseudomonal cephalosporins and antipseudomonal penicillins among acutely ill patients receiving empiric antibiotics. METHODS AND ANALYSIS: The Antibiotic Choice On ReNal outcomes trial is a prospective, single-centre, non-blinded randomised trial being conducted at Vanderbilt University Medical Center. The trial will enrol 2500 acutely ill adults receiving gram-negative coverage for treatment of infection. Eligible patients are randomised 1:1 to receive cefepime or piperacillin-tazobactam on first order entry of a broad-spectrum antibiotic covering gram-negative organisms. The primary outcome is the highest stage of AKI and death occurring between enrolment and 14 days after enrolment. This will be compared between patients randomised to cefepime and randomised to piperacillin-tazobactam using an unadjusted proportional odds regression model. The secondary outcomes are major adverse kidney events through day 14 and number of days alive and free of delirium and coma in 14 days after enrolment. Enrolment began on 10 November 2021 and is expected to be completed in December 2022. ETHICS AND DISSEMINATION: The trial was approved by the Vanderbilt University Medical Center institutional review board (IRB#210591) with a waiver of informed consent. Results will be submitted to a peer-reviewed journal and presented at scientific conferences. TRIAL REGISTRATION NUMBER: NCT05094154.

COVID-19 severity from Omicron and Delta SARS-CoV-2 variants.

The Omicron variant of SARS-CoV-2 achieved worldwide dominance in late 2021. Early work suggests that infections caused by the Omicron variant may be less severe than those caused by the Delta variant. We sought to compare clinical outcomes of infections caused by these two strains, confirmed by whole genome sequencing, over a short period of time, from respiratory samples collected from SARS-CoV-2 positive patients at a large medical center. We found that infections caused by the Omicron variant caused significantly less morbidity, including admission to the hospital and requirement for oxygen supplementation, and significantly less mortality than those caused by the Delta variant.

Do Patient-specific or Fracture-specific Factors Predict the Development of Acute Compartment Syndrome After Pediatric Tibial Shaft Fractures?

BACKGROUND: Tibial shaft fractures are the most common injuries preceding acute compartment syndrome (ACS), so it is important to understand the incidence of and risk factors for ACS after pediatric tibial shaft fractures. The purposes of this study were to determine the rate at which ACS occurs and if any patient or fracture characteristics are significantly associated with developing ACS. METHODS: All patients aged 5 to 17 years treated for a tibial shaft fracture at a level 1 pediatric trauma center, a level 1 adult trauma center, and an outpatient orthopaedic practice between 2008 and 2016 were retrospectively identified. Demographics, mechanisms of injury, and fracture characteristics were collected from the medical records. Radiographs were reviewed by study authors. ACS was diagnosed clinically or by intracompartmental pressure measurement. Univariable analysis was performed using the Fisher exact test for nominal variables and simple logistic regression for continuous variables. Multivariable analysis was performed using stepwise logistic regression. RESULTS: Among 515 patients with 517 tibial shaft fractures, 9 patients (1.7%) with 10 (1.9%) fractures developed ACS at a mean age of 15.2 years compared with a mean age of 11 years in patients without ACS (P=0.001). One patient with bilateral tibial fractures developed ACS bilaterally. Age greater than 14 years (P=0.006), higher body mass index (P<0.001), motorcycle or motor vehicle accidents (P=0.034), comminuted and segmental tibial shaft fractures (P<0.001), ipsilateral fibular fracture (P=0.002), and associated orthopaedic injuries (P=0.032) were all significantly more common in the ACS group. CONCLUSIONS: ACS developed in 1.7% of the patients with tibial shaft fractures in this retrospective study-a rate significantly lower than previously reported. Age greater than 14 years, higher body mass index, motor vehicle or motorcycle accidents, comminuted or segmental fracture pattern, ipsilateral fibular fracture, and associated orthopaedic injuries are all significantly associated with its development. LEVELS OF EVIDENCE: Level III-retrospective comparative study.

Automatic scoring of medical students' clinical notes to monitor learning in the workplace.

BACKGROUND: Educators need efficient and effective means to track students' clinical experiences to monitor their progress toward competency goals. AIM: To validate an electronic scoring system that rates medical students' clinical notes for relevance to priority topics of the medical school curriculum. METHOD: The Vanderbilt School of Medicine Core Clinical Curriculum enumerates 25 core clinical problems (CCP) that graduating medical students must understand. Medical students upload clinical notes pertinent to each CCP to a web-based dashboard, but criteria for determining relevance of a note and consistent uploading practices by students are lacking. The Vanderbilt Learning Portfolio (VLP) system automates both tasks by rating relevance for each CCP and uploading the note to the student's electronic dashboard. We validated this electronic scoring system by comparing the relevance of 265 clinical notes written by third year medical students to each of the 25 core patient problems as scored by VLP verses an expert panel of raters. RESULTS: We established the threshold score which yielded 75% positive prediction of relevance for 16 of the 25 clinical problems to expert opinion. DISCUSSION: Automated scoring of student's clinical notes provides a novel, efficient and standardized means of tracking student's progress toward institutional competency goals.

Automated Assessment of Medical Students' Clinical Exposures according to AAMC Geriatric Competencies.

Competence is essential for health care professionals. Current methods to assess competency, however, do not efficiently capture medical students' experience. In this preliminary study, we used machine learning and natural language processing (NLP) to identify geriatric competency exposures from students' clinical notes. The system applied NLP to generate the concepts and related features from notes. We extracted a refined list of concepts associated with corresponding competencies. This system was evaluated through 10-fold cross validation for six geriatric competency domains: "medication management (MedMgmt)", "cognitive and behavioral disorders (CBD)", "falls, balance, gait disorders (Falls)", "self-care capacity (SCC)", "palliative care (PC)", "hospital care for elders (HCE)" - each an American Association of Medical Colleges competency for medical students. The systems could accurately assess MedMgmt, SCC, HCE, and Falls competencies with F-measures of 0.94, 0.86, 0.85, and 0.84, respectively, but did not attain good performance for PC and CBD (0.69 and 0.62 in F-measure, respectively).

Assessing Electronic Note Quality Using the Physician Documentation Quality Instrument (PDQI-9).

OBJECTIVE: To refine the Physician Documentation Quality Instrument (PDQI) and test the validity and reliability of the 9-item version (PDQI-9). METHODS: Three sets each of admission notes, progress notes and discharge summaries were evaluated by two groups of physicians using the PDQI-9 and an overall general assessment: one gold standard group consisting of program or assistant program directors (n=7), and the other of attending physicians or chief residents (n=24). The main measures were criterion-related validity (correlation coefficients between Total PDQI-9 scores and 1-item General Impression scores for each note), discriminant validity (comparison of PDQI-9 scores on notes rated as best and worst using 1-item General Impression score), internal consistency reliability (Cronbach's alpha), and inter-rater reliability (intraclass correlation coefficient (ICC)). RESULTS: The results were criterion-related validity (r = -.678 to .856), discriminant validity (best versus worst note, t = 9.3, p = .003), internal consistency reliability (Cronbach's alphas = .87-.94), and inter-rater reliability (ICC = .83, CI = .72-.91). CONCLUSION: The results support the criterion-related and discriminant validity, internal consistency reliability, and inter-rater reliability of the PDQI-9 for rating the quality of electronic physician notes. Tools for assessing note redundancy are required to complement use of PDQI-9. Trials of the PDQI-9 at other institutions, of different size, using different EHRs, and incorporating additional physician specialties and notes of other healthcare providers are needed to confirm its generalizability.