Natural Language Processing Versus Diagnosis Code-Based Methods for Postherpetic Neuralgia Identification: Algorithm Development and Validation.

Background: Diagnosis codes and prescription data are used in algorithms to identify postherpetic neuralgia (PHN), a debilitating complication of herpes zoster (HZ). Because of the questionable accuracy of codes and prescription data, manual chart review is sometimes used to identify PHN in electronic health records (EHRs), which can be costly and time-consuming. Objective: This study aims to develop and validate a natural language processing (NLP) algorithm for automatically identifying PHN from unstructured EHR data and to compare its performance with that of code-based methods. Methods: This retrospective study used EHR data from Kaiser Permanente Southern California, a large integrated health care system that serves over 4.8 million members. The source population included members aged ≥50 years who received an incident HZ diagnosis and accompanying antiviral prescription between 2018 and 2020 and had ≥1 encounter within 90-180 days of the incident HZ diagnosis. The study team manually reviewed the EHR and identified PHN cases. For NLP development and validation, 500 and 800 random samples from the source population were selected, respectively. The sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), F-score, and Matthews correlation coefficient (MCC) of NLP and the code-based methods were evaluated using chart-reviewed results as the reference standard. Results: The NLP algorithm identified PHN cases with a 90.9% sensitivity, 98.5% specificity, 82% PPV, and 99.3% NPV. The composite scores of the NLP algorithm were 0.89 (F-score) and 0.85 (MCC). The prevalences of PHN in the validation data were 6.9% (reference standard), 7.6% (NLP), and 5.4%-13.1% (code-based). The code-based methods achieved a 52.7%-61.8% sensitivity, 89.8%-98.4% specificity, 27.6%-72.1% PPV, and 96.3%-97.1% NPV. The F-scores and MCCs ranged between 0.45 and 0.59 and between 0.32 and 0.61, respectively. Conclusions: The automated NLP-based approach identified PHN cases from the EHR with good accuracy. This method could be useful in population-based PHN research.

Post-marketing safety study to evaluate pregnancy outcomes among recipients of hepatitis B vaccines.

HepB-CpG is a licensed adjuvanted two-dose hepatitis B vaccine for adults, with limited data on exposure during pregnancy. We assessed the risk of pregnancy outcomes among individuals who received HepB-CpG or the 3-dose HepB-alum vaccine ≤28 d prior to conception or during pregnancy at Kaiser Permanente Southern California (KPSC). The pregnancy cohort included KPSC members aged ≥18 y who received ≥1 dose of hepatitis B vaccine (HepB-CpG or HepB-alum) at KPSC outpatient family or internal medicine departments from August 2018 to November 2020. We followed these individuals through electronic health records from the vaccination date until the end of pregnancy, KPSC health plan disenrollment, or death, whichever came first. Among 81 and 125 eligible individuals who received HepB-CpG and HepB-alum, respectively, live births occurred in 84% and 74%, spontaneous abortion occurred in 7% and 17% (adjusted relative risk [aRR] 0.40, 95% CI: 0.16-1.00), and preterm birth occurred in 15% and 14% of liveborn infants (aRR 0.97, 95% CI 0.47-1.99). No major birth defects were identified through 6 months of age. The study found no evidence of adverse pregnancy outcomes for recipients of HepB-CpG in comparison to HepB-alum.

Effectiveness and durability of mRNA-1273 BA.4/BA.5 bivalent vaccine (mRNA-1273.222) against SARS-CoV-2 BA.4/BA.5 and XBB sublineages.

Emerging SARS-CoV-2 sublineages continue to cause serious COVID-19 disease, but most individuals have not received any COVID-19 vaccine for >1 year. Assessment of long-term effectiveness of bivalent COVID-19 vaccines against circulating sublineages is important to inform the potential need for vaccination with updated vaccines. In this test-negative study at Kaiser Permanente Southern California, sequencing-confirmed BA.4/BA.5- or XBB-related SARS-CoV-2-positive cases (September 1, 2022 to June 30, 2023), were matched 1:3 to SARS-CoV-2-negative controls. We assessed mRNA-1273 bivalent relative (rVE) and absolute vaccine effectiveness (VE) compared to ≥2 or 0 doses of original monovalent vaccine, respectively. The rVE analysis included 20,966 cases and 62,898 controls. rVE (95%CI) against BA.4/BA.5 at 14-60 days and 121-180 days was 52.7% (46.9-57.8%) and 35.5% (-2.8-59.5%) for infection, and 59.3% (49.7-67.0%) and 33.2% (-28.2-68.0%) for Emergency Department/Urgent Care (ED/UC) encounters. For BA.4/BA.5-related hospitalizations, rVE was 71.3% (44.9-85.1%) and 52.0% (-1.2-77.3%) at 14-60 days and 61-120 days, respectively. rVE against XBB at 14-60 days and 121-180 days was 48.8% (33.4-60.7%) and -3.9% (-18.1-11.3%) for infection, 70.7% (52.4-82.0%) and 15.7% (-6.0-33.2%) for ED/UC encounters, and 87.9% (43.8-97.4%) and 57.1% (17.0-77.8%) for hospitalization. VE and subgroup analyses (age, immunocompromised status, previous SARS-CoV-2 infection) results were similar to rVE analyses. rVE of mRNA-1273 bivalent vaccine against BA.4/BA.5 and XBB infections, ED/UC encounters, and hospitalizations waned over time. Periodic revaccination with vaccines targeting emerging variants may be important in reducing COVID-19 morbidity and mortality.

mRNA-1273 bivalent (original and Omicron) COVID-19 vaccine effectiveness against COVID-19 outcomes in the United States.

The bivalent (original and Omicron BA.4/BA.5) mRNA-1273 COVID-19 vaccine was authorized to offer broader protection against COVID-19. We conducted a matched cohort study to evaluate the effectiveness of the bivalent vaccine in preventing hospitalization for COVID-19 (primary outcome) and medically attended SARS-CoV-2 infection and hospital death (secondary outcomes). Compared to individuals who did not receive bivalent mRNA vaccination but received ≥2 doses of any monovalent mRNA vaccine, the relative vaccine effectiveness (rVE) against hospitalization for COVID-19 was 70.3% (95% confidence interval, 64.0%-75.4%). rVE was consistent across subgroups and not modified by time since last monovalent dose or number of monovalent doses received. Protection was durable ≥3 months after the bivalent booster. rVE against SARS-CoV-2 infection requiring emergency department/urgent care and against COVID-19 hospital death was 55.0% (50.8%-58.8%) and 82.7% (63.7%-91.7%), respectively. The mRNA-1273 bivalent booster provides additional protection against hospitalization for COVID-19, medically attended SARS-CoV-2 infection, and COVID-19 hospital death.

Dose Changes for Long-term Opioid Patients Following a State Opioid Prescribing Policy.

BACKGROUND: In 2018, Nevada implemented opioid prescribing legislation (AB474) to support the uptake of CDC pain care guidelines. We studied the law's association with doses over threshold levels of morphine milligram equivalents (MMEs) and with time to dose increases and decreases, among long-term opioid patients. METHODS: A difference-in-difference study examined dosing changes across opioid prescription episodes (ie, prescriptions within 30 day and within the same dosing threshold). Patients with at least 120 days supply over 6 months in Nevada and Colorado Medicaid pharmacy claims were included. Using a logistic regression model, we compare the predicted probabilities that opioid episodes exceeded 50 MME before and after implementation of the law, in both states. Adjusted hazard ratios (aHR) from a gap time survival model estimated time to escalate above 50 MME among low-dose episodes (<50 MME), and time to de-escalate below 50 MME among high-dose episodes (≥50 MME). RESULTS: Among 453,577 episodes (74,292 patients), the Nevada law was associated with a 2.9% reduction in prescriptions over 50 MME (95% CI: -3.5, -2.3) compared with Colorado. While the law was also associated with slower escalation (Nevada: aHR = 0.75; 95% CI: 0.72, 0.77, Colorado: aHR = 1.04; 95% CI: 1.01, 1.06), it was also associated with slower de-escalation (Nevada: aHR = 0.87; 95% CI: 0.84, 0.89, Colorado: aHR = 0.97; 95% CI: 0.96, 0.99). CONCLUSIONS: Slower dose escalations, rather than faster dose de-escalation, likely explain post-law reductions in doses over 50 MME. Slower dose de-escalations may be due to longer days supply post-policy.

Post-licensure safety study of new-onset immune-mediated diseases, herpes zoster, and anaphylaxis in adult recipients of HepB-CpG vaccine versus HepB-alum vaccine.

BACKGROUND: HepB-CpG (Heplisav-B) is a licensed hepatitis B vaccine with a novel adjuvant that requires 2 doses (0, 1 month) compared to HepB-alum (Engerix-B) which requires 3 doses (0, 1, 6 months). Monitoring safety outcomes following receipt of vaccines with novel adjuvants outside trial settings is important. Hence, as part of a post-marketing commitment, we compared the incidence of new-onset immune-mediated diseases, herpes zoster (HZ), and anaphylaxis among recipients of HepB-CpG versus HepB-alum. METHODS: This cohort study included adults not on dialysis who received ≥1 dose of hepatitis B vaccine from 8/7/2018 to 10/31/2019, during which HepB-CpG was routinely administered in 7 of 15 Kaiser Permanente Southern California medical centers while HepB-alum was administered in the other 8 centers. Recipients of HepB-CpG or HepB-alum were followed through electronic health records for 13 months for occurrence of pre-specified new-onset immune-mediated diseases, HZ, and anaphylaxis identified using diagnosis codes. Incidence rates were compared using Poisson regression with inverse probability of treatment weighting when there was ≥80 % power to detect a relative risk (RR) of 5 for anaphylaxis and RR of 3 for other outcomes. Chart review to confirm new-onset diagnosis was conducted for outcomes with statistically significant elevated risk. RESULTS: There were 31,183 HepB-CpG and 38,442 HepB-alum recipients (overall 49.0 % female, 48.5 % age ≥50 years, and 49.6 % Hispanic). Among immune-mediated events that occurred frequently enough for formal comparison, rates among HepB-CpG versus Hep-B-alum recipients were similar except for rheumatoid arthritis (RA) (adjusted RR 1.53 [95 % CI: 1.07, 2.18]). After chart confirmation of new-onset RA, the adjusted RR was 0.93 (0.34, 2.49). The adjusted RR for HZ was 1.06 (0.89, 1.27). Anaphylaxis occurred in 0 HepB-CpG and 2 HepB-alum recipients. CONCLUSIONS: This large post-licensure study did not identify evidence of safety concerns for HepB-CpG compared to HepB-alum for immune-mediated diseases, HZ, or anaphylaxis.

Effectiveness of a fourth dose of mRNA-1273 against COVID-19 among older adults in the United States: Interim results from an observational cohort study.

We evaluated relative vaccine effectiveness (rVE) of 4- vs. 3-dose mRNA-1273 against SARS-CoV-2 infection, and COVID-19 hospitalization and death in immunocompetent adults aged ≥50 years at Kaiser Permanente Southern California. We included 178,492 individuals who received a fourth dose of mRNA-1273, and 178,492 randomly selected 3-dose recipients who were matched to 4-dose recipients by age, sex, race/ethnicity, and third dose date. Adjusted 4- vs. 3-dose rVE against SARS-CoV-2 infection, COVID-19 hospitalization, and COVID-19 hospitalization death were 25.9 % (23.5 %, 28.2 %), 67.3 % (58.7 %, 74.1 %), and 72.5 % (-35.9 %, 95.2 %), respectively. Adjusted rVE against SARS-CoV-2 infection ranged between 19.8 % and 39.1 % across subgroups. Adjusted rVE against SARS-CoV-2 infection and COVID-19 hospitalization decreased 2-4 months after the fourth dose. Four mRNA-1273 doses provided significant protection against COVID-19 outcomes compared with 3 doses, consistent in various subgroups of demographic and clinical characteristics, although rVE varied and waned over time.

Vaccine effectiveness of the mRNA-1273 3-dose primary series against COVID-19 in an immunocompromised population: A prospective observational cohort study.

BACKGROUND: Data on the effectiveness of the 3-dose mRNA-1273 primary series are limited, particularly in comparison to 2 doses. Given suboptimal COVID-19 vaccine uptake among immunocompromised populations, it is important to monitor the effectiveness of fewer than the recommended doses in this population. METHODS: We conducted a matched cohort study at Kaiser Permanente Southern California to evaluate the relative vaccine effectiveness (rVE) of the 3-dose series vs 2 doses of mRNA-1273 in preventing SARS-CoV-2 infection and severe COVID-19 outcomes among immunocompromised individuals. RESULTS: We included 21,942 3-dose recipients who were 1:1 matched with randomly selected 2-dose recipients (third doses accrued 08/12/2021-12/31/2021, with follow-up through 01/31/2022). Adjusted rVE of 3 vs 2 doses of mRNA-1273 against SARS-CoV-2 infection, COVID-19 hospitalization, and COVID-19 hospital death were 55.0 % (95 % CI: 50.8-58.9 %), 83.0 % (75.4-88.3 %), and 87.1 % (30.6-97.6 %), respectively. CONCLUSION: Three doses of mRNA-1273 were associated with a significantly higher rVE against SARS-CoV-2 infection and severe outcomes, compared to 2 doses. These findings were consistent across subgroups of demographic and clinical characteristics, and mostly consistent across subgroups of immunocompromising conditions. Our study highlights the importance of completing the 3-dose series for immunocompromised populations.

Effectiveness of mRNA-1273 vaccination against SARS-CoV-2 omicron subvariants BA.1, BA.2, BA.2.12.1, BA.4, and BA.5.

Studies have reported reduced natural SARS-CoV-2 infection- and vaccine-induced neutralization against omicron BA.4/BA.5 compared with earlier omicron subvariants. This test-negative case-control study evaluates mRNA-1273 vaccine effectiveness (VE) against infection and hospitalization with omicron subvariants. The study includes 30,809 SARS-CoV-2 positive and 92,427 SARS-CoV-2 negative individuals aged ≥18 years tested during 1/1/2022-6/30/2022. While 3-dose VE against BA.1 infection is high and wanes slowly, VE against BA.2, BA.2.12.1, BA.4, and BA.5 infection is initially moderate to high (61.0%-90.6% 14-30 days post third dose) and wanes rapidly. The 4-dose VE against infection with BA.2, BA.2.12.1, and BA.4 ranges between 64.3%-75.7%, and is low (30.8%) against BA.5 14-30 days post fourth dose, disappearing beyond 90 days for all subvariants. The 3-dose VE against hospitalization for BA.1, BA.2, and BA.4/BA.5 is 97.5%, 82.0%, and 72.4%, respectively; 4-dose VE against hospitalization for BA.4/BA.5 is 88.5%. Evaluation of the updated bivalent booster is warranted.

Effectiveness of Messenger RNA-1273 Vaccine Booster Against Coronavirus Disease 2019 in Immunocompetent Adults.

BACKGROUND: We conducted a prospective cohort study at Kaiser Permanente Southern California to evaluate the relative vaccine effectiveness (rVE) of a booster dose vs 2-dose primary series of messenger RNA (mRNA)-1273 in immunocompetent individuals. METHODS: Immunocompetent adults who received a booster dose of mRNA-1273 from October 2021 through December 2021 were matched 1:1 to randomly selected 2-dose mRNA-1273 recipients by age, sex, race/ethnicity, and second-dose date and followed up through January 2022. Cox proportional hazards models were used to estimate adjusted hazard ratios (aHRs) with 95% confidence intervals (CIs), comparing outcomes (severe acute respiratory syndrome coronavirus 2 [SARS-CoV-2] infection and coronavirus disease 2019 [COVID-19] hospitalization and hospital death) in the booster-dose and 2-dose groups. Adjusted rVE (%) was calculated as (1 - aHR) × 100. aHRs and rVE were also estimated by subgroup and month of follow-up. RESULTS: The study included 431 328 booster-dose vaccinated adults matched to 431 328 2-dose vaccinated adults. rVE was 61.3% (95% CI: 60.5%-62.2%) against SARS-CoV-2 infection, 89.0% (86.2%-91.2%) against COVID-19 hospitalization, and 96.0% (68.0%-99.5%) against COVID-19 hospital death. rVE against SARS-CoV-2 infection ranged from 55.6% to 66.7% across all subgroups. rVE against SARS-CoV-2 infection decreased from 67.1% (0 to <1 month of follow-up) to 30.5% (2 to <3 months). For COVID-19 hospitalization, rVE decreased from 91.2% (0 to <1 month) to 78.7% (2 to <3 months). CONCLUSIONS: Among immunocompetent adults, the mRNA-1273 booster conferred additional protection against SARS-CoV-2 infection and severe COVID-19 disease compared with the 2-dose mRNA-1273 primary series during periods of Delta and Omicron predominance.