RESUMO
From the start of the coronavirus disease 2019 (COVID-19) pandemic, researchers have looked to electronic health record (EHR) data as a way to study possible risk factors and outcomes. To ensure the validity and accuracy of research using these data, investigators need to be confident that the phenotypes they construct are reliable and accurate, reflecting the healthcare settings from which they are ascertained. We developed a COVID-19 registry at a single academic medical center and used data from March 1 to June 5, 2020 to assess differences in population-level characteristics in pandemic and non-pandemic years respectively. Median EHR length, previously shown to impact phenotype performance in type 2 diabetes, was significantly shorter in the SARS-CoV-2 positive group relative to a 2019 influenza tested group (median 3.1 years vs 8.7; Wilcoxon rank sum P = 1.3e-52). Using three phenotyping methods of increasing complexity (billing codes alone and domain-specific algorithms provided by an EHR vendor and clinical experts), common medical comorbidities were abstracted from COVID-19 EHRs, defined by the presence of a positive laboratory test (positive predictive value 100%, recall 93%). After combining performance data across phenotyping methods, we observed significantly lower false negative rates for those records billed for a comprehensive care visit (p = 4e-11) and those with complete demographics data recorded (p = 7e-5). In an early COVID-19 cohort, we found that phenotyping performance of nine common comorbidities was influenced by median EHR length, consistent with previous studies, as well as by data density, which can be measured using portable metrics including CPT codes. Here we present those challenges and potential solutions to creating deeply phenotyped, acute COVID-19 cohorts.
Assuntos
COVID-19/diagnóstico , Registros Eletrônicos de Saúde , Fenótipo , Comorbidade , Diabetes Mellitus Tipo 2 , Saúde Global , Humanos , Influenza Humana , Funções Verossimilhança , PandemiasRESUMO
OBJECTIVE: Identifying symptoms and characteristics highly specific to coronavirus disease 2019 (COVID-19) would improve the clinical and public health response to this pandemic challenge. Here, we describe a high-throughput approach - Concept-Wide Association Study (ConceptWAS) - that systematically scans a disease's clinical manifestations from clinical notes. We used this method to identify symptoms specific to COVID-19 early in the course of the pandemic. METHODS: We created a natural language processing pipeline to extract concepts from clinical notes in a local ER corresponding to the PCR testing date for patients who had a COVID-19 test and evaluated these concepts as predictors for developing COVID-19. We identified predictors from Firth's logistic regression adjusted by age, gender, and race. We also performed ConceptWAS using cumulative data every two weeks to identify the timeline for recognition of early COVID-19-specific symptoms. RESULTS: We processed 87,753 notes from 19,692 patients subjected to COVID-19 PCR testing between March 8, 2020, and May 27, 2020 (1,483 COVID-19-positive). We found 68 concepts significantly associated with a positive COVID-19 test. We identified symptoms associated with increasing risk of COVID-19, including "anosmia" (odds ratio [OR] = 4.97, 95% confidence interval [CI] = 3.21-7.50), "fever" (OR = 1.43, 95% CI = 1.28-1.59), "cough with fever" (OR = 2.29, 95% CI = 1.75-2.96), and "ageusia" (OR = 5.18, 95% CI = 3.02-8.58). Using ConceptWAS, we were able to detect loss of smell and loss of taste three weeks prior to their inclusion as symptoms of the disease by the Centers for Disease Control and Prevention (CDC). CONCLUSION: ConceptWAS, a high-throughput approach for exploring specific symptoms and characteristics of a disease like COVID-19, offers a promise for enabling EHR-powered early disease manifestations identification.
Assuntos
COVID-19/diagnóstico , Processamento de Linguagem Natural , Avaliação de Sintomas/métodos , Adulto , Ageusia , Teste de Ácido Nucleico para COVID-19 , Tosse , Feminino , Febre , Humanos , Masculino , Pessoa de Meia-Idade , Pandemias , Estados UnidosRESUMO
OBJECTIVE: During the COVID-19 pandemic, health systems postponed non-essential medical procedures to accommodate surge of critically-ill patients. The long-term consequences of delaying procedures in response to COVID-19 remains unknown. We developed a high-throughput approach to understand the impact of delaying procedures on patient health outcomes using electronic health record (EHR) data. MATERIALS AND METHODS: We used EHR data from Vanderbilt University Medical Center's (VUMC) Research and Synthetic Derivatives. Elective procedures and non-urgent visits were suspended at VUMC between March 18, 2020 and April 24, 2020. Surgical procedure data from this period were compared to a similar timeframe in 2019. Potential adverse impact of delay in cardiovascular and cancer-related procedures was evaluated using EHR data collected from January 1, 1993 to March 17, 2020. For surgical procedure delay, outcomes included length of hospitalization (days), mortality during hospitalization, and readmission within six months. For screening procedure delay, outcomes included 5-year survival and cancer stage at diagnosis. RESULTS: We identified 416 surgical procedures that were negatively impacted during the COVID-19 pandemic compared to the same timeframe in 2019. Using retrospective data, we found 27 significant associations between procedure delay and adverse patient outcomes. Clinician review indicated that 88.9% of the significant associations were plausible and potentially clinically significant. Analytic pipelines for this study are available online. CONCLUSION: Our approach enables health systems to identify medical procedures affected by the COVID-19 pandemic and evaluate the effect of delay, enabling them to communicate effectively with patients and prioritize rescheduling to minimize adverse patient outcomes.
Assuntos
COVID-19/epidemiologia , Doenças Cardiovasculares/diagnóstico , Doenças Cardiovasculares/cirurgia , Neoplasias/diagnóstico , Neoplasias/cirurgia , Pandemias , Tempo para o Tratamento , Adulto , COVID-19/virologia , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Estudos Retrospectivos , SARS-CoV-2/isolamento & purificaçãoRESUMO
PURPOSE: The primary objective of this study was to reproduce and validate the harvest, processing and storage of peripheral blood stem cells for a subsequent cartilage repair trial, evaluating safety, reliability, and potential to produce viable, sterile stem cells. METHODS: Ten healthy subjects (aged 19-44 years) received 3 consecutive daily doses of filgrastim followed by an apheresis harvest of mononuclear cells on a fourth day. In a clean room, the apheresis product was prepared for cryopreservation and processed into 4 mL aliquots. Sterility and qualification testing were performed pre-processing and post-processing at multiple time points out to 2 years. Eight samples were shipped internationally to validate cell transport potential. One sample from all participants was cultured to test proliferative potential with colony forming unit (CFU) assay. Five samples, from 5 participants were tested for differentiation potential, including chondrogenic, adipogenic, osteogenic, endoderm, and ectoderm assays. RESULTS: Fresh aliquots contained an average of 532.9 ± 166. × 106 total viable cells/4 mL vial and 2.1 ± 1.0 × 106 CD34+ cells/4 mL vial. After processing for cryopreservation, the average cell count decreased to 331.3 ± 79. × 106 total viable cells /4 mL vial and 1.5 ± 0.7 × 106 CD34+ cells/4 mL vial CD34+ cells. Preprocessing viability averaged 99% and postprocessing 88%. Viability remained constant after cryopreservation at all subsequent time points. All sterility testing was negative. All samples showed proliferative potential, with average CFU count 301.4 ± 63.9. All samples were pluripotent. CONCLUSIONS: Peripheral blood stem cells are pluripotent and can be safely harvested/stored with filgrastim, apheresis, clean-room processing, and cryopreservation. These cells can be stored for 2 years and shipped without loss of viability. CLINICAL RELEVANCE: This method represents an accessible stem cell therapy in development to augment cartilage repair.
Assuntos
Remoção de Componentes Sanguíneos , Células-Tronco de Sangue Periférico , Cartilagem , Ensaio de Unidades Formadoras de Colônias , Humanos , Reprodutibilidade dos TestesRESUMO
PURPOSE: The purpose of this study was to evaluate the safety and efficacy of intra-articular injections of autologous peripheral blood stem cells (PBSCs) plus hyaluronic acid (HA) after arthroscopic subchondral drilling into massive chondral defects of the knee joint and to determine whether PBSC therapy can improve functional outcome and reduce pain of the knee joint better than HA plus physiotherapy. METHODS: This is a dual-center randomized controlled trial (RCT). Sixty-nine patients aged 18 to 55 years with International Cartilage Repair Society grade 3 and 4 chondral lesions (size ≥3 cm2) of the knee joint were randomized equally into (1) a control group receiving intra-articular injections of HA plus physiotherapy and (2) an intervention group receiving arthroscopic subchondral drilling into chondral defects and postoperative intra-articular injections of PBSCs plus HA. The coprimary efficacy endpoints were subjective International Knee Documentation Committee (IKDC) and Knee Injury and Osteoarthritis Outcome Score (KOOS)-pain subdomain measured at month 24. The secondary efficacy endpoints included all other KOOS subdomains, Numeric Rating Scale (NRS), and Magnetic Resonance Observation of Cartilage Repair Tissue (MOCART) scores. RESULTS: At 24 months, the mean IKDC scores for the control and intervention groups were 48.1 and 65.6, respectively (P < .0001). The mean for KOOS-pain subdomain scores were 59.0 (control) and 86.0 (intervention) with P < .0001. All other KOOS subdomain, NRS, and MOCART scores were statistically significant (P < .0001) at month 24. Moreover, for the intervention group, 70.8% of patients had IKDC and KOOS-pain subdomain scores exceeding the minimal clinically important difference values, indicating clinical significance. There were no notable adverse events that were unexpected and related to the study drug or procedures. CONCLUSIONS: Arthroscopic marrow stimulation with subchondral drilling into massive chondral defects of the knee joint followed by postoperative intra-articular injections of autologous PBSCs plus HA is safe and showed a significant improvement of clinical and radiologic scores compared with HA plus physiotherapy. LEVEL OF EVIDENCE: Level I, RCT.
Assuntos
Artroplastia Subcondral , Cartilagem Articular , Células-Tronco de Sangue Periférico , Cartilagem Articular/cirurgia , Seguimentos , Humanos , Ácido Hialurônico , Articulação do Joelho/cirurgia , Modalidades de FisioterapiaRESUMO
This Viewpoint posits that to improve public understanding of the system, the Vaccine Adverse Event Reporting System (VAERS) could use a more accurate name, well-defined guidance about the reporting system's nature and use, and comprehensible information about an event's verification status.
Assuntos
Sistemas de Notificação de Reações Adversas a Medicamentos , Comunicação , Vacinas , Estados Unidos , Vacinas/efeitos adversosRESUMO
Biofilm organisms such as diatoms are potential regulators of global macrofouling dispersal because they ubiquitously colonize submerged surfaces, resist antifouling efforts and frequently alter larval recruitment. Although ships continually deliver biofilms to foreign ports, it is unclear how transport shapes biofilm microbial structure and subsequent macrofouling colonization. This study demonstrates that different ship hull coatings and transport methods change diatom assemblage composition in transported coastal marine biofilms. Assemblages carried on the hull experienced significant cell losses and changes in composition through hydrodynamic stress, whereas those that underwent sheltered transport, even through freshwater, were largely unaltered. Coatings and their associated biofilms shaped distinct macrofouling communities and affected recruitment for one third of all species, while biofilms from different transport treatments had little effect on macrofouling colonization. These results demonstrate that transport conditions can shape diatom assemblages in biofilms carried by ships, but the properties of the underlying coatings are mainly responsible for subsequent macrofouling. The methods by which organisms colonize and are transferred by ships have implications for their distribution, establishment and invasion success.
Assuntos
Biofilmes/crescimento & desenvolvimento , Incrustação Biológica/prevenção & controle , Diatomáceas/crescimento & desenvolvimento , Navios , Diatomáceas/fisiologia , Florida , Água Doce/química , Hidrodinâmica , Salinidade , Água do Mar/química , Estresse FisiológicoRESUMO
Adults with type 2 diabetes (T2DM) and low socioeconomic status (SES) have high rates of medication nonadherence, and, in turn, suboptimal glycemic control (hemoglobin A1c [HbA1c]). We tested the initial efficacy of a short message service (SMS) text messaging and interactive voice response (IVR) intervention to promote adherence among this high-risk group. Eighty low SES, diverse adults with T2DM used the MEssaging for Diabetes (MED) SMS/IVR intervention for 3 months. We used a pre-post single group design to explore adherence changes over 3 months, and a quasi-experimental design to test the impact of MED on HbA1c among the intervention group relative to a matched, archival control group. Compared to baseline, adherence improved at one (AOR 3.88, 95 % CI 1.79, 10.86) and at 2 months (AOR 3.76, 95 % CI 1.75, 17.44), but not at 3 months. HbA1c remained stable, with no differences at 3 months between the intervention group and the control group. MED had a positive, short-term impact on adherence, which did not translate to improvements in HbA1c. Future research should explore the longer-term impact of SMS/IVR interventions on the medication adherence of high risk adults with T2DM.
Assuntos
Adesão à Medicação , Envio de Mensagens de Texto , Adulto , Estudos de Casos e Controles , Diabetes Mellitus Tipo 2/sangue , Diabetes Mellitus Tipo 2/tratamento farmacológico , Feminino , Hemoglobinas Glicadas/metabolismo , Humanos , Masculino , Pessoa de Meia-Idade , Classe SocialRESUMO
BACKGROUND: Asthma is one of the most common childhood illnesses. Guideline-driven clinical care positively affects patient outcomes for care. There are several asthma guidelines and reminder methods for implementation to help integrate them into clinical workflow. Our goal is to determine the most prevalent method of guideline implementation; establish which methods significantly improved clinical care; and identify the factors most commonly associated with a successful and sustainable implementation. METHODS: PUBMED (MEDLINE), OVID CINAHL, ISI Web of Science, and EMBASE. STUDY SELECTION: Studies were included if they evaluated an asthma protocol or prompt, evaluated an intervention, a clinical trial of a protocol implementation, and qualitative studies as part of a protocol intervention. Studies were excluded if they had non-human subjects, were studies on efficacy and effectiveness of drugs, did not include an evaluation component, studied an educational intervention only, or were a case report, survey, editorial, letter to the editor. RESULTS: From 14,478 abstracts, we included 101 full-text articles in the analysis. The most frequent study design was pre-post, followed by prospective, population based case series or consecutive case series, and randomized trials. Paper-based reminders were the most frequent with fully computerized, then computer generated, and other modalities. No study reported a decrease in health care practitioner performance or declining patient outcomes. The most common primary outcome measure was compliance with provided or prescribing guidelines, key clinical indicators such as patient outcomes or quality of life, and length of stay. CONCLUSIONS: Paper-based implementations are by far the most popular approach to implement a guideline or protocol. The number of publications on asthma protocol reminder systems is increasing. The number of computerized and computer-generated studies is also increasing. Asthma guidelines generally improved patient care and practitioner performance regardless of the implementation method.
Assuntos
Asma , Protocolos Clínicos , Humanos , Asma/terapia , Guias de Prática Clínica como Assunto , Sistemas de Alerta/estatística & dados numéricosRESUMO
BACKGROUND: Electronic health records (EHRs) present navigation challenges due to time-consuming searches across segmented data. Voice assistants can improve clinical workflows by allowing natural language queries and contextually aware navigation of the EHR. OBJECTIVES: To develop a voice-mediated EHR assistant and interview providers to inform its future refinement. METHODS: The Vanderbilt EHR Voice Assistant (VEVA) was developed as a responsive web application and designed to accept voice inputs and execute the appropriate EHR commands. Fourteen providers from Vanderbilt Medical Center were recruited to participate in interactions with VEVA and to share their experience with the technology. The purpose was to evaluate VEVA's overall usability, gather qualitative feedback, and detail suggestions for enhancing its performance. RESULTS: VEVA's mean system usability scale score was 81 based on the 14 providers' evaluations, which was above the standard 50th percentile score of 68. For all five summaries evaluated (overview summary, A1C results, blood pressure, weight, and health maintenance), most providers offered a positive review of VEVA. Several providers suggested modifications to make the technology more useful in their practice, ranging from summarizing current medications to changing VEVA's speech rate. Eight of the providers (64%) reported they would be willing to use VEVA in its current form. CONCLUSION: Our EHR voice assistant technology was deemed usable by most providers. With further improvements, voice assistant tools such as VEVA have the potential to improve workflows and serve as a useful adjunct tool in health care.
Assuntos
Registros Eletrônicos de Saúde , Software , Idioma , TecnologiaRESUMO
OBJECTIVE: Large-language models (LLMs) can potentially revolutionize health care delivery and research, but risk propagating existing biases or introducing new ones. In epilepsy, social determinants of health are associated with disparities in care access, but their impact on seizure outcomes among those with access remains unclear. Here we (1) evaluated our validated, epilepsy-specific LLM for intrinsic bias, and (2) used LLM-extracted seizure outcomes to determine if different demographic groups have different seizure outcomes. MATERIALS AND METHODS: We tested our LLM for differences and equivalences in prediction accuracy and confidence across demographic groups defined by race, ethnicity, sex, income, and health insurance, using manually annotated notes. Next, we used LLM-classified seizure freedom at each office visit to test for demographic outcome disparities, using univariable and multivariable analyses. RESULTS: We analyzed 84 675 clinic visits from 25 612 unique patients seen at our epilepsy center. We found little evidence of bias in the prediction accuracy or confidence of outcome classifications across demographic groups. Multivariable analysis indicated worse seizure outcomes for female patients (OR 1.33, P ≤ .001), those with public insurance (OR 1.53, P ≤ .001), and those from lower-income zip codes (OR ≥1.22, P ≤ .007). Black patients had worse outcomes than White patients in univariable but not multivariable analysis (OR 1.03, P = .66). CONCLUSION: We found little evidence that our LLM was intrinsically biased against any demographic group. Seizure freedom extracted by LLM revealed disparities in seizure outcomes across several demographic groups. These findings quantify the critical need to reduce disparities in the care of people with epilepsy.
Assuntos
Epilepsia , Disparidades em Assistência à Saúde , Convulsões , Humanos , Feminino , Masculino , Adulto , Pessoa de Meia-Idade , Processamento de Linguagem Natural , Determinantes Sociais da Saúde , Adolescente , Adulto Jovem , IdiomaRESUMO
Importance: The Sentinel System is a key component of the US Food and Drug Administration (FDA) postmarketing safety surveillance commitment and uses clinical health care data to conduct analyses to inform drug labeling and safety communications, FDA advisory committee meetings, and other regulatory decisions. However, observational data are frequently deemed insufficient for reliable evaluation of safety concerns owing to limitations in underlying data or methodology. Advances in large language models (LLMs) provide new opportunities to address some of these limitations. However, careful consideration is necessary for how and where LLMs can be effectively deployed for these purposes. Observations: LLMs may provide new avenues to support signal-identification activities to identify novel adverse event signals from narrative text of electronic health records. These algorithms may be used to support epidemiologic investigations examining the causal relationship between exposure to a medical product and an adverse event through development of probabilistic phenotyping of health outcomes of interest and extraction of information related to important confounding factors. LLMs may perform like traditional natural language processing tools by annotating text with controlled vocabularies with additional tailored training activities. LLMs offer opportunities for enhancing information extraction from adverse event reports, medical literature, and other biomedical knowledge sources. There are several challenges that must be considered when leveraging LLMs for postmarket surveillance. Prompt engineering is needed to ensure that LLM-extracted associations are accurate and specific. LLMs require extensive infrastructure to use, which many health care systems lack, and this can impact diversity, equity, and inclusion, and result in obscuring significant adverse event patterns in some populations. LLMs are known to generate nonfactual statements, which could lead to false positive signals and downstream evaluation activities by the FDA and other entities, incurring substantial cost. Conclusions and Relevance: LLMs represent a novel paradigm that may facilitate generation of information to support medical product postmarket surveillance activities that have not been possible. However, additional work is required to ensure LLMs can be used in a fair and equitable manner, minimize false positive findings, and support the necessary rigor of signal detection needed for regulatory activities.
Assuntos
Processamento de Linguagem Natural , Vigilância de Produtos Comercializados , United States Food and Drug Administration , Vigilância de Produtos Comercializados/métodos , Humanos , Estados Unidos , Registros Eletrônicos de SaúdeRESUMO
Suicide prevention requires risk identification, appropriate intervention, and follow-up. Traditional risk identification relies on patient self-reporting, support network reporting, or face-to-face screening with validated instruments or history and physical exam. In the last decade, statistical risk models have been studied and more recently deployed to augment clinical judgment. Models have generally been found to be low precision or problematic at scale due to low incidence. Few have been tested in clinical practice, and none have been tested in clinical trials to our knowledge. Methods: We report the results of a pragmatic randomized controlled trial (RCT) in three outpatient adult Neurology clinic settings. This two-arm trial compared the effectiveness of Interruptive and Non-Interruptive Clinical Decision Support (CDS) to prompt further screening of suicidal ideation for those predicted to be high risk using a real-time, validated statistical risk model of suicide attempt risk, with the decision to screen as the primary end point. Secondary outcomes included rates of suicidal ideation and attempts in both arms. Manual chart review of every trial encounter was used to determine if suicide risk assessment was subsequently documented. Results: From August 16, 2022, through February 16, 2023, our study randomized 596 patient encounters across 561 patients for providers to receive either Interruptive or Non-Interruptive CDS in a 1:1 ratio. Adjusting for provider cluster effects, Interruptive CDS led to significantly higher numbers of decisions to screen (42%=121/289 encounters) compared to Non-Interruptive CDS (4%=12/307) (odds ratio=17.7, p-value <0.001). Secondarily, no documented episodes of suicidal ideation or attempts occurred in either arm. While the proportion of documented assessments among those noting the decision to screen was higher for providers in the Non-Interruptive arm (92%=11/12) than in the Interruptive arm (52%=63/121), the interruptive CDS was associated with more frequent documentation of suicide risk assessment (63/289 encounters compared to 11/307, p-value<0.001). Conclusions: In this pragmatic RCT of real-time predictive CDS to guide suicide risk assessment, Interruptive CDS led to higher numbers of decisions to screen and documented suicide risk assessments. Well-powered large-scale trials randomizing this type of CDS compared to standard of care are indicated to measure effectiveness in reducing suicidal self-harm. ClinicalTrials.gov Identifier: NCT05312437.
RESUMO
OBJECTIVE: Efforts to reduce documentation burden (DocBurden) for all health professionals (HP) are aligned with national initiatives to improve clinician wellness and patient safety. Yet DocBurden has not been precisely defined, limiting national conversations and rigorous, reproducible, and meaningful measures. Increasing attention to DocBurden motivated this work to establish a standard definition of DocBurden, with the emergence of excessive DocBurden as a term. METHODS: We conducted a scoping review of DocBurden definitions and descriptions, searching six databases for scholarly, peer-reviewed, and gray literature sources, using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extensions for Scoping Review (PRISMA-ScR) guidance. For the concept clarification phase of work, we used the American Nursing Informatics Association (ANIA)'s 6-Domains of Burden Framework. RESULTS: A total of 153 articles were included based on a priori criteria. Most articles described a focus on DocBurden, but only 18% (n=28) provided a definition. We define excessive DocBurden as the stress and unnecessarily heavy work a HP or healthcare team experiences when usability of documentation systems and documentation activities (i.e., generation, review, analysis and synthesis of patient data) are not aligned in support of care delivery. A negative connotation was attached to burden without a neutral state in included sources, which does not align with dictionary definitions of burden. CONCLUSIONS: Existing literature does not distinguish between a baseline or required task load to conduct patient care resulting from usability issues(DocBurden), and the unnecessarily heavy tasks and requirements that contribute to excessive DocBurden. Our definition of excessive DocBurden explicitly acknowledges this distinction, to support development of meaningful measures for understanding and intervening on excessive DocBurden locally, nationally and internationally.
RESUMO
OBJECTIVES: Automated phenotyping algorithms can reduce development time and operator dependence compared to manually developed algorithms. One such approach, PheNorm, has performed well for identifying chronic health conditions, but its performance for acute conditions is largely unknown. Herein, we implement and evaluate PheNorm applied to symptomatic COVID-19 disease to investigate its potential feasibility for rapid phenotyping of acute health conditions. MATERIALS AND METHODS: PheNorm is a general-purpose automated approach to creating computable phenotype algorithms based on natural language processing, machine learning, and (low cost) silver-standard training labels. We applied PheNorm to cohorts of potential COVID-19 patients from 2 institutions and used gold-standard manual chart review data to investigate the impact on performance of alternative feature engineering options and implementing externally trained models without local retraining. RESULTS: Models at each institution achieved AUC, sensitivity, and positive predictive value of 0.853, 0.879, 0.851 and 0.804, 0.976, and 0.885, respectively, at quantiles of model-predicted risk that maximize F1. We report performance metrics for all combinations of silver labels, feature engineering options, and models trained internally versus externally. DISCUSSION: Phenotyping algorithms developed using PheNorm performed well at both institutions. Performance varied with different silver-standard labels and feature engineering options. Models developed locally at one site also worked well when implemented externally at the other site. CONCLUSION: PheNorm models successfully identified an acute health condition, symptomatic COVID-19. The simplicity of the PheNorm approach allows it to be applied at multiple study sites with substantially reduced overhead compared to traditional approaches.
Assuntos
Algoritmos , COVID-19 , Humanos , Registros Eletrônicos de Saúde , Aprendizado de Máquina , Processamento de Linguagem NaturalRESUMO
OBJECTIVE: Pediatric dose rounding is a unique and complex process whose complexity is rarely supported by e-prescribing systems, though amenable to automation and deployment from a central service provider. The goal of this project was to validate an automated dose-rounding algorithm for pediatric dose rounding. METHODS: We developed a dose-rounding algorithm, STEPSTools, based on expert consensus about the rounding process and knowledge about the therapeutic/toxic window for each medication. We then used a 60% subsample of electronically-generated prescriptions from one academic medical center to further refine the web services. Once all issues were resolved, we used the remaining 40% of the prescriptions as a test sample and assessed the degree of concordance between automatically calculated optimal doses and the doses in the test sample. Cases with discrepant doses were compiled in a survey and assessed by pediatricians from two academic centers. The response rate for the survey was 25%. RESULTS: Seventy-nine test cases were tested for concordance. For 20 cases, STEPSTools was unable to provide a recommended dose. The dose recommendation provided by STEPSTools was identical to that of the test prescription for 31 cases. For 14 out of the 24 discrepant cases included in the survey, respondents significantly preferred STEPSTools recommendations (p<0.05, binomial test). Overall, when combined with the data from all test cases, STEPSTools either matched or exceeded the performance of the test cases in 45/59 (76%) of the cases. The majority of other cases were challenged by the need to provide an extremely small dose. We estimated that with the addition of two dose-selection rules, STEPSTools would achieve an overall performance of 82% or higher. CONCLUSIONS: Results of this pilot study suggest that automated dose rounding is a feasible mechanism for providing guidance to e-prescribing systems. These results also demonstrate the need for validating decision-support systems to support targeted and iterative improvement in performance.
Assuntos
Algoritmos , Automação , Relação Dose-Resposta a Droga , Reprodutibilidade dos TestesRESUMO
A new model of health care is emerging in which individuals can take charge of their health by connecting to online communities and social networks for personalized support and collective knowledge. Web 2.0 technologies expand the traditional notion of online support groups into a broad and evolving range of informational, emotional, as well as community-based concepts of support. In order to apply these technologies to patient-centered care, it is necessary to incorporate more inclusive conceptual frameworks of social support and community-based research methodologies. This paper introduces a conceptualization of online social support, reviews current challenges in online support research, and outlines six recommendations for the design, evaluation, and implementation of social support in online communities, networks, and groups. The six recommendations are illustrated by CanConnect, an online community for cancer survivors in middle Tennessee. These recommendations address the interdependencies between online and real-world support and emphasize an inclusive framework of interpersonal and community-based support. The applications of these six recommendations are illustrated through a discussion of online support for cancer survivors.