RESUMO
PURPOSE: To present a modification of the reversible tarsorrhaphy that can be opened and reclosed as necessary by caretakers and the patient. METHODS: Retrospective case series of patients who underwent the reversible tarsorrhaphy. Materials included intravenous (IV) tubing as bolsters and 4-0 polypropylene suture. The 4-0 suture is first passed through and through one end of IV tubing approximately 20 mm in length. Starting on the lateral upper lid and approximately 4 mm above the lash line, the suture is placed through the skin and into the tarsus. The suture exits through the eyelid gray line. These steps through the eyelid are repeated in the opposite direction. An air knot is tied above the upper eyelid near the base of IV tubing. A second air knot can be tied higher to provide a handle easily allowing the caretaker to close the eyelid. RESULTS: Included were 13 patients (ages 21-95-yeas), indications included lagophthalmos secondary to cicatricial changes from burns (2), keratouveitis (1), neurogenic palsy (3), neurotrophic ulcer (6), and cicatricial changes from skin cancer (1). There were no reported difficulties in maintaining the tarsorrhaphy by either family members or healthcare providers. The first tarsorrhaphy for each patient lasted between 3-19 weeks, with an average of 8 weeks. All were well tolerated. CONCLUSIONS: The caretaker-reversible tarsorrhaphy can be used as a temporizing measure. The technique balances the need for ocular protection with the need for examination/treatment by health care professionals and, equally importantly, the patients and caretakers.
Assuntos
Doenças Palpebrais , Pálpebras , Técnicas de Sutura , Humanos , Estudos Retrospectivos , Masculino , Pessoa de Meia-Idade , Feminino , Técnicas de Sutura/instrumentação , Adulto , Idoso , Idoso de 80 Anos ou mais , Pálpebras/cirurgia , Doenças Palpebrais/cirurgia , Adulto Jovem , Suturas , Procedimentos Cirúrgicos Oftalmológicos/métodosRESUMO
Cryopreservation is important in manufacturing of cell therapy products, influencing their safety and effectiveness. During freezing and thawing, intracellular events such as dehydration and ice formation can impact cell viability. In this study, the impact of controlling the ice nucleation temperature on intracellular events and viability were investigated. A model T cell line, Jurkat cells, were evaluated in commercially relevant cryoformulations (2.5 and 5 % v/v DMSO in Plasma-Lyte A) using a cryomicroscopic setup to monitor the dynamic changes cells go through during freeze-thaw as well as a controlled rate freezer to study bulk freeze-thaw. The equilibrium freezing temperatures of the studied formulations and a DMSO/Plasma-Lyte A liquidus curve were determined using DSC. The cryomicroscopic studies revealed that an ice nucleation temperature of -6°C, close to the equilibrium freezing temperatures of cryoformulations, led to more intracellular dehydration and less intracellular ice formation during freezing compared to either a lower ice nucleation temperature (-10 °C) or uncontrolled ice nucleation. The cell membrane integrity and post thaw viability in bulk cryopreservation consistently demonstrated the advantage of the higher ice nucleation temperature, and the correlation between the cellular events and cell viability.
Assuntos
Sobrevivência Celular , Criopreservação , Crioprotetores , Congelamento , Gelo , Linfócitos T , Sobrevivência Celular/efeitos dos fármacos , Criopreservação/métodos , Células Jurkat , Humanos , Crioprotetores/química , Crioprotetores/farmacologia , Dimetil Sulfóxido/química , Membrana CelularRESUMO
Neuroimmune interactions are essential for the development of neuropathic pain, yet the contributions of distinct immune cell populations have not been fully unraveled. Here, we demonstrate the critical role of B cells in promoting mechanical hypersensitivity (allodynia) after peripheral nerve injury in male and female mice. Depletion of B cells with a single injection of anti-CD20 monoclonal antibody at the time of injury prevented the development of allodynia. B cell-deficient (muMT) mice were similarly spared from allodynia. Nerve injury was associated with increased immunoglobulin G (IgG) accumulation in ipsilateral lumbar dorsal root ganglia (DRGs) and dorsal spinal cords. IgG was colocalized with sensory neurons and macrophages in DRGs and microglia in spinal cords. IgG also accumulated in DRG samples from human donors with chronic pain, colocalizing with a marker for macrophages and satellite glia. RNA sequencing revealed a B cell population in naive mouse and human DRGs. A B cell transcriptional signature was enriched in DRGs from human donors with neuropathic pain. Passive transfer of IgG from injured mice induced allodynia in injured muMT recipient mice. The pronociceptive effects of IgG are likely mediated through immune complexes interacting with Fc gamma receptors (FcγRs) expressed by sensory neurons, microglia, and macrophages, given that both mechanical allodynia and hyperexcitability of dissociated DRG neurons were abolished in nerve-injured FcγR-deficient mice. Consistently, the pronociceptive effects of IgG passive transfer were lost in FcγR-deficient mice. These data reveal that a B cell-IgG-FcγR axis is required for the development of neuropathic pain in mice.
Assuntos
Linfócitos B , Gânglios Espinais , Hiperalgesia , Imunoglobulina G , Neuralgia , Receptores de IgG , Transdução de Sinais , Animais , Receptores de IgG/metabolismo , Neuralgia/metabolismo , Imunoglobulina G/metabolismo , Humanos , Hiperalgesia/metabolismo , Hiperalgesia/patologia , Masculino , Gânglios Espinais/metabolismo , Linfócitos B/metabolismo , Linfócitos B/imunologia , Feminino , Camundongos , Comportamento Animal , Camundongos Endogâmicos C57BL , Macrófagos/metabolismo , Traumatismos dos Nervos Periféricos/metabolismo , Traumatismos dos Nervos Periféricos/complicaçõesRESUMO
PURPOSE OF REVIEW: In recent years, the field of aesthetic medicine has witnessed a paradigm shift with an increasing demand for minimally invasive cosmetic procedures, including cosmetic injectables. This review aims to delineate the distinctive role played by oculoplastic surgeons in the administration of cosmetic injectables, comparing their expertise to that of nonphysician practitioners. RECENT FINDINGS: Complications arising from cosmetic injections are discussed, including skin discoloration, inflammation, necrosis, vision loss, retinal pathology, and central nervous system adverse effects. Injector expertise, patient factors, type of filler, location of injection, and management strategies are reviewed. Findings highlight diverse practitioner involvement, common adverse effects like skin necrosis and vision loss, with hyaluronic acid fillers being prominent. Areas at the highest risk for ocular complication include the glabella and nose with potential management involving dissolving fillers and reducing pressure. Emphasis is placed on expert injector selection and patient awareness. SUMMARY: The administration of cosmetic injectables requires a profound understanding of facial anatomy, vasculature, and potential complications. In contrast to nonphysician practitioners, oculoplastic and aesthetic surgeons bring a level of anatomical precision and clinical acumen that is essential for navigating the complexities of cosmetic injectables. Emphasis on training and collaboration among practitioners will be essential in advancing the field while prioritizing patient safety and satisfaction.
Assuntos
Técnicas Cosméticas , Preenchedores Dérmicos , Humanos , Técnicas Cosméticas/efeitos adversos , Preenchedores Dérmicos/efeitos adversos , Preenchedores Dérmicos/administração & dosagem , Procedimentos Cirúrgicos Minimamente Invasivos , Injeções , Papel do Médico , Cirurgiões , Ácido Hialurônico/administração & dosagem , Ácido Hialurônico/efeitos adversosRESUMO
PURPOSE: The initial management of patients presenting with orbital inflammatory syndromes varies-with some pursuing a diagnostic workup while others treat without any testing. The evidence behind this rationale is limited. A review of patients with orbital inflammation is performed with an analysis of diagnostic testing to develop a workflow for such patients. DESIGN: A retrospective review of patients presenting with acute orbital inflammation at a single institution from 2011 to 2020 was conducted. METHODS: Orbital imaging was required for inclusion. Patients with high suspicion of neoplasm, bacterial infection, vascular malformation, or thyroid eye disease were excluded. A review of presenting clinical findings, laboratory workup, orbital imaging, and biopsy were performed. Statistical analysis was performed identifying statistically significant diagnostic and treatment maneuvers. RESULTS: In total, 172 patients met inclusion criteria (66% female, mean age 46 years). The primary clinical presentation was myositis, dacryoadenitis, and infiltrative in 67, 73, and 32 patients (39.0%, 43.0%, 18.6%, respectively). Laboratory studies were conducted in 145 (84%) while biopsy was performed in 55 (32%). Specific orbital inflammation (SOI) was diagnosed in 29 (16.9%) with the most frequent diagnoses being sarcoidosis, IgG4-related disease, inflammatory bowel disease, and systemic lupus erythematosus. The majority (147, 85.5%) was initially treated with steroids, but steroid-sparing agent use was statistically higher in patients with SOI. CONCLUSIONS: In patients presenting with orbital inflammatory syndromes, distinguishing myositis, dacryoadenitis, and infiltrative disease has workup and differential diagnosis impacts. Because SOI is relatively common, sequelae of SOI, and potential steroid-sparing therapy needs, diagnosis via an evidence-based systemic approach is critical. NOTE: Publication of this article is sponsored by the American Ophthalmological Society.
Assuntos
Oftalmologia , Humanos , Feminino , Estudos Retrospectivos , Masculino , Pessoa de Meia-Idade , Adulto , Sociedades Médicas , Estados Unidos/epidemiologia , Tomografia Computadorizada por Raios X , Idoso , Biópsia , Medicina Baseada em Evidências , Imageamento por Ressonância Magnética , Pseudotumor Orbitário/diagnóstico , Pseudotumor Orbitário/tratamento farmacológico , Adulto Jovem , Diagnóstico Diferencial , Órbita/diagnóstico por imagem , Técnicas de Diagnóstico Oftalmológico , AdolescenteRESUMO
BACKGROUND: This study aims to assess the impact of sotatercept on exercise tolerance, exercise capacity, and right ventricular function in pulmonary arterial hypertension. METHODS: SPECTRA (Sotatercept Phase 2 Exploratory Clinical Trial in PAH) was a phase 2a, single-arm, open-label, multicenter exploratory study that evaluated the effects of sotatercept by invasive cardiopulmonary exercise testing in participants with pulmonary arterial hypertension and World Health Organization functional class III on combination background therapy. The primary end point was the change in peak oxygen uptake from baseline to week 24. Cardiac magnetic resonance imaging was performed to assess right ventricular function. RESULTS: Among the 21 participants completing 24 weeks of treatment, there was a significant improvement from baseline in peak oxygen uptake, with a mean change of 102.74 mL/min ([95% CIs, 27.72-177.76]; P=0.0097). Sotatercept demonstrated improvements in secondary end points, including resting and peak exercise hemodynamics, and 6-minute walk distance versus baseline measures. Cardiac magnetic resonance imaging showed improvements from baseline at week 24 in right ventricular function. CONCLUSIONS: The clinical efficacy and safety of sotatercept demonstrated in the SPECTRA study emphasize the potential of this therapy as a new treatment option for patients with pulmonary arterial hypertension. Improvements in right ventricular structure and function underscore the potential for sotatercept as a disease-modifying agent with reverse-remodeling capabilities. REGISTRATION: URL: https://www.clinicaltrials.gov; Unique identifier: NCT03738150.
Assuntos
Tolerância ao Exercício , Hipertensão Arterial Pulmonar , Função Ventricular Direita , Humanos , Tolerância ao Exercício/efeitos dos fármacos , Masculino , Feminino , Função Ventricular Direita/efeitos dos fármacos , Pessoa de Meia-Idade , Hipertensão Arterial Pulmonar/tratamento farmacológico , Hipertensão Arterial Pulmonar/fisiopatologia , Adulto , Resultado do Tratamento , Teste de Esforço , Proteínas Recombinantes de Fusão/uso terapêutico , Idoso , Hipertensão Pulmonar/tratamento farmacológico , Hipertensão Pulmonar/fisiopatologia , Consumo de Oxigênio/efeitos dos fármacos , Teste de Caminhada , Receptores de Activinas Tipo II/uso terapêutico , Recuperação de Função FisiológicaRESUMO
PURPOSE: The current study queries the American Academy of Ophthalmology (AAO) Intelligent Research in Sight (IRIS) registry for data on the epidemiology, work-up, and management patterns of autoimmune orbital inflammation. METHODS: Analysis and description of patient data from the IRIS registry between 2013 and 2019 reviewing patients with autoimmune or idiopathic orbital inflammation with filters based on International Classification of Disease (ICD) and Current Procedural Terminology (CPT) codes. Patients with thyroid eye disease, orbital cellulitis, and orbital abscess were excluded. MAIN OUTCOME MEASURES: Demographic descriptions included gender, age, geographic region, and treatment. Sub-analysis was performed by assessing rates of imaging, biopsy, lab work-up, and diagnostic categories. RESULTS: In a final cohort of 20,584 patients, the mean age of onset of orbital inflammation was 51.7 years; 67% female; and 63% Caucasian, 21% unknown, 12% Black, 2.6% Asian, and 1.5% other. Only 49 had imaging, 78 had laboratory work-up, and 1,411 had biopsy codes. Treatment results showed 166 patients receiving antibiotics, 224 patients receiving steroids, and 35 patients receiving both. CONCLUSIONS: This study assessed the epidemiology, diagnostic patterns, and treatment patterns for orbital inflammation through the AAO IRIS registry. Practise patterns suggest a relatively low overall rate of imaging and laboratory studies compared to biopsies, although this certainly under-represents the actual number of imaging and laboratory studies and exemplifies the inherent imprecision of using a large database. However, the methodology of this study provides a framework of approaching the IRIS registry for oculoplastic research.
Assuntos
Sistema de Registros , Humanos , Feminino , Masculino , Pessoa de Meia-Idade , Estados Unidos/epidemiologia , Adulto , Idoso , Pseudotumor Orbitário/epidemiologia , Pseudotumor Orbitário/diagnóstico , Oftalmologia/estatística & dados numéricos , Estudos Retrospectivos , Adulto Jovem , Adolescente , Idoso de 80 Anos ou mais , Doenças Autoimunes/epidemiologia , CriançaRESUMO
OBJECTIVE: Giant cell arteritis (GCA) is an age-related vasculitis. Prior studies have identified an association between GCA and hematologic malignancies (HMs). How the presence of somatic mutations that drive the development of HMs, or clonal hematopoiesis (CH), may influence clinical outcomes in GCA is not well understood. METHODS: To examine an association between CH and GCA, we analyzed sequenced exomes of 470,960 UK Biobank (UKB) participants for the presence of CH and used multivariable Cox regression. To examine the clinical phenotype of GCA in patients with and without somatic mutations across the spectrum of CH to HM, we performed targeted sequencing of blood samples and electronic health record review on 114 patients with GCA seen at our institution. We then examined associations between specific clonal mutations and GCA disease manifestations. RESULTS: UKB participants with CH had a 1.48-fold increased risk of incident GCA compared to UKB participants without CH. GCA risk was highest among individuals with cytopenia (hazard ratio [HR] 2.98, P = 0.00178) and with TET2 mutation (HR 2.02, P = 0.00116). Mutations were detected in 27.2% of our institutional GCA cohort, three of whom had HM at GCA diagnosis. TET2 mutations were associated with vision loss in patients with GCA (odds ratio 4.33, P = 0.047). CONCLUSIONS: CH increases risk for development of GCA in a genotype-specific manner, with the greatest risk being conferred by the presence of mutations in TET2. Somatic TET2 mutations likewise increase the risk of GCA-associated vision loss. Integration of somatic genetic testing in GCA diagnostics may be warranted in the future.
Assuntos
Dioxigenases , Arterite de Células Gigantes , Humanos , Arterite de Células Gigantes/complicações , Mutação , Proteínas de Ligação a DNA/genéticaRESUMO
Stargardt macular dystrophy (Stargardt disease; STGD1; OMIM 248200) is the most prevalent inherited macular dystrophy. STGD1 is an autosomal recessive disorder caused by multiple pathogenic sequence variants in the large ABCA4 gene (OMIM 601691). Major advances in understanding both the clinical and molecular features, as well as the underlying pathophysiology, have culminated in many completed, ongoing and planned human clinical trials of novel therapies.The aims of this concise review are to describe (1) the detailed phenotypic and genotypic characteristics of the disease, multimodal imaging findings, natural history of the disease, and pathogenesis, (2) the multiple avenues of research and therapeutic intervention, including pharmacological, cellular therapies and diverse types of genetic therapies that have either been investigated or are under investigation and (3) the exciting novel therapeutic approaches on the translational horizon that aim to treat STGD1 by replacing the entire 6.8 kb ABCA4 open reading frame.
Assuntos
Degeneração Macular , Humanos , Doença de Stargardt , Fenótipo , Mutação , Degeneração Macular/diagnóstico , Degeneração Macular/genética , Degeneração Macular/terapia , Genótipo , Transportadores de Cassetes de Ligação de ATP/genéticaRESUMO
PURPOSE: To evaluate the perceived age of patients before and after functional upper blepharoplasty. METHODS: Retrospective chart review of patients who underwent upper blepharoplasty by a single surgeon at an academic center. The inclusion criterion was having external photographs before and after blepharoplasty. Exclusion criteria included any other concurrent eyelid or facial surgery. Primary endpoint: perceived change in age after surgery as judged by the American Society of Ophthalmic Plastic & Reconstructive Surgery (ASOPRS) surgeons. RESULTS: Sixty-seven patients (14 men, 53 women) were included. Mean pre-operative age was 66.9 years (range 37.8-89.4) and mean post-operative age was 67.4 years (range 38.6-89). The mean perceived age pre-operatively was 68.9 years, and the mean perceived age post-operatively was 67.1 years, a change of 1.8 years (p = 0.0001 by two-tailed paired T-test). Inter-rater reliability of the observers was measured by intraclass correlation coefficient of 0.77 for pre-operative and 0.75 for post-operative photos. The decreased perceived age was 1.9 years for women, 1.4 years for men, 0.3 years for Asians, 1.2 years for Hispanics, and 2.1 years for whites. DISCUSSION: Functional upper blepharoplasty by an experienced ASOPRS surgeon was shown to reduce the perceived age of a patient by an average of 1.8 years.
Assuntos
Blefaroplastia , Masculino , Humanos , Feminino , Adulto , Pessoa de Meia-Idade , Idoso , Idoso de 80 Anos ou mais , Lactente , Estudos Retrospectivos , Reprodutibilidade dos Testes , Pálpebras/cirurgia , Face/cirurgiaRESUMO
Ocular leishmaniasis, a rare form of vector-borne parasitic infection, can affect the adnexa, retina, uvea, and cornea. Coinfection with human immunodeficiency virus (HIV) and Leishmania may be a distinct clinical entity as the pathogens act synergistically, enhancing each other's pathogenicity, and leading to more severe forms of the disease. Ocular leishmaniasis in the setting of HIV coinfection most commonly causes anterior granulomatous uveitis, for which the etiology can be either active ocular infection or posttreatment inflammatory phenomenon. Keratitis is not considered to be associated with HIV but has rarely been seen from direct parasite invasion or in association with miltefosine. The judicious use of steroids in the treatment of ocular leishmaniasis is critical as steroid use is paramount to the treatment of uveitis associated with posttreatment inflammatory phenomenon but can worsen the prognosis when given in the setting of active, untreated infection. Here, we present a case of unilateral keratouveitis in a leishmaniasis and HIV-coinfected male following completion of systemic antileishmanial therapy. The keratouveitis completely resolved with only the addition of topical steroids. The rapid resolution with steroids suggests that keratitis, not only uveitis, can be an immune-mediated phenomenon in post- or ongoing-treatment individuals.
RESUMO
Over the past 40 years, there has been considerable research into the management and treatment of atherogenic lipid disorders. Although the majority of treatments and management strategies for cardiovascular disease (CVD) center around targeting low-density lipoprotein cholesterol (LDL-C), there is mounting evidence for the residual CVD risk attributed to high triglyceride (TG) and lipoprotein(a) (Lp(a)) levels despite the presence of lowered LDL-C levels. Among the biological mechanisms for clearing TG-rich lipoproteins, the VLDL receptor (VLDLR) plays a key role in the trafficking and metabolism of lipoprotein particles in multiple tissues, but it is not ordinarily expressed in the liver. Since VLDLR is capable of binding and internalizing apoE-containing TG-rich lipoproteins as well as Lp(a), hepatic VLDLR expression has the potential for promoting clearance of these atherogenic particles from the circulation and managing the residual CVD risk not addressed by current lipid lowering therapies. This review provides an overview of VLDLR function and the potential for developing a genetic medicine based on liver-targeted VLDLR gene expression.
Assuntos
Terapia Genética , Receptores de LDL , LDL-Colesterol , Receptores de LDL/metabolismoRESUMO
Orbital cellulitis in the pediatric population is treated primarily with antibiotic therapy. This leaves the inflammatory component unchecked. Corticosteroid therapy has been used to accelerate recovery and decrease the long-term morbidity in other infectious conditions. Its use has also been proposed for pediatric orbital cellulitis. The aim of this manuscript is to conduct a literature review to summarize existing evidence and understand ongoing controversies. Overall, prior investigations on corticosteroid therapy for pediatric orbital cellulitis are limited by their study design and sample sizes. One of the most discussed potential benefits is that adjuvant steroid therapy for pediatric orbital cellulitis is associated with shorter hospitalization without major infectious complications. However, decreased hospitalization length is an imperfect metric, especially without standardized criteria for hospital discharge. Future studies are warranted to better guide the use of adjuvant steroid therapy and to optimize its potential in the management of pediatric orbital cellulitis.
Assuntos
Celulite Orbitária , Doenças Orbitárias , Criança , Humanos , Celulite Orbitária/tratamento farmacológico , Celulite Orbitária/etiologia , Estudos Retrospectivos , Hospitalização , Antibacterianos/uso terapêutico , Esteroides , Corticosteroides/uso terapêuticoRESUMO
OBJECTIVES: To evaluate whether one summary metric of calculator performance sufficiently conveys equity across different demographic subgroups, as well as to evaluate how calculator predictive performance affects downstream health outcomes. STUDY DESIGN: We evaluate 3 commonly used clinical calculators-Model for End-Stage Liver Disease (MELD), CHA2DS2-VASc, and simplified Pulmonary Embolism Severity Index (sPESI)-on the cohort extracted from the Stanford Medicine Research Data Repository, following the cohort selection process as described in respective calculator derivation papers. METHODS: We quantified the predictive performance of the 3 clinical calculators across sex and race. Then, using the clinical guidelines that guide care based on these calculators' output, we quantified potential disparities in subsequent health outcomes. RESULTS: Across the examined subgroups, the MELD calculator exhibited worse performance for female and White populations, CHA2DS2-VASc calculator for the male population, and sPESI for the Black population. The extent to which such performance differences translated into differential health outcomes depended on the distribution of the calculators' scores around the thresholds used to trigger a care action via the corresponding guidelines. In particular, under the old guideline for CHA2DS2-VASc, among those who would not have been offered anticoagulant therapy, the Hispanic subgroup exhibited the highest rate of stroke. CONCLUSIONS: Clinical calculators, even when they do not include variables such as sex and race as inputs, can have very different care consequences across those subgroups. These differences in health care outcomes across subgroups can be explained by examining the distribution of scores and their calibration around the thresholds encoded in the accompanying care guidelines.
Assuntos
Fibrilação Atrial , Doença Hepática Terminal , Acidente Vascular Cerebral , Humanos , Masculino , Feminino , Medição de Risco , Índice de Gravidade de Doença , Anticoagulantes/uso terapêutico , Viés , Fatores de Risco , Fibrilação Atrial/complicações , Fibrilação Atrial/tratamento farmacológicoRESUMO
A 77-year-old Asian female with a history of left orbit exenteration and lid-sparing reconstruction for recurrent sebaceous carcinoma presented with fluid-like sensation of the left orbit. Magnetic resonance imaging (MRI) demonstrated bright T2 signal and a cyst-like cavity within the exenterated orbit. Decision was made to proceed with surgical exploration and excision. A calcified, bone-like cavity was encountered intraoperatively and removed. Histopathology revealed dense fibrous connective tissue with areas of calcification without osseous metaplasia, suggestive of retained blood in the orbit that underwent dystrophic calcification. This case report illustrates a rare occurrence of a bone-like calcific cyst following exenteration.
RESUMO
Multiple reporting guidelines for artificial intelligence (AI) models in healthcare recommend that models be audited for reliability and fairness. However, there is a gap of operational guidance for performing reliability and fairness audits in practice. Following guideline recommendations, we conducted a reliability audit of two models based on model performance and calibration as well as a fairness audit based on summary statistics, subgroup performance and subgroup calibration. We assessed the Epic End-of-Life (EOL) Index model and an internally developed Stanford Hospital Medicine (HM) Advance Care Planning (ACP) model in 3 practice settings: Primary Care, Inpatient Oncology and Hospital Medicine, using clinicians' answers to the surprise question ("Would you be surprised if [patient X] passed away in [Y years]?") as a surrogate outcome. For performance, the models had positive predictive value (PPV) at or above 0.76 in all settings. In Hospital Medicine and Inpatient Oncology, the Stanford HM ACP model had higher sensitivity (0.69, 0.89 respectively) than the EOL model (0.20, 0.27), and better calibration (O/E 1.5, 1.7) than the EOL model (O/E 2.5, 3.0). The Epic EOL model flagged fewer patients (11%, 21% respectively) than the Stanford HM ACP model (38%, 75%). There were no differences in performance and calibration by sex. Both models had lower sensitivity in Hispanic/Latino male patients with Race listed as "Other." 10 clinicians were surveyed after a presentation summarizing the audit. 10/10 reported that summary statistics, overall performance, and subgroup performance would affect their decision to use the model to guide care; 9/10 said the same for overall and subgroup calibration. The most commonly identified barriers for routinely conducting such reliability and fairness audits were poor demographic data quality and lack of data access. This audit required 115 person-hours across 8-10 months. Our recommendations for performing reliability and fairness audits include verifying data validity, analyzing model performance on intersectional subgroups, and collecting clinician-patient linkages as necessary for label generation by clinicians. Those responsible for AI models should require such audits before model deployment and mediate between model auditors and impacted stakeholders.
RESUMO
Importance: Various model reporting guidelines have been proposed to ensure clinical prediction models are reliable and fair. However, no consensus exists about which model details are essential to report, and commonalities and differences among reporting guidelines have not been characterized. Furthermore, how well documentation of deployed models adheres to these guidelines has not been studied. Objectives: To assess information requested by model reporting guidelines and whether the documentation for commonly used machine learning models developed by a single vendor provides the information requested. Evidence Review: MEDLINE was queried using machine learning model card and reporting machine learning from November 4 to December 6, 2020. References were reviewed to find additional publications, and publications without specific reporting recommendations were excluded. Similar elements requested for reporting were merged into representative items. Four independent reviewers and 1 adjudicator assessed how often documentation for the most commonly used models developed by a single vendor reported the items. Findings: From 15 model reporting guidelines, 220 unique items were identified that represented the collective reporting requirements. Although 12 items were commonly requested (requested by 10 or more guidelines), 77 items were requested by just 1 guideline. Documentation for 12 commonly used models from a single vendor reported a median of 39% (IQR, 37%-43%; range, 31%-47%) of items from the collective reporting requirements. Many of the commonly requested items had 100% reporting rates, including items concerning outcome definition, area under the receiver operating characteristics curve, internal validation, and intended clinical use. Several items reported half the time or less related to reliability, such as external validation, uncertainty measures, and strategy for handling missing data. Other frequently unreported items related to fairness (summary statistics and subgroup analyses, including for race and ethnicity or sex). Conclusions and Relevance: These findings suggest that consistent reporting recommendations for clinical predictive models are needed for model developers to share necessary information for model deployment. The many published guidelines would, collectively, require reporting more than 200 items. Model documentation from 1 vendor reported the most commonly requested items from model reporting guidelines. However, areas for improvement were identified in reporting items related to model reliability and fairness. This analysis led to feedback to the vendor, which motivated updates to the documentation for future users.