Eye tracking insights into physician behaviour with safe and unsafe explainable AI recommendations.

We studied clinical AI-supported decision-making as an example of a high-stakes setting in which explainable AI (XAI) has been proposed as useful (by theoretically providing physicians with context for the AI suggestion and thereby helping them to reject unsafe AI recommendations). Here, we used objective neurobehavioural measures (eye-tracking) to see how physicians respond to XAI with N = 19 ICU physicians in a hospital's clinical simulation suite. Prescription decisions were made both pre- and post-reveal of either a safe or unsafe AI recommendation and four different types of simultaneously presented XAI. We used overt visual attention as a marker for where physician mental attention was directed during the simulations. Unsafe AI recommendations attracted significantly greater attention than safe AI recommendations. However, there was no appreciably higher level of attention placed onto any of the four types of explanation during unsafe AI scenarios (i.e. XAI did not appear to 'rescue' decision-makers). Furthermore, self-reported usefulness of explanations by physicians did not correlate with the level of attention they devoted to the explanations reinforcing the notion that using self-reports alone to evaluate XAI tools misses key aspects of the interaction behaviour between human and machine.

High-throughput mass spectrometry maps the sepsis plasma proteome and differences in patient response.

Sepsis, the dysregulated host response to infection causing life-threatening organ dysfunction, is a global health challenge requiring better understanding of pathophysiology and new therapeutic approaches. Here, we applied high-throughput tandem mass spectrometry to delineate the plasma proteome for sepsis and comparator groups (noninfected critical illness, postoperative inflammation, and healthy volunteers) involving 2612 samples (from 1611 patients) and 4553 liquid chromatography-mass spectrometry analyses acquired through a single batch of continuous measurements, with a throughput of 100 samples per day. We show how this scale of data can delineate proteins, pathways, and coexpression modules in sepsis and be integrated with paired leukocyte transcriptomic data (837 samples from n = 649 patients). We mapped the plasma proteomic landscape of the host response in sepsis, including changes over time, and identified features relating to etiology, clinical phenotypes (including organ failures), and severity. This work reveals subphenotypes informative for sepsis response state, disease processes, and outcome; identifies potential biomarkers; and advances opportunities for a precision medicine approach to sepsis.

Can Machine Learning Personalize Cardiovascular Therapy in Sepsis?

Large randomized trials in sepsis have generally failed to find effective novel treatments. This is increasingly attributed to patient heterogeneity, including heterogeneous cardiovascular changes in septic shock. We discuss the potential for machine learning systems to personalize cardiovascular resuscitation in sepsis. While the literature is replete with proofs of concept, the technological readiness of current systems is low, with a paucity of clinical trials and proven patient benefit. Systems may be vulnerable to confounding and poor generalization to new patient populations or contemporary patterns of care. Typical electronic health records do not capture rich enough data, at sufficient temporal resolution, to produce systems that make actionable treatment suggestions. To resolve these issues, we recommend a simultaneous focus on technical challenges and removing barriers to translation. This will involve improving data quality, adopting causally grounded models, prioritizing safety assessment and integration into healthcare workflows, conducting randomized clinical trials and aligning with regulatory requirements.

Assessing the safety of physical rehabilitation in critically ill patients: a Delphi study.

BACKGROUND: Physical rehabilitation of critically ill patients is implemented to improve physical outcomes from an intensive care stay. However, before rehabilitation is implemented, a risk assessment is essential, based on robust safety data. To develop this information, a uniform definition of relevant adverse events is required. The assessment of cardiovascular stability is particularly relevant before physical activity as there is uncertainty over when it is safe to start rehabilitation with patients receiving vasoactive drugs. METHODS: A three-stage Delphi study was carried out to (a) define adverse events for a general ICU cohort, and (b) to define which risks should be assessed before physical rehabilitation of patients receiving vasoactive drugs. An international group of intensive care clinicians and clinician researchers took part. Former ICU patients and their family members/carers were involved in generating consensus for the definition of adverse events. Round one was an open round where participants gave their suggestions of what to include. In round two, participants rated their agreements with these suggestions using a five-point Likert scale; a 70% consensus agreement threshold was used. Round three was used to re-rate suggestions that had not reached consensus, whilst viewing anonymous feedback of participant ratings from round two. RESULTS: Twenty-four multi-professional ICU clinicians and clinician researchers from 10 countries across five continents were recruited. Average duration of ICU experience was 18 years (standard deviation 8) and 61% had publications related to ICU rehabilitation. For the adverse event definition, five former ICU patients and one patient relative were recruited. The Delphi process had a 97% response rate. Firstly, 54 adverse events reached consensus; an adverse event tool was created and informed by these events. Secondly, 50 risk factors requiring assessment before physical rehabilitation of patients receiving vasoactive drugs reached consensus. A second tool was created, informed by these suggestions. CONCLUSIONS: The adverse event tool can be used in studies of physical rehabilitation to ensure uniform measurement of safety. The risk assessment tool can be used to inform clinical practise when risk assessing when to start rehabilitation with patients receiving vasoactive drugs. Trial registration This study protocol was retrospectively registered on https://www.researchregistry.com/ (researchregistry2991).

From ICU Syndromes to ICU Subphenotypes: Consensus Report and Recommendations for Developing Precision Medicine in the ICU.

Critical care uses syndromic definitions to describe patient groups for clinical practice and research. There is growing recognition that a "precision medicine" approach is required and that integrated biologic and physiologic data identify reproducible subpopulations that may respond differently to treatment. This article reviews the current state of the field and considers how to successfully transition to a precision medicine approach. To impact clinical care, identification of subpopulations must do more than differentiate prognosis. It must differentiate response to treatment, ideally by defining subgroups with distinct functional or pathobiological mechanisms (endotypes). There are now multiple examples of reproducible subpopulations of sepsis, acute respiratory distress syndrome, and acute kidney or brain injury described using clinical, physiological, and/or biological data. Many of these subpopulations have demonstrated the potential to define differential treatment response, largely in retrospective studies, and that the same treatment-responsive subpopulations may cross multiple clinical syndromes (treatable traits). To bring about a change in clinical practice, a precision medicine approach must be evaluated in prospective clinical studies requiring novel adaptive trial designs. Several such studies are underway, but there are multiple challenges to be tackled. Such subpopulations must be readily identifiable and be applicable to all critically ill populations around the world. Subdividing clinical syndromes into subpopulations will require large patient numbers. Global collaboration of investigators, clinicians, industry, and patients over many years will therefore be required to transition to a precision medicine approach and ultimately realize treatment advances seen in other medical fields.

Developing Guidance for Donor Intervention Randomized Controlled Trials: Initial Discussions From the Canada-United Kingdom 2022 Workshop.

BACKGROUND: Donor interventions, including medications, protocols, and medical devices administered to donors, can enhance transplantable organ quality and quantity and maximize transplantation success. However, there is paucity of high-quality evidence about their effectiveness, in part because of ethical, practical, and regulatory challenges, and lack of guidance about conduct of donor intervention randomized controlled trials (RCTs). METHODS: With the vision to develop authoritative guidance for conduct of donor intervention RCTs, we convened a workshop of Canadian-United Kingdom experts in organ donation and transplantation ethics, research, and policy to identify stakeholders, explore unique challenges, and develop research agenda to inform future work in this promising field. RESULTS: Donor intervention trials should consider perspectives of broad group of stakeholders including donors, transplant recipients, and their families; researchers in donation and transplantation; research ethics boards; and healthcare providers and administrators involved in donation and transplantation. Unique challenges include (1) research ethics (living versus deceased status of the donor at the time of intervention, intervention versus outcomes assessment in different individuals, harm-benefit analysis in donors versus recipients, consent, and impact on research bystanders); (2) outcome data standardization and linkage; and (3) regulatory and governance considerations. CONCLUSIONS: Donor intervention RCTs hold potential to benefit organ transplantation outcomes but face unique research ethics, outcome data, and regulatory challenges. By developing research agenda to address these challenges, our workshop was an important first step toward developing Canada-United Kingdom guidance for donor intervention RCTs that are poised to improve the quality and availability of transplantable organs.

Patient stratification using plasma cytokines and their regulators in sepsis: relationship to outcomes, treatment effect and leucocyte transcriptomic subphenotypes.

RATIONALE: Heterogeneity of the host response within sepsis, acute respiratory distress syndrome (ARDS) and more widely critical illness, limits discovery and targeting of immunomodulatory therapies. Clustering approaches using clinical and circulating biomarkers have defined hyper-inflammatory and hypo-inflammatory subphenotypes in ARDS associated with differential treatment response. It is unknown if similar subphenotypes exist in sepsis populations where leucocyte transcriptomic-defined subphenotypes have been reported. OBJECTIVES: We investigated whether inflammatory clusters based on cytokine protein abundance were seen in sepsis, and the relationships with previously described transcriptomic subphenotypes. METHODS: Hierarchical cluster and latent class analysis were applied to an observational study (UK Genomic Advances in Sepsis (GAinS)) (n=124 patients) and two clinical trial datasets (VANISH, n=155 and LeoPARDS, n=484) in which the plasma protein abundance of 65, 21, 11 circulating cytokines, cytokine receptors and regulators were quantified. Clinical features, outcomes, response to trial treatments and assignment to transcriptomic subphenotypes were compared between inflammatory clusters. MEASUREMENTS AND MAIN RESULTS: We identified two (UK GAinS, VANISH) or three (LeoPARDS) inflammatory clusters. A group with high levels of pro-inflammatory and anti-inflammatory cytokines was seen that was associated with worse organ dysfunction and survival. No interaction between inflammatory clusters and trial treatment response was found. We found variable overlap of inflammatory clusters and leucocyte transcriptomic subphenotypes. CONCLUSIONS: These findings demonstrate that differences in response at the level of cytokine biology show clustering related to severity, but not treatment response, and may provide complementary information to transcriptomic sepsis subphenotypes. TRIAL REGISTRATION NUMBER: ISRCTN20769191, ISRCTN12776039.

Adaptive multi-interventional trial platform to improve patient care for fibrotic interstitial lung diseases.

BACKGROUND: Fibrotic interstitial lung diseases (fILDs) are a heterogeneous group of lung diseases associated with significant morbidity and mortality. Despite a large increase in the number of clinical trials in the last 10 years, current regulatory-approved management approaches are limited to two therapies that prevent the progression of fibrosis. The drug development pipeline is long and there is an urgent need to accelerate this process. This manuscript introduces the concept and design of an innovative research approach to drug development in fILD: a global Randomised Embedded Multifactorial Adaptive Platform in fILD (REMAP-ILD). METHODS: Description of the REMAP-ILD concept and design: the specific terminology, design characteristics (multifactorial, adaptive features, statistical approach), target population, interventions, outcomes, mission and values, and organisational structure. RESULTS: The target population will be adult patients with fILD, and the primary outcome will be a disease progression model incorporating forced vital capacity and mortality over 12 months. Responsive adaptive randomisation, prespecified thresholds for success and futility will be used to assess the effectiveness and safety of interventions. REMAP-ILD embraces the core values of diversity, equity, and inclusion for patients and researchers, and prioritises an open-science approach to data sharing and dissemination of results. CONCLUSION: By using an innovative and efficient adaptive multi-interventional trial platform design, we aim to accelerate and improve care for patients with fILD. Through worldwide collaboration, novel analytical methodology and pragmatic trial delivery, REMAP-ILD aims to overcome major limitations associated with conventional randomised controlled trial approaches to rapidly improve the care of people living with fILD.