Human factors methods in the design of digital decision support systems for population health: a scoping review.

BACKGROUND: While Human Factors (HF) methods have been applied to the design of decision support systems (DSS) to aid clinical decision-making, the role of HF to improve decision-support for population health outcomes is less understood. We sought to comprehensively understand how HF methods have been used in designing digital population health DSS. MATERIALS AND METHODS: We searched English documents published in health sciences and engineering databases (Medline, Embase, PsychINFO, Scopus, Comendex, Inspec, IEEE Xplore) between January 1990 and September 2023 describing the development, validation or application of HF principles to decision support tools in population health. RESULTS: We identified 21,581 unique records and included 153 studies for data extraction and synthesis. We included research articles that had a target end-user in population health and that used HF. HF methods were applied throughout the design lifecycle. Users were engaged early in the design lifecycle in the needs assessment and requirements gathering phase and design and prototyping phase with qualitative methods such as interviews. In later stages in the lifecycle, during user testing and evaluation, and post deployment evaluation, quantitative methods were more frequently used. However, only three studies used an experimental framework or conducted A/B testing. CONCLUSIONS: While HF have been applied in a variety of contexts in the design of data-driven DSSs for population health, few have used Human Factors to its full potential. We offer recommendations for how HF can be leveraged throughout the design lifecycle. Most crucially, system designers should engage with users early on and throughout the design process. Our findings can support stakeholders to further empower public health systems.

"We are the forgotten grievers": Bereaved family members' experiences of support and mental ill-health following a road traffic collision.

Road traffic collisions (RTCs) are a global public health concern; however, research on the impact of bereavement on families remains limited. A critical realist approach was adopted to explore experiences of families suffering bereavement following RTCs, using interviews with 14 participants in the United Kingdom (UK) who have lost a family member. Three key themes were identified: (1) worsening mental health following bereavement, (2) negative impact of an RTC-related bereavement upon family members, (3) limited support following an RTC. Findings highlighted the requirement for appropriate support for bereaved families, and outlined significant flaws within the UK legal system, sentencing, and treatment of families.

Rates and Reasons for Readmission after Hospitalisation on the Acute Medical Unit.

INTRODUCTION: Readmission after hospital discharge is an ongoing challenge that healthcare systems face worldwide, with multimorbidity increasing the readmission risk significantly. Identifying higher risk groups of patients allows for safety netting at discharge to be implemented to prevent harm. The aim of this study was to compare readmission rates and reasons across common diagnostic groups presenting to the acute medical unit. METHOD: A retrospective analysis was performed on an anonymous dataset extracted from Salford Royal Hospital from 2014 - 2022 covering all non-elective inpatient admissions to AMU or medical same day emergency care where the patient survived to discharge. Episodes were grouped according to ICD-10 diagnostic codes, with readmission rates and reasons at 30 and 90 day calculated and compared using descriptive statistics. Further subgroups were evaluated according to demographic and co-morbid features. RESULTS: There were 89,897 admissions to AMU and SDEC where patients survived to discharge: age 68±19 years, 53% female. 5,880 episodes were excluded due to inpatient death. The most common first admission reasons were pneumonia (n=9,121), COPD (4,800) and sepsis (3,440). The overall 30 day readmission rate was 12.3%, with the highest rates being found where first admission episode was due to liver disease (21.9%), chronic obstructive pulmonary disease (COPD, 21.1%), and falls (17.9%). 6% of all patients were readmitted within 30 days due to recurrence of the primary presenting illness, representing 49% of all readmissions. After primary illness recurrence, pneumonia was the second most common readmission reason in 17 of 22 diagnostic groups and accounted for 25% of all readmissions excluding primary illness recurrence. Overall 90 day readmission rate was 24.2% with the same 3 most common diagnostic groups (liver disease 44%, COPD 39% and falls 34%). For 90 day readmission reasons according to specified comorbidities, the highest rates were seen in heart failures (34.1%) and COPD (33.1%). The highest readmission reason in the diagnostic groups was 41.4% of heart failure patients being readmitted with respiratory causes. Heart failure was the most impactful co-morbid factor associated with higher likelihood of 90 day readmission in other disease presentations (34.4% with heart failure, 22.8% without). DISCUSSION: Readmission rates vary significantly between diagnostic and co-morbid groups meaning that targeting high risk groups for safety netting may be possible using only simple admission details.

Emergency admissions' diagnoses and risk of in-hospital death according to the primary ICD-10 chapter assigned at discharge and the National Early Warning Score on admission.

BACKGROUND: The relationship between diagnosis, illness severity, and mortality risk for unselected emergency admissions is poorly defined. AIM: To define primary ICD-10 diagnostic chapters at discharge, admission illness severity by the National Early Warning Score, and in-hospital mortality for all unselected emergency admissions. METHOD: Retrospective, observational, cohort study of 122,259 unselected, adult emergency admissions to Salford Royal Hospital between 2014 and 2022. RESULTS: In-hospital mortality was 4.3% but most patients had an ICD-10 chapter associated with a lower risk of death. 60% of in-hospital deaths were in four chapters, infections, circulatory and respiratory diseases, or neoplasms. An admission NEWS ≥3 was associated with earlier mortality and an eight-fold increased risk of in-hospital mortality. 45% of all in-hospital deaths occurred in patients with an admission NEWS <3. CONCLUSION: Mortality in emergency hospital admissions is associated with illness severity and four diagnostic chapters. NEWS should not be the only arbiter of hospital admission, as for certain diagnostic chapters the risk of death is high even if vital signs on presentation are normal.

Acute Medicine: How will we grow? - An analysis of organisational capabilities for quality improvement, research & education from SAMBA 2021.

BACKGROUND: Education, research, and Quality Improvement (QI) are key enablers for high quality care. We aimed to map the capability of Acute Medical Units (AMUs) to facilitate excellence in these areas. METHODS: AMUs were surveyed in an organisational questionnaire within the Society for Acute Medicine Benchmarking Audit 2021. RESULTS: 143 units participated. 80 units had a QI lead, 24 had a research lead and 99 had a medical education lead. 15 units had all three leadership roles. Most QI work considered service structure rather than changes in processes or care outcomes. CONCLUSION: The organisational capability of AMUs in the strategic areas considered is variable. Improving leadership and disseminating learning could help build a strategic foundation for acute medicine to grow.

Implementation of a Night-Float Curriculum: Impact on Intern Confidence over Time.

OBJECTIVES: Formal nighttime education is becoming increasingly necessary as more internal medicine (IM) residency programs adopt night-float rotations (NFRs); however, the efficacy of an NFR curriculum throughout an academic year and which topics in an NFR curriculum increase trainee confidence are unknown. We implemented a 12-module, self-paced NFR curriculum for 76 postgraduate year-1 residents at an academic IM residency program. We evaluated the impact of this curriculum on postgraduate year-1 residents' clinical confidence, as well as longitudinal efficacy of the curriculum. METHODS: Night-float interns' (NFIs) clinical confidence regarding specific curricular topics was evaluated overall and during specific timeframes within the academic year. Pre- and post-NFR surveys using Likert scales for each topic were administered to NFIs from June 24, 2020 to March 2, 2021, representing 32 week-long NFR cycles. RESULTS: NFIs' pre- and postrotation confidence in managing clinical scenarios significantly improved for all 12 topics in the NFR curriculum. The NFR curriculum resulted most significantly in improved confidence during the first 4 months of the academic year, with 11 of 12 curricular topics reaching the threshold for statistical significance. Modules on altered mental status, hypotension, narrow-complex tachyarrhythmias, new fever, and sepsis and antibiotic escalation maintained their efficacy for the longest periods of time. CONCLUSIONS: It may be especially important to emphasize an NFR curriculum at the beginning of the academic year. IM residency programs also may wish to carefully consider that certain topics may maintain their efficacy throughout the year, whereas other topics should potentially be replaced with more complex modules as the academic year progresses.

A mirror in the sky: the effects of map format and user expertise on navigation performance and mental workload.

A novel map display concept named Mirror in the Sky (MitS) has been introduced to improve performance and reduce workload in navigation tasks. However, this display will be novel to most users and as such, an evaluation of MitS in comparison with more conventional map formats is warranted. This study investigated the effects of map display format (MitS vs. north-up and track-up maps) and user expertise on mental workload (MWL) and performance, using both soldiers (experts) and civilians (novices) as participants. Participants followed a prescribed route to a destination in a virtual environment (route following task) while also performing a secondary task (detection response task). Soldiers generally performed better than civilians. Soldiers reported a higher MWL with MitS than with the north-up map, whereas civilians reported a higher MWL with MitS than with the track-up map. Regardless of user expertise, there were performance and workload challenges with MitS, despite its potential. Practitioner summary: A new map display concept called Mirror in the Sky (MitS) was compared with two conventional map formats: a north-up and track-up map. The experiment tested soldier and civilian users in a route following task. Both groups got further into the route and had fewer obstacle collisions with north-up and track-up maps than they did with the MitS map. MWL measures generally indicated higher workload with MitS. Abbreviations: MitS: mirror in the sky; FFOV: forward field of view; AR: augmented reality; MWL: mental workload; VR: virtual reality; HF: human factors; HR: heart rate; HRV: heart rate variability; DRT: detection response task; DRDC: defence research and development Canada; VE: virtual environment; RT: response time; ANOVA: analysis of variance.

Comparing an augmented reality navigation display to an electronic map for military reconnaissance.

The next generation of displays for soldiers may include augmented reality capabilities. One such display, called Mirror in the Sky (MitS), presents survey information in the upper visual field. Using a virtual reality simulation of a military reconnaissance scenario, we compared a MitS prototype to a familiar electronic 2D north-up map. Participants (24 soldiers) were told to follow a prescribed route, detect potential threats, and reroute around them. They also performed a secondary task as a measure of mental workload. At the end of the route, the soldiers were asked to recall the locations of threats and route changes. Participants made better reroute decisions with the north-up map than with MitS, although no differences were observed for threat detection or mental workload. They also scored higher on recall with the north-up map than with MitS. Practitioner Summary: An augmented reality navigation aid was compared to an electronic north-up map in a military reconnaissance scenario, in a virtual reality simulation. Participants made better route decisions and had better recall with the north-up map, but no mental workload differences were found between displays.

Improving and Sustaining the Quality of Discharge Summaries.

High quality discharge information communication has been linked to a reduction in the incidence of adverse events, decreasing the risk of prescription errors and lost follow up. In this paper we describe how our trust-wide quality improvement project, led by acute physicians, successfully improved discharge documentation. We demonstrate how we identified obstacles to continued success, and the interventions we implemented. We recommend how discharge summary quality can be optimised through training of junior doctors, recruitment of local champions, and use of novel methods to preserve engagement, such as gamification.

Society for Acute Medicine Benchmarking Audit 2021 (SAMBA21): assessing national performance of acute medicine services.

INTRODUCTION: The Society for Acute Medicine Benchmarking Audit 2021 (SAMBA21) took place on 17th June 2021, providing the first assessment of performance against the Society for Acute Medicine's Clinical Quality Indicators (CQIs) within acute medical units since the start of the COVID-19 pandemic. METHODS: All acute hospitals in the UK were invited to participate. Data were collected on unit structure, and for patients admitted to acute medicine services over a 24-hour period, with follow-up at 7 days. RESULTS: 158 units participated in SAMBA21, from 156 hospitals. 8973 patients were included. The number of admissions per unit had increased compared to SAMBA19 (Sign test p<0.005). An early warning score was recorded within 30 minutes of hospital arrival in 77.4% of patients. 87.4% of unplanned admissions were seen by a tier 1 clinician within 4 hours of arrival. Overall, the medical team performed the initial clinician assessment for 36.4% of unplanned medical admissions. More than a third of medical admissions had their initial assessment in Same Day Emergency Care (SDEC) in 25.4% of hospitals. 62.1% of unplanned admissions were seen by two other clinical decision makers prior to consultant review. Of those unplanned admissions requiring consultant review, 67.8% were seen within the target time. More than a third of unplanned admissions were discharged the same day in 41.8% of units. CONCLUSION: Performance against the CQIs for acute medicine was maintained in comparison to previous rounds of SAMBA, despite increased admissions. There remains considerable variation in unit structure and performance within acute medical services.

Length of stay in Acute Medical Admissions: Analysis from the Society for Acute Medicine Benchmarking Audit.

INTRODUCTION: Medical admissions to hospital represent a diverse range of patients, from those managed on ambulatory pathways through Same Day Emergency Care (SDEC) services, to those requiring prolonged inpatient admission. An understanding of current patterns of admission through acute medicine services and patient factors associated with longer hospital admission is needed to guide service planning and improvement. METHODS: Data from the Society for Acute Medicine Benchmarking Audit (SAMBA) 2021 were analysed. Patients admitted to acute medicine services during a 24-hour period on 17th June 2021 were included, with data recording patient demographics, frailty score, acuity and follow-up of outcomes after seven days. RESULTS: 8101 unplanned medical admissions were included, from 156 hospitals. 31.6% were discharged without overnight admission; the median hospital performance was 30.1% (IQR 19.3-39.3%). 22.1% of patients remained in hospital for more than 7 days. Those remaining in hospital for more than 48 hours and for more than seven days were more likely to be aged over 70, to be frail, or to have a NEWS2 of 3 or more on arrival to hospital. CONCLUSION: The proportion of acute medical attendances receiving overnight admission varies between hospitals. Length of stay is impacted by patient factors and illness acuity. Strategies to reduce inpatient service pressures must ensure effective care for older patients and those with frailty.

Developing priorities for quality improvement in acute medicine using a modified Delphi method A consensus process hosted by the Society for Acute Medicine Quality Improvement Committee (SAM-QI).

INTRODUCTION: The SAM Quality Improvement Committee (SAM-QI), set up in 2016, has worked over the last year to determine the priority Acute Medicine QI topics. They have also discussed and put forward proposals to improve QI training for Acute Medicine professionals. METHODS: A modified Delphi process was completed over four rounds to determine priority QI topics. Online meetings were also used to develop proposals for QI training. RESULTS: Same Day Emergency Care (SDEC) was chosen as the priority topic for QI work within Acute Medicine. CONCLUSION: The SAM-QI group settled on SDEC being the priority topic for Acute Medicine QI development. Throughout the Delphi process SAM-QI has also developed proposals for QI training that will help Acute Medicine professionals deliver coordinated meaningful improvements in care.

Guest Editorial - Acute Medicine and Pandemics: Getting It Right Next Time!

For those of you who are not aware of what GIRFT (Getting It Right First Time) is, let me start by saying it is a brilliant idea, genius perhaps. The vision of its founder, Professor Tim Briggs CBE, was to optimise orthopaedic care by using the most clinically and cost effective treatments, minimising waste, reducing variation and eliminating poor practice. Since 2014 in orthopaedics alone, operational and financial opportunities to save the NHS £696 million have been generated. Acute medicine, coupled with general medicine, has been part of the GIRFT programme since 2017. The mischievous reader might question the name, as clearly this is about getting things right at the second time of asking at the very earliest. Apart from that pedantic note, GIRFT is a force for good.

Quality: What does it mean in Acute Medicine and how do we measure it?

Acute Medicine is a specialty that is not defined by a single organ system and sits at the interface between primary and secondary care. In order to document improvements in the quality of care delivered a system of metrics is required. A number of frameworks for measurements exist to quantify quality of care at the level of patients, teams and organisations, such as measures of population health, patient satisfaction and cost per patient. Measures can capture whether care is safe, effective, patient-centred, timely, efficient and equitable. Measurement in Acute Medicine is challenged by the often-transient nature of the contact between Acute Medicine clinicians and patients, the lack of diagnostic labels, a low degree of standardisation and difficulties in capturing the patient experience in the context. In a time of increasing ecological and financial constraints, reflecting about the most appropriate metrics to document the impact of Acute Medicine is required.

Society for Acute Medicine Benchmarking Audit 2019 (SAMBA19): Trends in Acute Medical Care.

INTRODUCTION: The eighth Society for Acute Medicine Benchmarking Audit (SAMBA19) took place on Thursday 27th June 2019. SAMBA gives a broad picture of acute medical care in the UK and allows individual units to compare their performance against their peers. METHOD: All UK hospitals were invited to participate. Unit and patient level were collected. Data were analysed against published Clinical Quality indicators (CQI) and standards. This was the biggest SAMBA to date, with data from 7170 patients across 142 units in 140 hospitals. RESULTS: 84.5% of patients had an Early Warning Score measured within 30 minutes of arrival in hospital (SAMBA18 84.1%), 90.4% of patients were seen by a competent clinical decision maker within four hours of arrival in hospital (SAMBA18 91.4 %) and 68.6% of patients were seen by a consultant within the timeframe standard (SAMBA18 62.7%). Ambulatory Emergency Care is provided in 99.3% of hospitals. 61.8% of patients are initially seen in the Emergency Department (ED). Since SAMBA18 death rates and planned discharge rates, while the use of NEWS2 increased from 2.5% to 59.2% of hospitals. CONCLUSION: SAMBA19 highlighted the evolving complexity of acute medical pathways for patients. The challenge now is to increase sample frequency, assess the impact of SAMBA open a broader debate to define optimal CQIs.

Acute care service performance during winter: report from the winter SAMBA 2020 national audit of acute care.

The Winter Society for Acute Medicine Benchmarking Audit (SAMBA) provides the first comparison of performance within acute medicine against clinical quality indicators during winter, a time of increased pressure and demand on acute services. 105 hospitals participated in Winter SAMBA, collecting data over 24-hours on 30th January 2020. 5626 patients were included. Participating units saw a median of 48 patients (range 13-131). Comparison between Winter SAMBA and SAMBA19 found less patients had an early warning score within 30 minutes during winter (74.3% vs 78.9%) and less were seen by a clinical decision maker within four hours (84.9% vs 87.9%). Unplanned admissions represented a higher proportion of workload (92.5% vs 90.1%). Patients were more likely to have a NEWS2 score of 3 or higher (30.1% vs 25.7%). Performance is poorer in winter, and patients are more unwell, needing prompt treatment. Services should ensure high quality care can be maintained through times of increased pressure, including winter.

SAMBA18 Report - A National Audit of Acute Medical Care in the UK.

SAMBA18 took place on Thursday 28th June 2018 with follow up data at 7 days. Acute medical teams from 127 Acute Medical Units (AMUs) across the UK collected data relating to operational performance, clinical quality indicators and standards from NHS Improvement. Data was collected from 6114 patients.

Phosphorylation of Eukaryotic Initiation Factor-2α during Stress and Encystation in Entamoeba Species.

Entamoeba histolytica is an enteric pathogen responsible for amoebic dysentery and liver abscess. It alternates between the host-restricted trophozoite form and the infective environmentally-stable cyst stage. Throughout its lifecycle E. histolytica experiences stress, in part, from host immune pressure. Conversion to cysts is presumed to be a stress-response. In other systems, stress induces phosphorylation of a serine residue on eukaryotic translation initiation factor-2α (eIF2α). This inhibits eIF2α activity resulting in a general decline in protein synthesis. Genomic data reveal that E. histolytica possesses eIF2α (EheIF2α) with a conserved phosphorylatable serine at position 59 (Ser59). Thus, this pathogen may have the machinery for stress-induced translational control. To test this, we exposed cells to different stress conditions and measured the level of total and phospho-EheIF2α. Long-term serum starvation, long-term heat shock, and oxidative stress induced an increase in the level of phospho-EheIF2α, while short-term serum starvation, short-term heat shock, or glucose deprivation did not. Long-term serum starvation also caused a decrease in polyribosome abundance, which is in accordance with the observation that this condition induces phosphorylation of EheIF2α. We generated transgenic cells that overexpress wildtype EheIF2α, a non-phosphorylatable variant of eIF2α in which Ser59 was mutated to alanine (EheIF2α-S59A), or a phosphomimetic variant of eIF2α in which Ser59 was mutated to aspartic acid (EheIF2α-S59D). Consistent with the known functions of eIF2α, cells expressing wildtype or EheIF2α-S59D exhibited increased or decreased translation, respectively. Surprisingly, cells expressing EheIF2α-S59A also exhibited reduced translation. Cells expressing EheIF2α-S59D were more resistant to long-term serum starvation underscoring the significance of EheIF2α phosphorylation in managing stress. Finally, phospho-eIF2α accumulated during encystation in E. invadens, a model encystation system. Together, these data demonstrate that the eIF2α-dependent stress response system is operational in Entamoeba species.

Study of physical function in adolescents with haemophilia: The SO-FIT study.

INTRODUCTION: Contemporary haemophilia care demands Patient-Reported Outcomes. SO-FIT is a UK multi-centre study, assessing self-reported function, health-related quality of life (HRQoL) and joint health in boys with severe haemophilia. METHODS: Subjective physical function (PedHAL, HEP-Test-Q) and HRQoL (Haemo-QoL Short Form [SF]) were assessed alongside joint health using the objective Haemophilia Joint Health Score (HJHS v2.1). Demographic and clinical data were collected. RESULTS: Data from 127 boys mean age 12.38 ± 2.5 (range 8-17) treated at 16 sites were analysed. One-hundred-and-thirteen had haemophilia A, 25/9 past/current inhibitor, 124 were treated prophylactically (46.8% primary) and three on-demand. In the preceding 6 months, boys reported median 0 joint bleeds (range 0-8) with a median HJHS score of 1 (range 0-30). Boys reported good physical functioning; HEP-Test-Q (M = 80.32 ± 16.1) showed the highest impairments in the domain "endurance" (72.53 ± 19.1), in PedHAL (M = 85.44 ± 18.9) highest impairments were in the domains "leisure activities & sports" (M = 82.43 ± 23.4) and "lying/sitting/kneeling/standing" (M = 83.22 ± 20.3). Boys reported generally good HRQoL in Haemo-QoL SF SF (M = 22.81 ± 15.0) with highest impairments in the domains "friends" (M = 28.81 ± 30.5) and "sports & school" (M = 26.14 ± 25.1). HJHS revealed low correlations with the Haemo-QoL SF (r = .251, P < .006), the PedHAL (r = -.397, P < .0001) and the HEP-Test-Q (r = -.323, P < .0001). A moderate correlation was seen between HEP-Test-Q and Haemo-QoL SF of r = -.575 (P < .0001) and between PedHAL and Haemo-QoL SFr = -.561 (P < .0001) implying that good perceived physical function is related to good HRQoL. CONCLUSIONS: The SO-FIT study has demonstrated that children with severe haemophilia in the UK report good HRQoL and have good joint health as reflected in low HJHS scores.

Endometrial biopsy in Bos indicus beef heifers.

An endometrial biopsy allows for a comprehensive assessment of the uterine environment of a breeding female. Although routine in mares, devices used for endometrial biopsies are impracticable in heifers due to the size and structure of the cervix. This report describes the use of a human bronchoscopy biopsy device (Karl Storz® 10366L) for collection of endometrial biopsies in Bos indicus beef heifers. The Storz® device is smaller and thinner and enabled the collection of an endometrial biopsy in 86% of heifers (n = 44/51). The biopsied tissue was of good quality and suitable for transcriptomic assessment of the endometrium, with total RNA yield and RNA integrity number (RIN) averaging 1.3 µg (range 0.4-5.3 µg) and 7.4 (range 5.7-8.4), respectively.