Outcome-based analytical performance specifications: current status and future challenges.

Analytical performance specifications (APS) based on outcomes refer to how 'good' the analytical performance of a test needs to be to do more good than harm to the patient. Analytical performance of a measurand affects its clinical performance. Without first setting clinical performance requirements, it is difficult to define how good analytically the test needs to be to meet medical needs. As testing is indirectly linked to health outcomes through clinical decisions on patient management, often simulation-based studies are used to assess the impact of analytical performance on the probability of clinical outcomes which is then translated to Model 1b APS according to the Milan consensus. This paper discusses the related key definitions, concepts and considerations that should assist in finding the most appropriate methods for deriving Model 1b APS. We review the advantages and limitations of published methods and discuss the criteria for transferability of Model 1b APS to different settings. We consider that the definition of the clinically acceptable misclassification rate is central to Model 1b APS. We provide some examples and guidance on a more systematic approach for first defining the clinical performance requirements for tests and we also highlight a few ideas to tackle the future challenges associated with providing outcome-based APS for laboratory testing.

A summary of the 2023 Society of Obstetric Medicine of Australia and New Zealand (SOMANZ) hypertension in pregnancy guideline.

INTRODUCTION: Hypertensive disorders of pregnancy (HDP) affect up to 10% of all pregnancies annually and are associated with an increased risk of maternal and fetal morbidity and mortality. This guideline represents an update of the Society of Obstetric Medicine of Australia and New Zealand (SOMANZ) guidelines for the management of hypertensive disorders of pregnancy 2014 and has been approved by the National Health and Medical Research Council (NHMRC) under section 14A of the National Health and Medical Research Council Act 1992. In approving the guideline recommendations, NHMRC considers that the guideline meets NHMRC's standard for clinical practice guidelines. MAIN RECOMMENDATIONS: A total of 39 recommendations on screening, preventing, diagnosing and managing HDP, especially preeclampsia, are presented in this guideline. Recommendations are presented as either evidence-based recommendations or practice points. Evidence-based recommendations are presented with the strength of recommendation and quality of evidence. Practice points were generated where there was inadequate evidence to develop specific recommendations and are based on the expertise of the working group. CHANGES IN MANAGEMENT RESULTING FROM THE GUIDELINE: This version of the SOMANZ guideline was developed in an academically robust and rigorous manner and includes recommendations on the use of combined first trimester screening to identify women at risk of developing preeclampsia, 14 pharmacological and two non-pharmacological preventive interventions, clinical use of angiogenic biomarkers and the long term care of women who experience HDP. The guideline also includes six multilingual patient infographics which can be accessed through the main website of the guideline. All measures were taken to ensure that this guideline is applicable and relevant to clinicians and multicultural women in regional and metropolitan settings in Australia and New Zealand.

Applying the Milan models to setting analytical performance specifications - considering all the information.

Analytical performance specifications (APS) are used for decisions about the required analytical quality of pathology tests to meet clinical needs. The Milan models, based on clinical outcome, biological variation, or state of the art, were developed to provide a framework for setting APS. An approach has been proposed to assign each measurand to one of the models based on a defined clinical use, physiological control, or an absence of quality information about these factors. In this paper we propose that in addition to such assignment, available information from all models should be considered using a risk-based approach that considers the purpose and role of the actual test in a clinical pathway and its impact on medical decisions and clinical outcomes in addition to biological variation and the state-of-the-art. Consideration of APS already in use and the use of results in calculations may also need to be considered to determine the most appropriate APS for use in a specific setting.

How should artificial intelligence be used in Australian health care? Recommendations from a citizens' jury.

OBJECTIVE: To support a diverse sample of Australians to make recommendations about the use of artificial intelligence (AI) technology in health care. STUDY DESIGN: Citizens' jury, deliberating the question: "Under which circumstances, if any, should artificial intelligence be used in Australian health systems to detect or diagnose disease?" SETTING, PARTICIPANTS: Thirty Australian adults recruited by Sortition Foundation using random invitation and stratified selection to reflect population proportions by gender, age, ancestry, highest level of education, and residential location (state/territory; urban, regional, rural). The jury process took 18 days (16 March - 2 April 2023): fifteen days online and three days face-to-face in Sydney, where the jurors, both in small groups and together, were informed about and discussed the question, and developed recommendations with reasons. Jurors received extensive information: a printed handbook, online documents, and recorded presentations by four expert speakers. Jurors asked questions and received answers from the experts during the online period of the process, and during the first day of the face-to-face meeting. MAIN OUTCOME MEASURES: Jury recommendations, with reasons. RESULTS: The jurors recommended an overarching, independently governed charter and framework for health care AI. The other nine recommendation categories concerned balancing benefits and harms; fairness and bias; patients' rights and choices; clinical governance and training; technical governance and standards; data governance and use; open source software; AI evaluation and assessment; and education and communication. CONCLUSIONS: The deliberative process supported a nationally representative sample of citizens to construct recommendations about how AI in health care should be developed, used, and governed. Recommendations derived using such methods could guide clinicians, policy makers, AI researchers and developers, and health service users to develop approaches that ensure trustworthy and responsible use of this technology.

Systematic review and meta-analysis of prognostic characteristics for breast cancers in populations with digital vs film mammography indicate the transition may have increased both early detection and overdiagnosis.

OBJECTIVES: Film mammography has been replaced by digital mammography in breast screening programs globally. This led to a small increase in the rate of detection, but whether the detection of clinically important cancers increased is uncertain. We aimed to assess the impact on tumor characteristics of screen-detected and interval breast cancers. STUDY DESIGN AND SETTING: We searched seven databases from inception to October 08, 2023, for publications comparing film and digital mammography within the same population of asymptomatic women at population (average) risk of breast cancer. We recorded reported tumor characteristics and assessed risk of bias using the Risk Of Bias In Non-randomised Studies - of Interventions tool. We synthesized results using meta-analyses of random effects. RESULTS: Eighteen studies were included in the analysis from 8 countries, including 11,592,225 screening examinations (8,117,781 film; 3,474,444 digital). There were no differences in tumor size, morphology, grade, node status, receptor status, or stage in the pooled differences for screen-detected and interval invasive cancer tumor characteristics. There were statistically significant increases in screen-detected ductal carcinoma in situ (DCIS) across all grades: 0.05 (0.00-0.11), 0.14 (0.05-0.22), and 0.19 (0.05-0.33) per 1000 screens for low, intermediate, and high-grade DCIS, respectively. There were similar (non-statistically significant) increases in screen-detected invasive cancer across all grades. CONCLUSION: The increased detection of all grades of DCIS and invasive cancer may indicate both increased early detection of more aggressive disease and increased overdiagnosis.

Communicating the Imperfect Diagnostic Accuracy of COVID-19 Rapid Antigen Self-Tests: An Online Randomized Experiment.

OBJECTIVE: To investigate the potential impacts of optimizing coronavirus disease 2019 (COVID-19) rapid antigen test (RAT) self-testing diagnostic accuracy information. DESIGN: Online randomized experiment using hypothetical scenarios: in scenarios 1 to 3 (RAT result positive), the posttest probability was considered to be very high (likely true positives), and in scenarios 4 and 5 (RAT result negative), the posttest probability was considered to be moderately high (likely false negatives). SETTING: December 12 to 22, 2022, during the mixed-variant Omicron wave in Australia. PARTICIPANTS: Australian adults. Intervention: diagnostic accuracy of a COVID-19 self-RAT presented in a health literacy-sensitive way; usual care: diagnostic accuracy information provided by the manufacturer; control: no diagnostic accuracy information. MAIN OUTCOME MEASURE: Intention to self-isolate. RESULTS: A total of 226 participants were randomized (control n = 75, usual care n = 76, intervention n = 75). More participants in the intervention group correctly interpreted the meaning of the diagnostic accuracy information (P = 0.08 for understanding sensitivity, P < 0.001 for understanding specificity). The proportion who would self-isolate was similar across scenarios 1 to 3 (likely true positives). The proportion was higher in the intervention group than in the control for scenarios 4 and 5 (likely false negatives). These differences were not statistically significant. The largest potential effect was seen in scenario 5 (dinner party with confirmed cases, the person has symptoms, negative self-RAT result), with 63% of the intervention group and 49% of the control group indicating they would self-isolate (absolute difference 13.3%, 95% confidence interval: -2% to 30%, P = 0.10). CONCLUSION: Health literacy sensitive formatting supported participant understanding and recall of diagnostic accuracy information. This may increase community intentions to self-isolate when there is a likely false-negative self-RAT result. Trial registration: Australia New Zealand Clinical Trial Registry (ACTRN12622001517763). HIGHLIGHTS: Community-based diagnostic accuracy studies of COVID-19 self-RATs indicate substantially lower sensitivity (and higher risk of false-negative results) than the manufacturer-supplied information on most government public Web sites.This online randomized study found that a health literacy-sensitive presentation of the imperfect diagnostic accuracy COVID-19 self-RATs supported participant understanding and recall of diagnostic accuracy information.Health literacy-sensitive presentation may increase community intentions to self-isolate after a negative test result where the posttest probability is still moderately high (i.e., likely false-negative result).To prevent the onward spread of infection, efforts to improve communication about the high risk of false-negative results from COVID-19 self-RATs are urgently needed.

Methods to Include Environmental Impacts in Health Economic Evaluations and Health Technology Assessments: A Scoping Review.

OBJECTIVES: The environmental impacts of healthcare are important factors that should be considered during health technology assessments. This study aims to summarize the evidence that exists about methods to include environmental impacts in health economic evaluations and health technology assessments. METHODS: We identified records for screening using an existing scoping review and a systematic search of academic databases and gray literature up to September 2023. We screened the identified records for eligibility and extracted data using a narrative synthesis approach. The review was conducted following the JBI Manual for Evidence Synthesis and reported according to the Preferred Reporting Items for Systematic Reviews and Meta Analyses Extension for Scoping Reviews checklist. RESULTS: We identified 2898 records and assessed the full text of 114, of which 54 were included in this review. Ten methods were identified to include environmental impacts in health economic evaluations and health technology assessments. Methods included converting environmental impacts to dollars or disability-adjusted life years and including them in a cost-effectiveness, cost-utility, or cost-benefit analysis, calculating an incremental carbon footprint effectiveness ratio or incremental carbon footprint cost ratio, incorporating impacts as one criteria of a multi-criteria decision analysis, and freely considering impacts during health technology assessment deliberation processes. CONCLUSIONS: Methods to include environmental impacts in health economic evaluations and health technology assessments exist but have not been tested for widespread use by health technology assessment agencies. Further research and implementation work is needed to determine which method can best aid decision makers to choose low environmental impact healthcare interventions.

First implantable cardiac defibrillator insertions in New South Wales, 2005-2020: an analysis of linked administrative data.

OBJECTIVES: To determine the annual numbers of first ICD insertions in New South Wales during 2005-2020; to examine health outcomes for people who first received ICDs during this period. STUDY DESIGN: Retrospective cohort study; analysis of linked administrative health data. SETTING, PARTICIPANTS: All first insertions of ICDs in NSW, 2005-2020. MAIN OUTCOME MEASURES: Annual numbers of first ICD insertions, and of emergency department presentations and hospital re-admissions 30 days, 90 days, 365 days after first ICD insertions; all-cause and disease-specific mortality (to ten years after ICD insertion). RESULTS: During 2005-2020, ICDs were first inserted into 16 867 people (18.5 per 100 000 population); their mean age was 65.7 years (standard deviation, 13.5 years; 7376 aged 70 years or older, 43.7%), 13 214 were men (78.3%). The annual number of insertions increased from 791 in 2005 to 1256 in 2016; the first ICD insertion rate increased from 15.5 in 2005 to 18.9 per 100 000 population in 2010, after which the rate was stable until 2019 (19.8 per 100 000 population). Of the 16 778 people discharged alive from hospital after first ICD insertions, 54.4% presented to emergency departments within twelve months, including 1236 with cardiac arrhythmias (7.4%) and 434 with device-related problems (2.6%); 56% were re-admitted to hospital, including 1944 with cardiac arrhythmias (11.5%) and 2045 with device-related problems (12.1%). A total of 5624 people who received first ICDs during 2005-2020 (33.3%) died during follow-up (6.7 deaths per 100 person-years); the survival rate was 94.4% at one year, 76.5% at five years, and 54.2% at ten years. CONCLUSIONS: The annual number of new ICDs inserted in NSW has increased since 2005. A substantial proportion of recipients experience device-related problems that require re-admission to hospital. The potential harms of ICD insertion should be considered when assessing the likelihood of preventing fatal ventricular arrhythmia.

Using the Behaviour Change Wheel to identify barriers and targeted strategies to improve adherence in randomised clinical trials: The example of MEL-SELF trial of patient-led surveillance for melanoma.

BACKGROUND: Adherence to self-management interventions is critical in both clinical settings and trials to ensure maximal effectiveness. This study reports how the Behaviour Change Wheel may be used to assess barriers to self-management behaviours and develop strategies to maximise adherence in a trial setting (the MEL-SELF trial of patient-led melanoma surveillance). METHODS: The Behaviour Change Wheel was applied by (i) using the Capability, Opportunity, Motivation-Behaviour (COMB) model informed by empirical and review data to identify adherence barriers, (ii) mapping identified barriers to corresponding intervention functions, and (iii) identifying appropriate behaviour change techniques and developing potential solutions using the APEASE (Affordability, Practicability, Effectiveness and cost-effectiveness, Acceptability, Side-effects and safety, Equity) criteria. RESULTS: The target adherence behaviour was defined as conducting a thorough skin self-examination and submitting images for teledermatology review. Key barriers identified included: non-engaged skin check partners, inadequate planning, time constraints, low self-efficacy, and technological difficulties. Participants' motivation was positively influenced by perceived health benefits and negatively impacted by emotional states such as anxiety and depression. We identified the following feasible interventions to support adherence: education, training, environmental restructuring, enablement, persuasion, and incentivisation. Proposed solutions included action planning, calendar scheduling, alternative dermatoscopes, optimised communication, educational resources in various formats to boost self-efficacy and motivation and optimised reminders (which will be evaluated in a Study Within A Trial (SWAT)). CONCLUSION: The Behaviour Change Wheel may be used to improve adherence in clinical trials by identifying barriers to self-management behaviours and guiding development of targeted strategies.

Breast Cancer Stage and Size Detected with Film versus Digital Mammography in New South Wales, Australia: A Population-Based Study Using Routinely Collected Data.

BACKGROUND: Digital mammography has replaced film mammography in breast-screening programs globally, including Australia. This led to an increase in the rate of detection, but whether there was increased detection of clinically important cancers is uncertain. METHODS: In this population-wide retrospective cohort study in New South Wales, Australia spanning 2004 to 2016 and including 4,631,656 screens, there were 22,965 cancers in women screened with film (n = 11,040) or digital mammography (n = 11,925). We examined the change in tumor characteristics overall and how these rates changed over time, accounting for changes in background rates using an interrupted time-series. Comparisons were made with unscreened women (n = 26,326) during this time. RESULTS: We found increased detection of in situ cancer (3.36 per 10,000 screens), localized invasive, and smaller-sized breast cancers attributable to the change in mammography technology, whereas screen-detected intermediate-sized and metastatic breast cancers decreased. Rates of early-stage and intermediate-sized interval cancers increased, and late-stage (-1.62 per 10,000 screens) and large interval cancers decreased. In unscreened women, there were small increases in the temporal trends of cancers across all stages. CONCLUSIONS: At least some of the increased detection of smaller early-stage cancers may have translated into a reduction in larger and late-stage cancers, indicating beneficial detection of cancers that would have otherwise progressed. However, the increased detection of smaller early-stage and small cancers may also have increased over-diagnosis of lesions that would otherwise have not caused harm. IMPACT: Robust evaluation of potential benefits and harms is needed after changes to screening programs. See related In the Spotlight, p. 638.

Ecological study estimating melanoma overdiagnosis in the USA using the lifetime risk method.

OBJECTIVES: To quantify the proportion of melanoma diagnoses (invasive and in situ) in the USA that might be overdiagnosed. DESIGN: In this ecological study, incidence and mortality data were collected from the Surveillance, Epidemiology and End Results 9 registries database. DevCan software was used to calculate the cumulative lifetime risk of being diagnosed with melanoma between 1975 and 2018, with adjustments made for changes in longevity and risk factors over the study period. SETTING: USA. PARTICIPANTS: White American men and women (1975-2018). MAIN OUTCOME MEASURES: The primary outcome was excess lifetime risk of melanoma diagnosis between 1976 and 2018 (adjusted for year 2018 competing mortality and changes in risk factors), which was inferred as likely overdiagnosis. The secondary outcome was an excess lifetime risk of melanoma diagnosis in each year between 1976 and 2018 (adjusted and unadjusted). RESULTS: Between 1975 and 2018 the adjusted lifetime risk of being diagnosed with melanoma (invasive and in situ) increased from 3.2% (1 in 31) to 6.4% (1 in 16) among white men, and from 1.6% (1 in 63) to 4.5% (1 in 22) among white women. Over the same period, the adjusted lifetime risk of being diagnosed with melanoma in situ increased from 0.17% (1 in 588) to 2.7% (1 in 37) in white men and 0.08% (1 in 1250) to 2.0% (1 in 50) in white women. An estimated 49.7% of melanomas diagnosed in white men and 64.6% in white women were overdiagnosed in 2018. Among people diagnosed with melanomas in situ, 89.4% of white men and 85.4% of white women were likely overdiagnosed in 2018. CONCLUSIONS: Melanoma overdiagnosis among white Americans is significant and increasing over time with an estimated 44 000 overdiagnosed in men and 39 000 in women in 2018. A large proportion of overdiagnosed melanomas are in situ cancers, pointing to a potential focus for intervention.

Can evidence drive health equity in the COVID-19 pandemic and beyond?

Using scoping review methods, we systematically searched multiple online databases for publications in the first year of the pandemic that proposed pragmatic population or health system-level solutions to health inequities. We found 77 publications with proposed solutions to pandemic-related health inequities. Most were commentaries, letters, or editorials from the USA, offering untested solutions, and no robust evidence on effectiveness. Some of the proposed solutions could unintentionally exacerbate health inequities. We call on health policymakers to co-create, co-design, and co-produce equity-focussed, evidence-based interventions with communities, focussing on those most at risk to protect the population as a whole. Epidemiologists collaborating with people from other relevant disciplines may provide methodological expertise for these processes. As epidemiologists, we must interrogate our own methods to avoid propagating any unscientific biases we may hold. Epidemiology must be used to address, and never exacerbate, health inequities-in the pandemic and beyond.

Evidence for overdiagnosis in noncancer conditions was assessed: a metaepidemiological study using the 'Fair Umpire' framework.

OBJECTIVES: To evaluate the strength of the evidence for, and the extent of, overdiagnosis in noncancer conditions. STUDY DESIGN AND SETTING: We systematically searched for studies investigating overdiagnosis in noncancer conditions. Using the 'Fair Umpire' framework to assess the evidence that cases diagnosed by one diagnostic strategy but not by another may be overdiagnosed, two reviewers independently identified whether a Fair Umpire-a disease-specific clinical outcome, a test result or risk factor that can determine whether an additional case does or does not have disease-was present. Disease-specific clinical outcomes provide the strongest evidence for overdiagnosis, follow-up or concurrent tests provide weaker evidence, and risk factors provide only weak evidence. Studies without a Fair Umpire provide the weakest evidence of overdiagnosis. RESULTS: Of 132 studies, 47 (36%) did not include a Fair Umpire to adjudicate additional diagnoses. When present, the most common Umpire was a single test or risk factor (32% of studies), with disease-specific clinical outcome Umpires used in only 21% of studies. Estimates of overdiagnosis included 43-45% of screen-detected acute abdominal aneurysms, 54% of cases of acute kidney injury, and 77% of cases of oligohydramnios in pregnancy. CONCLUSION: Much of the current evidence for overdiagnosis in noncancer conditions is weak. Application of the framework can guide development of robust studies to detect and estimate overdiagnosis in noncancer conditions, ultimately informing evidence-based policies to reduce it.

Exploring anaesthetists' views on the carbon footprint of anaesthesia and identifying opportunities and challenges for reducing its impact on the environment.

A shift in practice by anaesthetists away from anaesthetic gases with high global warming potential towards lower emission techniques (e.g. total intravenous anaesthesia) could result in significant carbon savings for the health system. The purpose of this qualitative interview study was to understand anaesthetists' perspectives on the carbon footprint of anaesthesia, and views on shifting practice towards more environmentally sustainable options. Anaesthetists were recruited from four hospitals in Western Sydney, Australia. Data were organised according to the capability-opportunity-motivation model of behaviour change. Twenty-eight anaesthetists were interviewed (July-September 2021). Participants' age ranged from 29 to 62 years (mean 43 years), 39% were female, and half had completed their anaesthesia training between 2010 and 2019. Challenges to the wider use of greener anaesthetic agents were identified across all components of the capability-opportunity-motivation model: capability (gaps in clinician skills and experience, uncertainty regarding research evidence); opportunity (norms, time, and resource pressures); and motivation (beliefs, habits, responsibility and guilt). Suggestions for encouraging a shift to more environmentally friendly anaesthesia included access to education and training, implementing guidelines and audit/feedback models, environmental restructuring, improving resource availability, reducing low value care, and building the research evidence base on the safety of alternative agents and their impacts on patient outcomes. We identified opportunities and challenges to reducing the carbon footprint of anaesthesia in Australian hospitals by way of system-level and individual behavioural change. Our findings will be used to inform the development of communication and behavioural interventions aiming to mitigate carbon emissions of healthcare.