Estimating classification consistency of machine learning models for screening measures.

This article illustrates novel quantitative methods to estimate classification consistency in machine learning models used for screening measures. Screening measures are used in psychology and medicine to classify individuals into diagnostic classifications. In addition to achieving high accuracy, it is ideal for the screening process to have high classification consistency, which means that respondents would be classified into the same group every time if the assessment was repeated. Although machine learning models are increasingly being used to predict a screening classification based on individual item responses, methods to describe the classification consistency of machine learning models have not yet been developed. This article addresses this gap by describing methods to estimate classification inconsistency in machine learning models arising from two different sources: sampling error during model fitting and measurement error in the item responses. These methods use data resampling techniques such as the bootstrap and Monte Carlo sampling. These methods are illustrated using three empirical examples predicting a health condition/diagnosis from item responses. R code is provided to facilitate the implementation of the methods. This article highlights the importance of considering classification consistency alongside accuracy when studying screening measures and provides the tools and guidance necessary for applied researchers to obtain classification consistency indices in their machine learning research on diagnostic assessments. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

ACR Appropriateness Criteria® Female Breast Cancer Screening: 2023 Update.

Early detection of breast cancer from regular screening substantially reduces breast cancer mortality and morbidity. Multiple different imaging modalities may be used to screen for breast cancer. Screening recommendations differ based on an individual's risk of developing breast cancer. Numerous factors contribute to breast cancer risk, which is frequently divided into three major categories: average, intermediate, and high risk. For patients assigned female at birth with native breast tissue, mammography and digital breast tomosynthesis are the recommended method for breast cancer screening in all risk categories. In addition to the recommendation of mammography and digital breast tomosynthesis in high-risk patients, screening with breast MRI is recommended. The American College of Radiology Appropriateness Criteria are evidence-based guidelines for specific clinical conditions that are reviewed annually by a multidisciplinary expert panel. The guideline development and revision process support the systematic analysis of the medical literature from peer reviewed journals. Established methodology principles such as Grading of Recommendations Assessment, Development, and Evaluation or GRADE are adapted to evaluate the evidence. The RAND/UCLA Appropriateness Method User Manual provides the methodology to determine the appropriateness of imaging and treatment procedures for specific clinical scenarios. In those instances where peer reviewed literature is lacking or equivocal, experts may be the primary evidentiary source available to formulate a recommendation.

ACR Appropriateness Criteria® Screening for Abdominal Aortic Aneurysm.

Abdominal aortic aneurysm (AAA) is a significant vascular disease found in 4% to 8% of the screening population. If ruptured, its mortality rate is between 75% and 90%, and it accounts for up to 5% of sudden deaths in the United States. Therefore, screening of AAA while asymptomatic has been a crucial portion of preventive health care worldwide. Ultrasound of the abdominal aorta is the primary imaging modality for screening of AAA recommended for asymptomatic adults regardless of their family history or smoking history. Alternatively, duplex ultrasound and CT abdomen and pelvis without contrast may be appropriate for screening. The American College of Radiology Appropriateness Criteria are evidence-based guidelines for specific clinical conditions that are reviewed annually by a multidisciplinary expert panel. The guideline development and revision process support the systematic analysis of the medical literature from peer reviewed journals. Established methodology principles such as Grading of Recommendations Assessment, Development, and Evaluation or GRADE are adapted to evaluate the evidence. The RAND/UCLA Appropriateness Method User Manual provides the methodology to determine the appropriateness of imaging and treatment procedures for specific clinical scenarios. In those instances where peer reviewed literature is lacking or equivocal, experts may be the primary evidentiary source available to formulate a recommendation.

Comparison between screening for primary aldosteronism with and without drug adjustment.

OBJECTIVE: Few studies have evaluated the performance of non-drug-adjusted primary aldosteronism (PA) screening. Therefore, we aimed to examine the consistency between PA screening results with and without drug adjustment and to explore the effectiveness of screening without drug adjustment. METHODS: This prospective study included 650 consecutive patients with a high risk of incidence PA. Patients who initially screened positive underwent rescreening with drug adjustments and confirmatory tests. Regarding the remaining patients, one of every three consecutive patients underwent rescreening with drug adjustments and confirmatory tests. The changes in aldosterone and renin concentrations were compared between patients with essential hypertension (EH) and those with PA before and after drug adjustment. Sensitivity and specificity were used to assess the diagnostic performance of screening without drug adjustment, using the confirmatory test results as the reference. RESULTS: We screened 650 patients with hypertension for PA. Forty-nine patients were diagnosed with PA and 195 with EH. Regarding drugs, 519 patients were taking angiotensin-converting enzyme inhibitors (ACEIs), angiotensin II receptor blockers (ARBs), calcium channel blockers (CCBs), or diuretics alone or in combination. Forty-one patients were taking beta-blockers. Ninety patients were taking beta-blockers in combination with other drugs. In patients treated with ACEIs, ARBs, CCBs, or diuretics alone, or in combination, or beta-blockers alone, PA positivity was determined using the criteria, aldosterone-to-renin ratio (ARR) >38 pg/mL/pg/mL and plasma aldosterone concentration (PAC) >100 pg/mL, and negativity, using the criteria, ARR <9 pg/mL/pg/mL; the sensitivity and specificity were 94.7% and 94.5%, respectively. After drug adjustment, the sensitivity and specificity of screening were 92.1% and 89%, respectively. CONCLUSIONS: In patients not treated with beta-blockers combined with others, when ARR >38 pg/mL/pg/mL and plasma aldosterone concentration (PAC) >100 pg/mL, or, ARR <9 pg/mL/pg/mL, non-drug-adjusted screening results were identical to with drug adjustment. Non-drug-adjusted screening could reduce the chance of medication adjustment, enable patients to continue their treatments and avoiding adverse effects, is of clinical importance.

Primary aldosteronism (PA) is the most common form of endocrine hypertension. The risk of stroke, myocardial infarction, heart failure, atrial fibrillation, and deterioration of kidney function is higher in PA than in essential hypertension (EH), even with the same blood pressure (BP) levels. However, many patients remain undiagnosed because most antihypertensive drugs substantially interfere with PA screening results, which makes drug adjustment necessary. This can be a time-consuming and unsafe process, requiring 4­6 weeks, and could lead to a hypertensive crisis and other complications. Some studies have suggested that certain antihypertensive drugs can be continued during PR screening. However, few studies have evaluated the performance of non-drug-adjusted PA screening. Therefore, in this prospective study, we aimed to compare patients with hypertension and a high risk of PA before and after drug adjustment and to use confirmatory test results as a reference to explore the diagnostic or exclusion effect. We found that non-drug-adjusted screening performs similarly to drug-adjusted screening in a particular group of patients. Our findings could aid in preventing unnecessary drug adjustment for PA screening, thereby reducing the risk in these patients.

[Challenges and prospects in the application of artificial intelligence for ocular disease screening and diagnosis].

In recent years, artificial intelligence (AI) technologies have experienced substantial growth across various sectors, with significant strides made particularly in medical AI through advancements such as large models. The application of AI within the field of ophthalmology can enhance the accuracy of eye disease screening and diagnosis. However, the deployment of AI and its large models in ophthalmology still encounters numerous limitations and challenges. This article builds upon the transformative achievements in the medical AI sector and discusses the ongoing challenges faced by AI applications in ophthalmology. It provides forward-looking insights from an ophthalmic perspective regarding the era of large models and anticipates research trends in AI applications in ophthalmology, so as to foster the continuous advancement of AI technologies, thereby significantly promoting eye health.

Prediction of Diabetes and Prediabetes among the Saudi Population Using a Non-Invasive Tool (AUSDRISK).

Background and Objectives: Screening for type 2 diabetes mellitus (DM2) aims to identify asymptomatic individuals who may be at a higher risk, allowing proactive interventions. The objective of this study was to predict the incidence of DM2 and prediabetes in the Saudi population over the next five years. Materials and Methods: The study was conducted in the Aseer region through August 2023 using a cross-sectional survey for data collection. A multistage stratified random sampling technique was adopted, and data were collected through face-to-face interviews using the validated Arabic version of the Australian Type 2 Diabetes Risk Assessment Tool (AUSDRISK). Results: In total, 652 individuals were included in the study. Their mean age was 32.0 ± 12.0 years; 53.8% were male, 89.6% were from urban areas, and 55.8% were single. There were statistically significant differences between males and females in AUSDRISK items, including age, history of high blood glucose, use of medications for high blood pressure, smoking, physical activity, and measurements of waist circumference (p < 0.05). Based on AUSDRISK scores, 46.2% of the included participants were predicted to develop impaired glucose tolerance within the coming five years (65.8% among females vs. 23.6%), and 21.9% were predicted to develop DM2 (35.6% among males vs. 6.0% among females); this difference was statistically significant (p = 0.0001). Conclusions: Urgent public health action is required to prevent the increasing epidemic of DM2 in Saudi Arabia.

Impact of an Automated Population-Level Cirrhosis Screening Program Using Common Pathology Tests on Rates of Cirrhosis Diagnosis and Linkage to Specialist Care (CAPRISE): Protocol for a Pilot Prospective Single-Arm Intervention Study.

BACKGROUND: People with compensated cirrhosis receive the greatest benefit from risk factor modification and prevention programs to reduce liver decompensation and improve early liver cancer detection. Blood-based liver fibrosis algorithms such as the Aspartate Transaminase-to-Platelet Ratio Index (APRI) and Fibrosis-4 (FIB-4) index are calculated using routinely ordered blood tests and are effective screening tests to exclude cirrhosis in people with chronic liver disease, triaging the need for further investigations to confirm cirrhosis and linkage to specialist care. OBJECTIVE: This pilot study aims to evaluate the impact of a population screening program for liver cirrhosis (CAPRISE [Cirrhosis Automated APRI and FIB-4 Screening Evaluation]), which uses automated APRI and FIB-4 calculation and reporting on routinely ordered blood tests, on monthly rates of referral for transient elastography, cirrhosis diagnosis, and linkage to specialist care. METHODS: We have partnered with a large pathology service in Victoria, Australia, to pilot a population-level liver cirrhosis screening package, which comprises (1) automated calculation and reporting of APRI and FIB-4 on routinely ordered blood tests; (2) provision of brief information about liver cirrhosis; and (3) a web link for transient elastography referral. APRI and FIB-4 will be prospectively calculated on all community-ordered pathology results in adults attending a single pathology service. This single-center, prospective, single-arm, pre-post study will compare the monthly rates of transient elastography (FibroScan) referral, liver cirrhosis diagnosis, and the proportion linked to specialist care in the 6 months after intervention to the 6 months prior to the intervention. RESULTS: As of January 2024, in the preintervention phase of this study, a total of 120,972 tests were performed by the laboratory. Of these tests, 78,947 (65.3%) tests were excluded, with the remaining 42,025 (34.7%) tests on 37,872 individuals meeting inclusion criteria with APRI and FIB-4 being able to be calculated. Of these 42,025 tests, 1.3% (n=531) had elevated APRI>1 occurring in 446 individuals, and 2.3% (n=985) had elevated FIB-4>2.67 occurring in 816 individuals. Linking these data with FibroScan referral and appointment attendance is ongoing and will continue during the intervention phase, which is expected to commence on February 1, 2024. CONCLUSIONS: We will determine the feasibility and effectiveness of automated APRI and FIB-4 reporting on the monthly rate of transient elastography referrals, liver cirrhosis diagnosis, and linkage to specialist care. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN12623000295640; https://tinyurl.com/58dv9ypp. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/56607.

Occupational health screening during Gurkha Central Selection: a retrospective cohort study.

OBJECTIVE: The selection process to the British Army's Brigade of Gurkhas is rigorous, demanding and competitive. The ethos of recruitment to the Gurkhas is grounded in an overarching tenant: that selection is free, fair and transparent. The aim of this study was to retrospectively review reasons for potential recruits (PRs) to be deemed medically unsuitable or deferred suitability on medical grounds for selection to the Brigade of Gurkhas. METHODS: A retrospective review was conducted by extracted data from published post-exercise reports for the past four years to ascertain numbers of PRs deemed medically fit, medically unsuitable or deferred suitability on medical grounds. The International Classification of Disease version 11 (ICD-11) codes were retrospectively assigned to code medical reasons for non-progression. Rates of medical non-progression were compared by year. RESULTS: A total of 3154 PRs were analysed between 2018 and 2021. There was no significant difference between PRs deemed medically fit and those deemed medically suitable or deferred on medical grounds over the study period (p=0.351). There was a significant difference in the ratio of PRs deferred on medical grounds and those deemed medically unsuitable over the study period (p<0.05). CONCLUSION: Selection to the Gurkhas is extremely competitive. These data demonstrate that, overall, reasons for medical deferral or unsuitability have remained constant despite the impact of a global pandemic. These data reinforce the central tenant of Gurkha selection; that it continues to be free, fair, and transparent.

Malnutrition screening tool and nutritional screening tool for classification of nutritional risk in patients with cancer upon hospital admission: Comparison of diagnostic performance using Global Leadership Initiative on malnutrition criteria as reference.

BACKGROUND & AIMS: Tools for screening of nutrition risk in patients with cancer are usually validated against other screening instruments. Here with the performance of Malnutrition Screening Tool (MST) and Nutritional Screening Tool (NUTRISCORE) to identify the risk of malnutrition was assessed. A full nutritional evaluation and diagnosis following criteria from the Global Leadership Initiative of Malnutrition (GLIM) was the reference standard for the classification of malnutrition. METHODS: Diagnostic test prospective analysis of adult patients with a confirmed diagnosis of cancer. MST, NUTRISCORE and nutritional evaluation and diagnosis by GLIM criteria were independently performed within 24 h of admission to a 4th tier hospital in Bogotá, Colombia. RESULTS: From 439 patients the sensitivity and specificity of MST was 75% and 94% and of NUTRISCORE 45% and 97% respectively. The area under receiver operating characteristic (ROC) curves were 0.90 for MST and 0.85 for NUTRISCORE (p = 0.003). CONCLUSION: The MST showed a significantly better diagnostic performance over NUTRISCORE for detection of malnutrition risk at admission to hospital of patients with cancer.

Female Sexual Health: Screening and Evaluation.

Female sexual dysfunction is highly prevalent, affecting 30% to 50% of cisgender women globally. Low sexual desire, sexual arousal disorder, and orgasm disorder affect 10% to 20%, 6% to 20%, and 4% to 14% of women, respectively. Dyspareunia or pain with intercourse affects 8% to 22% of women. Universal screening is recommended; and a thorough medical history and physical examination are the foundations of evaluation and assessment. Laboratory tests and imaging are sometimes warranted, but referral to a sexual medicine expert is suggested if the practitioner is unfamiliar or uncomfortable with treatment.

Sexual Health for Transgender and Gender Diverse Individuals: Routine Examination, Sexually-Transmitted Infection Screening, and Prevention.

Gynecologists play a critical role in the office evaluation of transgender and gender diverse individuals. This includes the provision of essential healthcare services including the treatment and prevention of human immunodeficiency virus and sexually-transmitted infections and screening for human papillomavirus infection-related diseases and cancers. Caring for patients who identify as transgender or gender diverse (TGD) and who have undergone gender-affirming surgical treatments is challenging due in part to clinical gaps in knowledge resulting from insufficient training and educational resources. A patient-centered approach to the care of TGD individuals requires knowledge of the general principles of affirming, holistic care with attention to the risk factors, and anatomic considerations unique to this population. This review aims to provide basic knowledge needed for the successful gynecologic evaluation of a gender diverse patient.

Tumor Doubling Time and Screening Interval.

The goal of screening is to detect breast cancers when still curable to decrease breast cancer-specific mortality. Breast cancer screening in the United States is routinely performed with digital mammography and digital breast tomosynthesis. This article reviews breast cancer doubling time by tumor subtype and examines the impact of doubling time on breast cancer screening intervals. By the article's end, the reader will be better equipped to have informed discussions with patients and medical professionals regarding the benefits and disadvantages of the currently recommended screening mammography intervals.

Interval Cancers in Understanding Screening Outcomes.

Interval breast cancers are not detected at routine screening and are diagnosed in the interval between screening examinations. A variety of factors contribute to interval cancers, including patient and tumor characteristics as well as the screening technique and frequency. The interval cancer rate is an important metric by which the effectiveness of screening may be assessed and may serve as a surrogate for mortality benefit.

Suicide Risk Screening for Head and Neck Cancer Patients: An Implementation Study.

OBJECTIVES: There is limited research on suicide risk screening (SRS) among head and neck cancer (HNC) patients, a population at increased risk for suicide. To address this gap, this single-site mixed methods study assessed oncology professionals' perspectives about the feasibility, acceptability, and appropriateness of an electronic SRS program that was implemented as a part of routine care for HNC patients. METHODS: Staff who assisted with SRS implementation completed (e.g., nurses, medical assistants, advanced practice providers, physicians, social workers) a one-time survey (N = 29) and interview (N = 25). Quantitative outcomes were assessed using previously validated feasibility, acceptability, and appropriateness measures. Additional qualitative data were collected to provide context for interpreting the scores. RESULTS: Nurses and medical assistants, who were directly responsible for implementing SRS, reported low feasibility, acceptability, and appropriateness, compared with other team members (e.g., physicians, social workers, advanced practice providers). Team members identified potential improvements needed to optimize SRS, such as hiring additional staff, improving staff training, providing different modalities for screening completion among individuals with disabilities, and revising the patient-reported outcomes to improve suicide risk prediction. CONCLUSION: Staff perspectives about implementing SRS as a part of routine cancer care for HNC patients varied widely. Before screening can be implemented on a larger scale for HNC and other cancer patients, additional implementation strategies may be needed that optimize workflow and reduce staff burden, such as staff training, multiple modalities for completion, and refined tools for identifying which patients are at greatest risk for suicide.

Enhancing HIV positivity yield in southern Mozambique: The effect of a Ministry of Health training module in targeted provider-initiated testing and counselling.

In Mozambique, targeted provider-initiated HIV testing and counselling (PITC) is recommended where universal PITC is not feasible, but its effectiveness depends on healthcare providers' training. This study aimed to evaluate the effect of a Ministry of Health training module in targeted PITC on the HIV positivity yield, and identify factors associated with a positive HIV test. We conducted a single-group pre-post study between November 2018 and November 2019 in the triage and emergency departments of four healthcare facilities in Manhiça District, a resource-constrained semi-rural area. It consisted of two two-month phases split by a one-week targeted PITC training module ("observation phases"). The HIV positivity yield of targeted PITC was estimated as the proportion of HIV-positive individuals among those recommended for HIV testing by the provider. Additionally, we extracted aggregated health information system data over the four months preceding and following the observation phases to compare yield in real-world conditions ("routine phases"). Logistic regression analysis from observation phase data was conducted to identify factors associated with a positive HIV test. Among the 7,102 participants in the pre- and post-training observation phases (58.5% and 41.5% respectively), 68% were women, and 96% were recruited at triage. In the routine phases with 33,261 individuals (45.8% pre, 54.2% post), 64% were women, and 84% were seen at triage. While HIV positivity yield between pre- and post-training observation phases was similar (10.9% (269/2470) and 11.1% (207/1865), respectively), we observed an increase in yield in the post-training routine phase for women in triage, rising from 4.8% (74/1553) to 7.3% (61/831) (Yield ratio = 1.54; 95%CI: 1.11-2.14). Age (25-49 years) (OR = 2.43; 95%CI: 1.37-4.33), working in industry/mining (OR = 4.94; 95%CI: 2.17-11.23), unawareness of partner's HIV status (OR = 2.50; 95%CI: 1.91-3.27), and visiting a healer (OR = 1.74; 95%CI: 1.03-2.93) were factors associated with a positive HIV test. Including these factors in the targeted PITC algorithm could have increased new HIV diagnoses by 2.6%. In conclusion, providing refresher training and adapting the current targeted PITC algorithm through further research can help reach undiagnosed PLHIV, treat all, and ultimately eliminate HIV, especially in resource-limited rural areas.

Practitioners support and intention to adopt universal access to self-collection in Australia's National Cervical Screening Program.

OBJECTIVE: Primary care practitioners are crucial to engaging people in Australia's national cervical screening program. From July 2022, practitioners have been able to offer all screen-eligible people the choice to collect their own self-collected sample; an option introduced to increase equity. This study explored how practitioners are intending to incorporate universal access to self-collection into their clinical care. METHODS: Semi-structed interviews with 27 general practitioners, nurses, and practice managers from 10 practices in Victoria, Australia conducted between May and August 2022. Interviews were deductively coded, informed by the Consolidated Framework for Implementation Research. The Diffusion of Innovations theory was used to categorise intention to provide self-collection. RESULTS: Participants were supportive of universal access to self-collection, citing benefits for screen-eligible people and that it overcame the limited adaptability of the previous policy. Most participants' practices (n = 7, 70%) had implemented or had plans to offer the option for self-collection to all. Participants deliberating whether to provide universal access to self-collection held concerns about the correct performance of the self-test and the perceived loss of opportunity to perform a pelvic examination. Limited time to change practice-level processes and competing demands within consultations were anticipated as implementation barriers. CONCLUSIONS: The extent to which self-collection can promote equity within the program will be limited without wide-spread adoption by practitioners. Communication and education that addresses concerns of practitioners, along with targeted implementation support, will be critical to ensuring that self-collection can increase participation and Australia's progression towards elimination of cervical cancer.