Improving the Safety of Computed Tomography Through Automated Quality Measurement: A Radiologist Reader Study of Radiation Dose, Image Noise, and Image Quality.

OBJECTIVES: The Centers for Medicare and Medicaid Services funded the development of a computed tomography (CT) quality measure for use in pay-for-performance programs, which balances automated assessments of radiation dose with image quality to incentivize dose reduction without compromising the diagnostic utility of the tests. However, no existing quantitative method for assessing CT image quality has been validated against radiologists' image quality assessments on a large number of CT examinations. Thus to develop an automated measure of image quality, we tested the relationship between radiologists' subjective ratings of image quality with measurements of radiation dose and image noise. MATERIALS AND METHODS: Board-certified, posttraining, clinically active radiologists rated the image quality of 200 diagnostic CT examinations from a set of 734, representing 14 CT categories. Examinations with significant distractions, motion, or artifact were excluded. Radiologists rated diagnostic image quality as excellent, adequate, marginally acceptable, or poor; the latter 2 were considered unacceptable for rendering diagnoses. We quantified the relationship between ratings and image noise and radiation dose, by category, by analyzing the odds of an acceptable rating per standard deviation (SD) increase in noise or geometric SD (gSD) in dose. RESULTS: One hundred twenty-five radiologists contributed 24,800 ratings. Most (89%) were acceptable. The odds of an examination being rated acceptable statistically significantly increased per gSD increase in dose and decreased per SD increase in noise for most categories, including routine dose head, chest, and abdomen-pelvis, which together comprise 60% of examinations performed in routine practice. For routine dose abdomen-pelvis, the most common category, each gSD increase in dose raised the odds of an acceptable rating (2.33; 95% confidence interval, 1.98-3.24), whereas each SD increase in noise decreased the odds (0.90; 0.79-0.99). For only 2 CT categories, high-dose head and neck/cervical spine, neither dose nor noise was associated with ratings. CONCLUSIONS: Radiation dose and image noise correlate with radiologists' image quality assessments for most CT categories, making them suitable as automated metrics in quality programs incentivizing reduction of excessive radiation doses.

When Can We Rely on Real-World Evidence to Evaluate New Medical Treatments?

Concerns regarding both the limited generalizability and the slow pace of traditional randomized trials have led to calls for greater use of real-world evidence (RWE) in the evaluation of new treatments or products. The RWE label has been used to refer to a variety of departures from the methods of traditional randomized controlled trials. Recognizing this complexity and potential confusion, the National Academies of Science, Engineering, and Medicine convened a series of workshops to clarify and address questions regarding the use of RWE to evaluate new medical treatments. Those workshops identified three specific dimensions in which RWE studies might differ from traditional clinical trials: use of real-world data (data extracted from health system records or data captured by mobile devices), delivery of real-world treatment (open-label treatments delivered in community settings by community practitioners), and real-world treatment assignment (including nonrandomized comparisons and variations on random assignment such as before-after or stepped-wedge designs). For any RWE study, decisions regarding each of these dimensions depends on the specific research question, characteristics of the potential study settings, and characteristics of the settings where study results would be applied.

When Can We Trust Real-World Data To Evaluate New Medical Treatments?

Concerns regarding both the limited generalizability and the slow pace of traditional randomized trials have led to calls for greater use of real-world evidence (RWE) in the evaluation of new treatments or products. RWE studies often rely on real-world data (RWD), including data extracted from healthcare records or data captured by mobile phones or other consumer devices. Global assessments of RWD sources are not helpful in assessing whether any specific RWD element is fit for any specific purpose. Instead, evidence generators and evidence consumers should clearly identify the specific health state or clinical phenomenon of interest and then consider each step between that clinical phenomenon and its representation in a research database. We propose specific questions regarding potential error or bias affecting each of those steps: Would a person experiencing this clinical phenomenon present for care in this setting or interact with this recording device? Would this clinical phenomenon be accurately recognized or assessed? How might the recording environment or tools affect accurate and consistent recording of this clinical phenomenon? Can data elements from different sources be harmonized, both technically (same format) and semantically (same meaning)? Can the original data elements be consistently reduced to a useful clinical phenotype? Addressing these questions requires a range of clinical, organizational, and technical expertise. Transparency regarding each step in the creation of RWD is essential if evidence consumers are to rely on RWE studies.

An Image Quality-informed Framework for CT Characterization.

Background Lack of standardization in CT protocol choice contributes to radiation dose variation. Purpose To create a framework to assess radiation doses within broad CT categories defined according to body region and clinical imaging indication and to cluster indications according to the dose required for sufficient image quality. Materials and Methods This was a retrospective study using Digital Imaging and Communications in Medicine metadata. CT examinations in adults from January 1, 2016 to December 31, 2019 from the University of California San Francisco International CT Dose Registry were grouped into 19 categories according to body region and required radiation dose levels. Five body regions had a single dose range (ie, extremities, neck, thoracolumbar spine, combined chest and abdomen, and combined thoracolumbar spine). Five additional regions were subdivided according to dose. Head, chest, cardiac, and abdomen each had low, routine, and high dose categories; combined head and neck had routine and high dose categories. For each category, the median and 75th percentile (ie, diagnostic reference level [DRL]) were determined for dose-length product, and the variation in dose within categories versus across categories was calculated and compared using an analysis of variance. Relative median and DRL (95% CI) doses comparing high dose versus low dose categories were calculated. Results Among 4.5 million examinations, the median and DRL doses varied approximately 10 times between categories compared with between indications within categories. For head, chest, abdomen, and cardiac (3 266 546 examinations [72%]), the relative median doses were higher in examinations assigned to the high dose categories than in examinations assigned to the low dose categories, suggesting the assignment of indications to the broad categories is valid (head, 3.4-fold higher [95% CI: 3.4, 3.5]; chest, 9.6 [95% CI: 9.3, 10.0]; abdomen, 2.4 [95% CI: 2.4, 2.5]; and cardiac, 18.1 [95% CI: 17.7, 18.6]). Results were similar for DRL doses (all P < .001). Conclusion Broad categories based on image quality requirements are a suitable framework for simplifying radiation dose assessment, according to expected variation between and within categories. © RSNA, 2021 See also the editorial by Mahesh in this issue.

Difficulty and help with activities of daily living among older adults living alone with cognitive impairment.

INTRODUCTION: There is limited research on difficulties with activities of daily living (I/ADLs) among older adults living alone with cognitive impairment, including differences by race/ethnicity. METHODS: For U.S. Health and Retirement Study (2000-2014) participants aged 55+ living alone with cognitive impairment (4,666 individuals; 9,091 observations), we evaluated I/ADL difficulty and help. RESULTS: Among 4.3 million adults aged 55+ living alone with cognitive impairment, an estimated 46% reported an I/ADL difficulty; 72% reported not receiving help with an I/ADL. Women reported more difficulty than men. Compared to white women, black women were 22% more likely to report a difficulty without help, and Latina women were 36% more likely to report a difficulty with help. Among men, racial/ethnic differences in outcomes were not significant. Patterns of difficulty without help by race/ethnicity were similar among Medicaid beneficiaries. DISCUSSION: Findings call for targeted efforts to support older adults living alone with cognitive impairment.

Challenges and Opportunities to Updating Prescribing Information for Longstanding Oncology Drugs.

A number of important drugs used to treat cancer-many of which serve as the backbone of modern chemotherapy regimens-have outdated prescribing information in their drug labeling. The Food and Drug Administration is undertaking a pilot project to develop a process and criteria for updating prescribing information for longstanding oncology drugs, based on the breadth of knowledge the cancer community has accumulated with the use of these drugs over time. This article highlights a number of considerations for labeling updates, including selecting priorities for updating; data sources and evidentiary criteria; as well as the risks, challenges, and opportunities for iterative review to ensure prescribing information for oncology drugs remains relevant to current clinical practice.