Improving Patient Understanding of Femoroacetabular Impingement Syndrome With Three-Dimensional Models.

INTRODUCTION: Three-dimensional (3D) printed models may help patients understand complex anatomic pathologies such as femoroacetabular impingement syndrome (FAIS). We aimed to assess patient understanding and satisfaction when using 3D printed models compared with standard imaging modalities for discussion of FAIS diagnosis and surgical plan. METHODS: A consecutive series of 76 new patients with FAIS (37 patients in the 3D model cohort and 39 in the control cohort) from a single surgeon's clinic were educated using imaging and representative 3D printed models of FAI or imaging without models (control). Patients received a voluntary post-visit questionnaire that evaluated their understanding of the diagnosis, surgical plan, and visit satisfaction. RESULTS: Patients in the 3D model cohort reported a significantly higher mean understanding of FAIS (90.0 ± 11.5 versus 79.8 ± 14.9 out of 100; P = 0.001) and surgery (89.5 ± 11.6 versus 81.0 ± 14.5; P = 0.01) compared with the control cohort. Both groups reported high levels of satisfaction with the visit. CONCLUSION: In this study, the use of 3D printed models in clinic visits with patients with FAIS improved patients' perceived understanding of diagnosis and surgical treatment.

A systematic review and meta-analysis of English language online patient education materials in breast cancer: Is readability the only story?

BACKGROUND: Online patient education materials (OPEMs) are an increasingly popular resource for women seeking information about breast cancer. The AMA recommends written patient material to be at or below a 6th grade level to meet the general public's health literacy. Metrics such as quality, understandability, and actionability also heavily influence the usability of health information, and thus should be evaluated alongside readability. PURPOSE: A systematic review and meta-analysis was conducted to determine: 1) Average readability scores and reporting methodologies of breast cancer readability studies; and 2) Inclusion frequency of additional health literacy-associated metrics. MATERIALS AND METHODS: A registered systematic review and meta-analysis was conducted in Ovid MEDLINE, Web of Science, Embase.com, CENTRAL via Ovid, and ClinicalTrials.gov in June 2022 in adherence with the PRISMA 2020 statement. Eligible studies performed readability analyses on English-language breast cancer-related OPEMs. Study characteristics, readability data, and reporting of non-readability health literacy metrics were extracted. Meta-analysis estimates were derived from generalized linear mixed modeling. RESULTS: The meta-analysis included 30 studies yielding 4462 OPEMs. Overall, average readability was 11.81 (95% CI [11.14, 12.49]), with a significant difference (p < 0.001) when grouped by OPEM categories. Commercial organizations had the highest average readability at 12.2 [11.3,13.0]; non-profit organizations had one of the lowest at 11.3 [10.6,12.0]. Readability also varied by index, with New Fog, Lexile, and FORCAST having the lowest average scores (9.4 [8.6, 10.3], 10.4 [10.0, 10.8], and 10.7 [10.2, 11.1], respectively). Only 57% of studies calculated average readability with more than two indices. Only 60% of studies assessed other OPEM metrics associated with health literacy. CONCLUSION: Average readability of breast cancer OPEMs is nearly double the AMA's recommended 6th grade level. Readability and other health literacy-associated metrics are inconsistently reported in the current literature. Standardization of future readability studies, with a focus on holistic evaluation of patient materials, may aid shared decision-making and be critical to increased screening rates and breast cancer awareness.

Evaluation of online text-based information resources of gynaecological cancer symptoms.

BACKGROUND: Gynaecological cancer symptoms are often vague and non-specific. Quality health information is central to timely cancer diagnosis and treatment. The aim of this study was to identify and evaluate the quality of online text-based patient information resources regarding gynaecological cancer symptoms. METHODS: A targeted website search and Google search were conducted to identify health information resources published by the Australian government and non-government health organisations. Resources were classified by topic (gynaecological health, gynaecological cancers, cancer, general health); assessed for reading level (Simple Measure of Gobbledygook, SMOG) and difficulty (Flesch Reading Ease, FRE); understandability and actionability (Patient Education Materials Assessment Tool, PEMAT, 0-100), whereby higher scores indicate better understandability/actionability. Seven criteria were used to assess cultural inclusivity specific for Aboriginal and Torres Strait Islander people; resources which met 3-5 items were deemed to be moderately inclusive and 6+ items as inclusive. RESULTS: A total of 109 resources were identified and 76% provided information on symptoms in the context of gynaecological cancers. The average readability was equivalent to a grade 10 reading level on the SMOG and classified as 'difficult to read' on the FRE. The mean PEMAT scores were 95% (range 58-100) for understandability and 13% (range 0-80) for actionability. Five resources were evaluated as being moderately culturally inclusive. No resource met all the benchmarks. CONCLUSIONS: This study highlights the inadequate quality of online resources available on pre-diagnosis gynaecological cancer symptom information. Resources should be revised in line with the recommended standards for readability, understandability and actionability and to meet the needs of a culturally diverse population.

From technical to understandable: Artificial Intelligence Large Language Models improve the readability of knee radiology reports.

PURPOSE: The purpose of this study was to evaluate the effectiveness of an Artificial Intelligence-Large Language Model (AI-LLM) at improving the readability of knee radiology reports. METHODS: Reports of 100 knee X-rays, 100 knee computed tomography (CT) scans and 100 knee magnetic resonance imaging (MRI) scans were retrieved. The following prompt command was inserted into the AI-LLM: 'Explain this radiology report to a patient in layman's terms in the second person:[Report Text]'. The Flesch-Kincaid reading level (FKRL) score, Flesch reading ease (FRE) score and report length were calculated for the original radiology report and the AI-LLM generated report. Any 'hallucination' or inaccurate text produced by the AI-LLM-generated report was documented. RESULTS: Statistically significant improvements in mean FKRL scores in the AI-LLM generated X-ray report (12.7 ± 1.0-7.2 ± 0.6), CT report (13.4 ± 1.0-7.5 ± 0.5) and MRI report (13.5 ± 0.9-7.5 ± 0.6) were observed. Statistically significant improvements in mean FRE scores in the AI-LLM generated X-ray report (39.5 ± 7.5-76.8 ± 5.1), CT report (27.3 ± 5.9-73.1 ± 5.6) and MRI report (26.8 ± 6.4-73.4 ± 5.0) were observed. Superior FKRL scores and FRE scores were observed in the AI-LLM-generated X-ray report compared to the AI-LLM-generated CT report and MRI report, p < 0.001. The hallucination rates in the AI-LLM generated X-ray report, CT report and MRI report were 2%, 5% and 5%, respectively. CONCLUSIONS: This study highlights the promising use of AI-LLMs as an innovative, patient-centred strategy to improve the readability of knee radiology reports. The clinical relevance of this study is that an AI-LLM-generated knee radiology report may enhance patients' understanding of their imaging reports, potentially reducing the responder burden placed on the ordering physicians. However, due to the 'hallucinations' produced by the AI-LLM-generated report, the ordering physician must always engage in a collaborative discussion with the patient regarding both reports and the corresponding images. LEVEL OF EVIDENCE: Level IV.

An effort to improve the collection of patient-generated data: readability and understandability of patient-reported outcomes measures in a survivorship cohort.

PURPOSE: In this study, we evaluated readability and understandability of nine French-language Patient-Reported Outcome Measures (PROMs) that are currently used in a contemporary longitudinal cohort of breast cancer survivors as part of an effort to improve equity in cancer care and research. METHODS: Readability of PROMs was assessed using the Flesh Reading Ease Score (FRES), the Gunning's Fog Index (FOG), and the FRY graphics. Readability was considered ideal if mean score ≤ 6th-grade level and acceptable if between 6th and 8th grade. Understandability was evaluated using the Patient Education Materials Assessment Tool and defined as ideal if PEMAT ≥ 80%. The Evaluative Linguistic Framework for Questionnaires (ELF-Q) provided additional qualitative elements to assess understandability. Plain-language best practice was met if both readability and understandability were ideal. RESULTS: None of the 9 PROMs evaluated had ideal readability scores and only 1 had an acceptable score. Understandability ranged from 55% to 91%, and only 3 PROMs had ideal scores. ELF-Q identified points for improvement in several understandability dimensions of the PROMs. None of the instruments met the definition of plain-language best practice. CONCLUSION: None of the studied PROMs met the standards of readability and understandability. Future development and translation of PROMs should follow comprehensive linguistic and cultural frameworks to ensure plain-language standards and enhance equitable patient-centered care and research.

Large language models and bariatric surgery patient education: a comparative readability analysis of GPT-3.5, GPT-4, Bard, and online institutional resources.

BACKGROUND: The readability of online bariatric surgery patient education materials (PEMs) often surpasses the recommended 6th grade level. Large language models (LLMs), like ChatGPT and Bard, have the potential to revolutionize PEM delivery. We aimed to evaluate the readability of PEMs produced by U.S. medical institutions compared to LLMs, as well as the ability of LLMs to simplify their responses. METHODS: Responses to frequently asked questions (FAQs) related to bariatric surgery were gathered from top-ranked health institutions. FAQ responses were also generated from GPT-3.5, GPT-4, and Bard. LLMs were then prompted to improve the readability of their initial responses. The readability of institutional responses, initial LLM responses, and simplified LLM responses were graded using validated readability formulas. Accuracy and comprehensiveness of initial and simplified LLM responses were also compared. RESULTS: Responses to 66 FAQs were included. All institutional and initial LLM responses had poor readability, with average reading levels ranging from 9th grade to college graduate. Simplified responses from LLMs had significantly improved readability, with reading levels ranging from 6th grade to college freshman. When comparing simplified LLM responses, GPT-4 responses demonstrated the highest readability, with reading levels ranging from 6th to 9th grade. Accuracy was similar between initial and simplified responses from all LLMs. Comprehensiveness was similar between initial and simplified responses from GPT-3.5 and GPT-4. However, 34.8% of Bard's simplified responses were graded as less comprehensive compared to initial. CONCLUSION: Our study highlights the efficacy of LLMs in enhancing the readability of bariatric surgery PEMs. GPT-4 outperformed other models, generating simplified PEMs from 6th to 9th grade reading levels. Unlike GPT-3.5 and GPT-4, Bard's simplified responses were graded as less comprehensive. We advocate for future studies examining the potential role of LLMs as dynamic and personalized sources of PEMs for diverse patient populations of all literacy levels.

ChatGPT vs. web search for patient questions: what does ChatGPT do better?

PURPOSE: Chat generative pretrained transformer (ChatGPT) has the potential to significantly impact how patients acquire medical information online. Here, we characterize the readability and appropriateness of ChatGPT responses to a range of patient questions compared to results from traditional web searches. METHODS: Patient questions related to the published Clinical Practice Guidelines by the American Academy of Otolaryngology-Head and Neck Surgery were sourced from existing online posts. Questions were categorized using a modified Rothwell classification system into (1) fact, (2) policy, and (3) diagnosis and recommendations. These were queried using ChatGPT and traditional web search. All results were evaluated on readability (Flesch Reading Ease and Flesch-Kinkaid Grade Level) and understandability (Patient Education Materials Assessment Tool). Accuracy was assessed by two blinded clinical evaluators using a three-point ordinal scale. RESULTS: 54 questions were organized into fact (37.0%), policy (37.0%), and diagnosis (25.8%). The average readability for ChatGPT responses was lower than traditional web search (FRE: 42.3 ± 13.1 vs. 55.6 ± 10.5, p < 0.001), while the PEMAT understandability was equivalent (93.8% vs. 93.5%, p = 0.17). ChatGPT scored higher than web search for questions the 'Diagnosis' category (p < 0.01); there was no difference in questions categorized as 'Fact' (p = 0.15) or 'Policy' (p = 0.22). Additional prompting improved ChatGPT response readability (FRE 55.6 ± 13.6, p < 0.01). CONCLUSIONS: ChatGPT outperforms web search in answering patient questions related to symptom-based diagnoses and is equivalent in providing medical facts and established policy. Appropriate prompting can further improve readability while maintaining accuracy. Further patient education is needed to relay the benefits and limitations of this technology as a source of medial information.

"Uninformed consent" in clinical trials with cancer patients: A qualitative analysis of patients' and support persons' communication experiences and needs.

OBJECTIVE: Cancer patients are often overwhelmed when being informed about clinical trials. However, there is a lack of evidence-based strategies to improve physician-patient communication in this area. This study assessed the experiences and needs of cancer patients and their support persons (SPs) during the informed consent (IC) process prior to participation in clinical trials. METHODS: 17 semi-structured interviews with cancer patients and their SP were conducted and analysed using a framework analysis. RESULTS: Most respondents reported feeling well informed about the clinical trial. However, core aspects of the study were often not understood highlighting a dissonance between perceived and actual recall and understanding. Many participants trusted that the trial recommended was the best available care and only skimmed the consent form or did not read it at all. CONCLUSIONS: This is the first German study to analyse both cancer patients' and SPs' perspectives on IC processes. Although many feel well informed, our results suggest a significant gap in recall and understanding of core components of clinical trials which hinders IC. PRACTICE IMPLICATIONS: Further interventional research is required to improve the consent processes prior to clinical trials in order to provide optimal, patient-centred care.

Assessing the Readability of Online English and Spanish Language Patient Education Resources Provided by the American Society of Plastic Surgeons, American Society of Aesthetic Plastic Surgeons, and American Society of Reconstructive Microsurgeons.

INTRODUCTION: The National Institutes of Health recommends that patient education materials (PEMs) be written at the sixth grade level. However, PEMs online are still generally difficult to read. The usefulness of online PEMs depends on their comprehensibility. OBJECTIVES: This study assessed the readability of PEMs from national Plastic and Reconstructive Surgery (PRS) organization websites. METHODS: Patient education materials were collected from 3 prominent PRS organizations-the American Society of Plastic Surgeons (ASPS), American Society of Aesthetic Plastic Surgeons (ASAPS), and the American Society of Reconstructive Microsurgeons (ASRM). ASPS PEMs were organized into reconstructive and cosmetic groups, and then further subdivided into English and Spanish subgroups. ASAPS and ASRM PEMs provided cosmetic and reconstructive comparison groups to ASPS, respectively. Readability scores were generated using the Simple Measure of Gobbledygook (SMOG) and the Spanish SMOG scales. RESULTS: Overall, all PEMs failed to meet readability guidelines. Within ASPS, Spanish PEMs were easier to read than English PEMs ( P < 0.001), and cosmetic PEMs were easier to read than reconstructive PEMs ( P < 0.05). There was no significant difference between ASPS cosmetic and ASAPS PEMs ( P = 0.36), nor between ASPS reconstructive and ASRM PEMs ( P = 0.65). ASAPS and ASRM did not have any Spanish PEMs, and 92% of all ASPS PEMs were in English. CONCLUSION: Although PRS societies strive to better educate the public on the scope of PRS, PRS ranks lowly in public understanding of its role in patient care. In addition, Spanish language PEMs from the 3 PRS organizations are severely lacking. Addressing these concerns will make online patient resources more equitable for various patient populations.

Serum IgA contributes to the comprehension of Anisakis simplex associated chronic urticaria.

The phenotype of allergic diseases associated with Anisakis determines the pattern of cytokines related to antibody production. However, the role of serum IgA and the immunomodulatory mechanisms exerted by active infection of L3 or passive mucosal contact with A. simplex specific antigens has not been studied before. We measured serum cytokine by flow cytometry (IL-2, IL-4, IL-6, IL-10, TNF-α, IFN-γ, IL-17A, TGF-ß1) and antibody levels (IgE, IgG4, IgA) by ELISA against total and excretory-secretory (ES) antigens, Ani s 3,and the group of major allergens Ani s 1, Ani s 7, and Ani s 13 in sera from 10 patients with gastro-allergic anisakiasis (GAA), 11 Anisakis sensitization associated chronic urticaria (CU+) as well as 17 non-Anisakis-sensitized patients with chronic urticaria (CU-), compared with the urticaria control group (18 subjects). Specific IgE, IgG4 and IgA were high in the GAA, but IgA levels were significantly higher in the CU+ with respect the CONTROL group. We observed higher levels of the ratio IgA/IgG4 in CU+ than GAA group for Ani s 1, Ani s 7, Ani s 13 and ES. Furthermore, chronic urticaria (CU) patients showed significant lower levels of IL-10, IFN-γ and IL-17A than patients without CU. The anti-Ani s 13 IgA/IgG4 ratio correlated positively with pro-inflammatory cytokines and ratios (TNF-α, IL-17A, Th17/Th2, Type1/Type2 and TNF-α/IL-10) in CONTROL group. In general, Anti-Anisakis IgA/G4 ratio was high in CU patients. In conclusion, this study demonstrates the importance of serum IgA because it is associated with chronic urticaria independently of Anisakis sensitization.

A survey on perceived medication guide reading and comprehension ease among US adults.

Medication guides (MGs) provide patients with important information about certain prescription drugs to help them take these drugs safely. We surveyed US residents about their perceptions of MG readability and understandability. We randomly sampled 5204 US residents (age 18+) from Ipsos's KnowledgePanel to complete a two-part survey. Only respondents who reported receiving an MG with their prescription drugs (n = 3852) completed part 2, which included two key items: How easy to [(1)read/(2)understand] are the MGs that you have received from a pharmacy along with your prescription medicines? (1 = Very easy, 5 = Very difficult; reverse-coded). Health literacy (HL) and demographic data were also collected. After weighting our data, we found that 85% of respondents who reported receiving an MG perceived this information as 'very easy' (27.3%), 'somewhat easy' (28.3%) or 'about average' (29.3%) to read. Eighty-seven percent of respondents who reported receiving an MG perceived it as 'very easy' (27.6%), 'somewhat easy' (30.2%) or 'about average' (29.5%) to understand. ANOVAs revealed higher average perceived MG reading and comprehension ease scores among respondents presumed to have adequate versus inadequate HL (ps ≤ 0.0006). Younger or less-educated respondents and non-Hispanic Blacks perceived MGs as easier to read and understand, on average, than their counterparts (ps ≤ 0.0001). Many of these relationships remained intact in models predicting perceived MG reading and comprehension ease (ps ≤ 0.001). Adjusted R2 values across models were small, however (≤0.06). Our findings suggest most US residents (18+) who received MGs perceived them to be 'about average' to 'very easy' to read and understand.

The Role of Three-Dimensional Modeling to Improve Comprehension of Liver Anatomy and Tumor Characteristics for Medical Students and Surgical Residents.

OBJECTIVE: Studying liver anatomy can be challenging for medical students and surgical residents due to its complexity. Three-dimensional visualization technology (3DVT) allows for a clearer and more precise view of liver anatomy. We sought to assess how 3DVT can assist students and surgical residents comprehend liver anatomy. DESIGN: Data from 5 patients who underwent liver resection for malignancy at our institution between September 2020 and April 2022 were retrospectively reviewed and selected following consensus among the investigators. Participants were required to complete an online survey to investigate their understanding of tumor characteristics and vascular variations based on patients' computed tomography (CT) and 3DVT. SETTING: The study was carried out at the General and Hepato-Biliary Surgery Department of the University of Verona. PARTICIPANTS: Among 32 participants, 13 (40.6%) were medical students, and 19 (59.4%) were surgical residents. RESULTS: Among 5 patients with intrahepatic lesions, 4 patients (80.0%) had at least 1 vascular variation. Participants identified number and location of lesions more correctly when evaluating the 3DVT (84.6% and 80.9%, respectively) compared with CT scans (61.1% and 64.8%, respectively) (both p ≤ 0.001). The identification of any vascular variations was more challenging using the CT scans, with only 50.6% of correct answers compared with 3DVT (72.2%) (p < 0.001). Compared with CT scans, 3DVT led to a 23.5%, 16.1%, and 21.6% increase in the correct definition of number and location of lesions, and vascular variations, respectively. 3DVT allowed for a decrease of 50.8 seconds (95% CI 23.6-78.0) in the time needed to answer the questions. All participants agreed on the usefulness of 3DVT in hepatobiliary surgery. CONCLUSIONS: The 3DVT facilitated a more precise preoperative understanding of liver anatomy, tumor location and characteristics.

Are adult thoracic patient education materials designed with patients in mind?

OBJECTIVE: Patients are increasingly using the internet to obtain health care information. US News and World Report Best Hospital rankings received more than 103 million views in 2021. Considering 21% of thoracic surgery patients are minorities, 27.9% are in the bottom quartile of household income, and 70% have Medicare/Medicaid or no insurance, online patient educational materials (PEMs) should be accessible and written at a level easily understood by majority of patients. We performed a comprehensive analysis of readability of websites containing patient-centered resources across all adult thoracic surgery areas. METHODS: Online PEMs on thoracic surgical procedures were collected from top 50 hospitals for pulmonology and lung surgery ranked by US News and World Report Best Hospital as of December 1, 2021. Text pertaining to thoracic surgical procedures was collected and divided into 4 procedural genres: esophageal, lung, transplant procedures, and other. Texts were analyzed using OleanderSoftware's Readability Suite through the Raygor readability test. RESULTS: Three hundred seventy-two articles met criteria for analysis. Websites were difficult to read; mean (standard deviation) readability score for all content required a 13.9 (3.6) grade level for comprehension. The mean (standard deviation) readability for esophageal, lung, lung transplant, and other surgeries were 14.5 (3.6), 13.1 (3.6), 11.5 (3.9), and 13.4 (3.7), respectively. CONCLUSIONS: Online PEMs required at least a college reading level to comprehend, well exceeding the sixth-grade level recommended by the American Medical Association. As digital health becomes increasingly relevant, improving the readability of online PEMs in adult cardiac surgery will facilitate equitable access to high-quality care.

Cancer-related fatigue: Quality, credibility, usability, and readability of information on websites of health care institutions in Germany.

OBJECTIVES: This study aimed to portray available information on cancer-related fatigue on German health care institution websites considering the idea of patient empowerment. METHODS: Based on website quality criteria, we developed a website-rating tool comprising 18 items. Descriptive analyses, a KruskalWallis test, and corresponding post hoc tests comparing rating sum scores between institution groups were performed. RESULTS: Websites of 283 systematically compiled health care institutions were included in the rating. Cancer-related fatigue was introduced on 21.9% and detailed information was provided on 27.9% of the websites. Information material was offered on 9.2% of the websites, while fatigue treatment offers were presented on 21.6% of the websites. The rating sum scores differed between institution groups (p < 0.001), with Comprehensive Cancer Centers scoring significantly higher than the others. CONCLUSION: The rating revealed an overall sparse provision of information, with fatigue being addressed on less than half of the websites. PRACTICE IMPLICATIONS: For patients who have access to at least one introduction about fatigue, institutions need to extend their websites. Patients could further be referred to external institutions or information booklets. The naming of contact persons may help linking patients to providers.

Scientific clickbait: Examining media coverage and readability in genome-wide association research.

In the present study, we analyzed a large corpus of English-language online media articles covering genome-wide association studies (GWAS), exemplifying the use of computational methods to study science communication in biological sciences. We analyzed trends in media coverage, readability, themes, and mentions of ethical and social issues, in over 5,000 websites published from 2005 to 2018 from 3,555 GWAS publications on 1,943 different traits, identified via GWAS Catalog using a text-mining approach to inform the discussion about genetic literacy and media coverage. We found that 22.9% of GWAS papers received media attention but most were described in language too complex to be understood by the public. Ethical issues are rarely mentioned and mentions of translation are increasing over time. We predicted media attention based on year of publication, number of genetic associations identified, study sample size, and journal impact factor, using a regression model (r2 = 38.7%). We found that chronotype, educational attainment, alcohol and coffee consumption, sexual orientation, tanning, and hair color received substantially more attention than predicted by the regression model. We also evaluated the prevalence of the clickbait "one gene, one disease" headlines (e.g., "Scientists Say They've Found Gene That Causes Breast Cancer") and found that it is declining. In sum, online media coverage of GWAS should be more accessible, introduce more modern genetics terms, and when appropriate, ELSI should be mentioned. Science communication research can benefit from big data and text-mining techniques which allow us to study trends and changes in coverage trends across thousands of media outlets. Results can be explored interactively in a website we have built for this manuscript: https://jjmorosoli.shinyapps.io/newas/.