Readability Assessment of Internet-Based Patient Education Materials Related to Parathyroid Surgery.

OBJECTIVES: Patient education is critical in obtaining informed consent and reducing preoperative anxiety. Written patient education material (PEM) can supplement verbal communication to improve understanding and satisfaction. Published guidelines recommend that health information be presented at or below a sixth-grade reading level to facilitate comprehension. We investigate the grade level of online PEMs regarding parathyroid surgery. METHODS: A popular internet search engine was used to identify PEM discussing parathyroid surgery. Four formulas were used to calculate readability scores: Flesch Reading Ease (FRE), Flesch-Kincaid Grade Level (FKGL), Gunning Frequency of Gobbledygook (GFOG), and Simple Measure of Gobbledygook (SMOG). RESULTS: Thirty web-based articles discussing parathyroid surgery were identified. The average FRE score was 42.8 (±1 standard deviation [SD] 16.3; 95% confidence interval [CI], 36.6-48.8; range, 6.1-71.3). The average FKGL score was 11.7 (±1 SD 3.3; 95% CI, 10.5-12.9; range, 6.1-19.0). The SMOG scores averaged 14.2 (±1 SD 2.6; 95% CI, 13.2-15.2; range, 10.7-21.9), and the GFOG scores averaged 15.0 (±1 SD 3.5; 95% CI, 13.7-16.3; range, 10.6-24.8). CONCLUSION: Online PEM on parathyroid surgery is written above the recommended sixth-grade reading level. Improving readability of PEM may promote better health education and compliance.

Readability assessment of internet-based patient education materials related to mammography for breast cancer screening.

RATIONALE AND OBJECTIVES: The US Department of Health and Human Services (USDHHS) recommends that Internet-based patient education materials (IPEMs) be written below the sixth-grade reading level to target the average American adult. This study was designed to determine the readability of IPEMs regarding mammography for breast cancer screening. MATERIALS AND METHODS: Three-hundred mammography-related Web sites were reviewed for IPEMs. Forty-two IPEMs that met the Health on the Net Foundation Code of Conduct were assessed for readability level with four readability indices that use existing algorithms based on word and sentence length to quantitatively analyze Internet sources for language intricacy including the following: Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease Score (FRES), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (Gunning FOG; GFOG). Results were compared to national recommendations, and intergroup analysis was performed. RESULTS: No IPEMs (0%) regarding mammography were written at or below the sixth-grade reading level, based on FKGL. The mean readability scores were as follows: FRES, 49.04 ± 10.62; FKGL, 10.71 ± 2.01; SMOG, 13.33 ± 1.67; and Gunning FOG, 14.32 ± 2.18. These scores indicate that the readability of mammography IPEMs is written at a "difficult" level, significantly above the recommended sixth-grade reading level (P < .05) determined by the USDHHS. CONCLUSIONS: IPEMs related to mammography are written well above the recommended sixth-grade level and likely reflect other IPEMs in diagnostic radiology.

Readability assessment of Internet-based patient education materials related to acoustic neuromas.

OBJECTIVE: The objectives of this study were to assess the readability of Internet-based patient education materials related to acoustic neuromas (AN-IPEMs) by 4 widely validated readability indices, to evaluate scores against the existing sixth grade recommended reading level, and to compare the readability scores of patient education materials (PEMs) produced by professional organizations, clinical practices, hospitals, and miscellaneous sources. MATERIALS AND METHODS: AN-IPEMs from 67 web sites (6 professional societies, 33 clinical practices, 19 hospitals, and 9 miscellaneous) were assessed using Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (Gunning FOG). Scores were then evaluated against national recommendations by 1-tailed t tests and against each other using 1-way ANOVAs. RESULTS: The average FKGL, SMOG, and Gunning FOG scores were all significantly higher than the recommended sixth grade reading level suggested by the USDHHS (p < 0.0001, single sample 1-tailed t test). Zero articles, by all indices, had a reading level equal to or below the sixth grade reading level. The FKGLs also varied between the various sources at a significant level (p = 0.01 one-way ANOVA independent samples). The average FKGLs of clinical practice and professional society AN-IPEMs were significantly higher than the average FKGLs of hospital AN-IPEMs (both p ≤ 0.05 one-tailed t-tests assuming unequal variances). CONCLUSION: AN-IPEMs are written at a level significantly higher than that suggested by national recommendations. Current AN-IPEMs may need to be revised in order to enhance patient comprehension.

Assessment of mucocele formation after endoscopic nasoseptal flap reconstruction of skull base defects.

Advances in endoscopic skull base (SB) surgery have led to the resection of increasingly larger cranial base lesions, resulting in large SB defects. These defects have initially led to increased postoperative cerebrospinal fluid (CSF) leaks. The development of the vascularized pedicled nasoseptal flap (PNSF) has successfully reduced postoperative CSF leaks. Mucocele formation, however, has been reported as a complication of this technique. In this study, we analyze the incidence of mucocele formation after repair of SB defects using a PNSF. A retrospective review was performed from December 2008 to December 2011 to identify patients who underwent PNSF reconstruction for large ventral SB defects. Demographic data, defect site, incidence of postoperative CSF leaks, and rate of mucocele formation were collected. Seventy patients undergoing PNSF repair of SB defects were identified. No postoperative mucocele formation was noted at an average radiological follow-up of 11.7 months (range, 3-36.9 months) and clinical follow-up of 13.8 months (range, 3-38.9 months), making the overall mucocele rate 0%. The postoperative CSF leak rate was 2.9%. Proper closure of SB defects is crucial to prevent CSF leaks. The PNSF is an efficient technique for these repairs. Although this flap may carry an inherent risk of mucocele formation when placed over mucosalized bone during repair, we found that meticulous and strategic removal of mucosa from the site of flap placement resulted in a 0% incidence of postoperative mucocele formation in our cohort.

Readability assessment of internet-based patient education materials related to uterine artery embolization.

PURPOSE: To determine the readability of Internet-based patient education materials (IPEMs) created by United States hospitals and universities and clinical practices and miscellaneous health care-associated Web sites regarding uterine artery embolization (UAE) as a marker for IPEMs in general. METHODS AND METHODS: Two hundred unique Web sites were evaluated for patient-related articles on UAE. Web sites produced by US hospitals and universities and clinical practices, as well as miscellaneous health care-associated Web sites meeting the Health on the Net Foundation Code of Conduct criteria were included in the database. By using mathematical regression algorithms based on word and sentence length to quantitatively analyze reading materials for language intricacy, readability of 40 UAE-related IPEMs was assessed with four indices: Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease Score (FRES), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (GFOG). Scores were evaluated against national recommendations, and intergroup analysis was performed. RESULTS: None of the IPEMs were written at or below the sixth-grade reading level, based on FKGL. The mean readability scores were as follows: FRES, 43.98; FKGL, 10.76; SMOG, 13.63; and GFOG, 14.55. These scores indicate that the readability of UAE IPEMs is written at an advanced level, significantly above the recommended 6th grade reading level (P<.05) determined by the United States Department of Health and Human Services. CONCLUSIONS: IPEMs related to UAE generated by hospitals, clinical practices, and miscellaneous health care-associated Web sites are written above the recommended sixth grade level. IPEMs for other disease entities may also reflect similar results.

Is NIH funding predictive of greater research productivity and impact among academic otolaryngologists?

OBJECTIVES/HYPOTHESIS: The h-index is an accurate and reliable indicator of scholarly productivity that takes into account relevance, significance, and influence of research contributions. As such, it is an effective, objective bibliometric that can be used to evaluate academic otolaryngologists for decisions regarding appointment and advancement. In this study, we evaluate the impact of NIH funding on scholarly productivity in otolaryngology. STUDY DESIGN: Analysis of bibliometric data of academic otolaryngologists. METHODS: Funding data for the 20 otolaryngology departments with the largest aggregate total of NIH grants for the fiscal years (FY) 2011 and 2012 was obtained using the National Institutes of Health Research Portfolio Online Reporting Tools Expenditures and Reports (RePORTER) Database. H-indices were calculated using the Scopus online database, and then compared to funding data at both the departmental and individual level. RESULTS: Faculty members in otolaryngology departments who received NIH funding had significantly greater research productivity and impact, as measured by the h-index, than their nonfunded peers. H-indices increased with greater NIH funding levels, and investigators with MD degrees tended to have higher mean NIH funding levels than those with PhDs. While there was no correlation between average h-index and NIH funding totals at the level of departments, there was greater correlation upon examination of NIH funding levels of individual investigators. CONCLUSIONS: The h-index has a strong relationship with, and may be predictive of, grant awards of NIH-funded faculty members in otolaryngology departments. This bibliometric may be useful in decisions regarding appointment and advancement of faculty members within academic otolaryngology departments.

Readability assessment of online thyroid surgery patient education materials.

BACKGROUND: Published guidelines recommend written health information be written at or below the sixth-grade level. We evaluate the readability of online materials related to thyroid surgery. METHODS: Thyroid surgery materials were evaluated using Flesch Reading Ease Score (FRES), Flesch Kincaid Grade Level (FKGL), Gunning Frequency of Gobbledygook (GFOG), and Simple Measure of Gobbledygook (SMOG). RESULTS: Thirty-one documents were evaluated. FRES scores ranged from 29.3 to 67.8 (possible range = 0 to 100), and averaged 50.5. FKGL ranged from 6.9 to 14.9 (possible range = 3 to 12), and averaged 10.4. SMOG scores ranged from 11.8 to 14.5 (possible range = 3 to 19), and averaged 13.0. GFOG scores ranged from 10.6 to 18.0 (possible range = 3 to 19), and averaged 13.5. CONCLUSIONS: Readability scores for online thyroid surgery materials are higher (i.e., more difficult) than the recommended levels. However, readability is only one aspect of comprehension. Written information should be designed with that fact in mind.

Readability assessment of internet-based patient education materials related to facial fractures.

OBJECTIVE/HYPOTHESIS: Various professional societies, clinical practices, hospitals, and health care-related Web sites provide Internet-based patient education material (IPEMs) to the general public. However, this information may be written above the 6th-grade reading level recommended by the US Department of Health and Human Services. The purpose of this study is to assess the readability of facial fracture (FF)-related IPEMs and compare readability levels of IPEMs provided by four sources: professional societies, clinical practices, hospitals, and miscellaneous sources. STUDY DESIGN: Analysis of IPEMs on FFs available on Google.com. METHODS: The readability of 41 FF-related IPEMs was assessed with four readability indices: Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease Score (FRES), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (Gunning FOG). Averages were evaluated against national recommendations and between each source using analysis of variance and t tests. RESULTS: Only 4.9% of IPEMs were written at or below the 6th-grade reading level, based on FKGL. The mean readability scores were: FRES 54.10, FKGL 9.89, SMOG 12.73, and Gunning FOG 12.98, translating into FF-related IPEMs being written at a "difficult" writing level, which is above the level of reading understanding of the average American adult. CONCLUSIONS: IPEMs related to FFs are written above the recommended 6th-grade reading level. Consequently, this information would be difficult to understand by the average US patient.

Readability assessment of Internet-based patient education materials related to endoscopic sinus surgery.

OBJECTIVES/HYPOTHESIS: Numerous professional societies, clinical practices, and hospitals provide Internet-based patient education materials (PEMs) to the general public, but not all of this information is written at a reading level appropriate for the average patient. The National Institutes of Health and the US Department of Health and Human Services recommend that PEMs be written at or below the sixth-grade level. Our purpose was to assess the readability of endoscopic sinus surgery (ESS)-related PEMs available on the Internet and compare readability levels of PEMs provided by three sources: professional societies, clinical practices, and hospitals. STUDY DESIGN: A descriptive and correlational design was used for this study. METHODS: The readability of 31 ESS-related PEMs was assessed with four different readability indices: Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease Score (FRES), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (Gunning FOG). Averages were evaluated against national recommendations and between each source using analysis of variance and t tests. RESULTS: The majority of PEMs (96.8%) were written above the recommended sixth-grade reading level, based on FKGL (P < .001). Only one article (3.2%) had an FKGL at or below the sixth-grade level. The mean readability values were: FRES 47.1 ± 13.4, FKGL 10.7 ± 2.4, SMOG 13.7 ± 1.6, and Gunning FOG 12.4 ± 2.7. CONCLUSIONS: Current Internet-based PEMs related to ESS, regardless of source type, were written well above the recommended sixth-grade level. Materials from the hospitals/university-affiliated websites had lower readability scores, but were still above recommended levels. Web-based PEMs pertaining to ESS should be written with the average patient in mind.