Readability assessment of online tracheostomy care resources.
Readability assessment of online tracheostomy care resources.
- Research Article
1
- 10.1177/0194599814541629a50
- Sep 1, 2014
- Otolaryngology–Head and Neck Surgery
Readability Assessment of Online Tracheostomy Care Resources
- Research Article
31
- 10.1016/j.jvir.2013.01.006
- Feb 26, 2013
- Journal of Vascular and Interventional Radiology
Readability Assessment of Internet-based Patient Education Materials Related to Uterine Artery Embolization
- Research Article
97
- 10.1002/lary.23309
- Jun 8, 2012
- The Laryngoscope
Numerous professional societies, clinical practices, and hospitals provide Internet-based patient education materials (PEMs) to the general public, but not all of this information is written at a reading level appropriate for the average patient. The National Institutes of Health and the US Department of Health and Human Services recommend that PEMs be written at or below the sixth-grade level. Our purpose was to assess the readability of endoscopic sinus surgery (ESS)-related PEMs available on the Internet and compare readability levels of PEMs provided by three sources: professional societies, clinical practices, and hospitals. A descriptive and correlational design was used for this study. The readability of 31 ESS-related PEMs was assessed with four different readability indices: Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease Score (FRES), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (Gunning FOG). Averages were evaluated against national recommendations and between each source using analysis of variance and t tests. The majority of PEMs (96.8%) were written above the recommended sixth-grade reading level, based on FKGL (P < .001). Only one article (3.2%) had an FKGL at or below the sixth-grade level. The mean readability values were: FRES 47.1 ± 13.4, FKGL 10.7 ± 2.4, SMOG 13.7 ± 1.6, and Gunning FOG 12.4 ± 2.7. Current Internet-based PEMs related to ESS, regardless of source type, were written well above the recommended sixth-grade level. Materials from the hospitals/university-affiliated websites had lower readability scores, but were still above recommended levels. Web-based PEMs pertaining to ESS should be written with the average patient in mind.
- Research Article
51
- 10.1016/j.acra.2014.10.009
- Dec 5, 2014
- Academic Radiology
Readability Assessment of Internet-based Patient Education Materials Related to Mammography for Breast Cancer Screening
- Research Article
69
- 10.1002/lary.23424
- Jul 25, 2012
- The Laryngoscope
Various professional societies, clinical practices, hospitals, and health care-related Web sites provide Internet-based patient education material (IPEMs) to the general public. However, this information may be written above the 6th-grade reading level recommended by the US Department of Health and Human Services. The purpose of this study is to assess the readability of facial fracture (FF)-related IPEMs and compare readability levels of IPEMs provided by four sources: professional societies, clinical practices, hospitals, and miscellaneous sources. Analysis of IPEMs on FFs available on Google.com. The readability of 41 FF-related IPEMs was assessed with four readability indices: Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease Score (FRES), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (Gunning FOG). Averages were evaluated against national recommendations and between each source using analysis of variance and t tests. Only 4.9% of IPEMs were written at or below the 6th-grade reading level, based on FKGL. The mean readability scores were: FRES 54.10, FKGL 9.89, SMOG 12.73, and Gunning FOG 12.98, translating into FF-related IPEMs being written at a "difficult" writing level, which is above the level of reading understanding of the average American adult. IPEMs related to FFs are written above the recommended 6th-grade reading level. Consequently, this information would be difficult to understand by the average US patient.
- Research Article
1
- 10.1055/s-0033-1336394
- Mar 16, 2013
- Journal of Neurological Surgery Part B: Skull Base
OBJECTIVE The objectives of this study were to assess the readability of Internet-based patient education materials related to acoustic neuromas (AN-IPEMs) by 4 widely validated readability indices, to evaluate scores against the existing sixth grade recommended reading level, and to compare the readability scores of patient education materials (PEMs) produced by professional organizations, clinical practices, hospitals, and miscellaneous sources. MATERIALS AND METHODS AN-IPEMs from 67 web sites (6 professional societies, 33 clinical practices, 19 hospitals, and 9 miscellaneous) were assessed using Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (Gunning FOG). Scores were then evaluated against national recommendations by 1-tailed t tests and against each other using 1-way ANOVAs. RESULTS The average FKGL, SMOG, and Gunning FOG scores were all significantly higher than the recommended sixth grade reading level suggested by the USDHHS (p < 0.0001, single sample 1-tailed t test). Zero articles, by all indices, had a reading level equal to or below the sixth grade reading level. The FKGLs also varied between the various sources at a significant level (p = 0.01 one-way ANOVA independent samples). The average FKGLs of clinical practice and professional society AN-IPEMs were significantly higher than the average FKGLs of hospital AN-IPEMs (both p ≤ 0.05 one-tailed t-tests assuming unequal variances). CONCLUSION AN-IPEMs are written at a level significantly higher than that suggested by national recommendations. Current AN-IPEMs may need to be revised in order to enhance patient comprehension.
- Research Article
30
- 10.1097/mao.0b013e31829530e5
- Sep 1, 2013
- Otology & Neurotology
The objectives of this study were to assess the readability of Internet-based patient education materials related to acoustic neuromas (AN-IPEMs) by 4 widely validated readability indices, to evaluate scores against the existing sixth grade recommended reading level, and to compare the readability scores of patient education materials (PEMs) produced by professional organizations, clinical practices, hospitals, and miscellaneous sources. AN-IPEMs from 67 web sites (6 professional societies, 33 clinical practices, 19 hospitals, and 9 miscellaneous) were assessed using Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (Gunning FOG). Scores were then evaluated against national recommendations by 1-tailed t tests and against each other using 1-way ANOVAs. The average FKGL, SMOG, and Gunning FOG scores were all significantly higher than the recommended sixth grade reading level suggested by the USDHHS (p < 0.0001, single sample 1-tailed t test). Zero articles, by all indices, had a reading level equal to or below the sixth grade reading level. The FKGLs also varied between the various sources at a significant level (p = 0.01 one-way ANOVA independent samples). The average FKGLs of clinical practice and professional society AN-IPEMs were significantly higher than the average FKGLs of hospital AN-IPEMs (both p ≤ 0.05 one-tailed t-tests assuming unequal variances). AN-IPEMs are written at a level significantly higher than that suggested by national recommendations. Current AN-IPEMs may need to be revised in order to enhance patient comprehension.
- Research Article
5
- 10.7759/cureus.24287
- Apr 19, 2022
- Cureus
IntroductionBranchial cleft cysts are the second most common congenital neck mass and can cause significant anxiety for patients and families despite their benign nature. Education through online patient education materials (PEMs) is critical for informing patients and reducing stress. We aimed to determine the content, quality, and readability of online PEMs related to branchial cleft cysts.MethodsThe search engine Google was used to collect the first 100 website results for the query “branchial cleft cyst.” PEMs were included and assessed for content, quality via the DISCERN tool, and readability via Flesch Reading Ease Score (FRES), Flesch-Kincaid Reading Grade Level (FKGL), Gunning Frequency of Gobbledygook (GFOG), and Simple Measure of Gobbledygook (SMOG).ResultsTwenty-six websites containing PEMs related to branchial cleft cysts were assessed. Most websites were from universities or medical centers and did not contain any media. The mean DISCERN score was 49.3 (SD: 11.1, Median: 52.5), the mean FRES score was 51.9 (SD: 12.1, Median: 54.0), the mean FKGL score was 10.35 (SD: 2.52, Median: 9.95), the mean GFOG score was 13.32 (SD: 2.52, Median: 13.00), and the mean SMOG score was 10.25 (SD: 1.83, Median: 9.95). DISCERN was not significantly correlated with FRES, FKGL, GFOG, or SMOG.ConclusionOnline PEMs related to branchial cleft cysts are consistently written above the National Institutes of Health (NIH) recommended sixth-grade reading level and are often of unsatisfactory overall quality. Writers of online PEMs for branchial cleft cysts should consider the readability and quality of their materials to improve patient education and reduce anxiety.
- Research Article
25
- 10.1016/j.acra.2019.11.020
- Jan 9, 2020
- Academic Radiology
Readability Assessment of Internet-based Patient Education Materials Related to Treatment Options for Benign Prostatic Hyperplasia
- Research Article
62
- 10.1097/iop.0000000000002549
- Nov 16, 2023
- Ophthalmic plastic and reconstructive surgery
This study aims to compare the readability of patient education materials (PEM) of the American Society of Ophthalmic Plastic and Reconstructive Surgery to that of PEMs generated by the AI-chat bots ChatGPT and Google Bard. PEMs on 16 common American Society of Ophthalmic Plastic and Reconstructive Surgery topics were generated by 2 AI models, ChatGPT 4.0 and Google Bard, with and without a 6th-grade reading level prompt modifier. The PEMs were analyzed using 7 readability metrics: Flesch Reading Ease Score, Gunning Fog Index, Flesch-Kincaid Grade Level, Coleman-Liau Index, Simple Measure of Gobbledygook Index Score, Automated Readability Index, and Linsear Write Readability Score. Each AI-generated PEM was compared with the equivalent American Society of Ophthalmic Plastic and Reconstructive Surgery PEM. Across all readability indices, PEM generated by ChatGPT 4.0 consistently had the highest readability scores, indicating that the material generated by this AI chatbot may be most difficult to read in its unprompted form (Flesch Reading Ease Score: 36.5; Simple Measure of Gobbledygook: 14.7). Google's Bard was able to generate content that was easier to read than both the American Society of Ophthalmic Plastic and Reconstructive Surgery and ChatGPT 4.0 (Flesch Reading Ease Score: 52.3; Simple Measure of Gobbledygook: 12.7). When prompted to produce PEM at a 6th-grade reading level, both ChatGPT 4.0 and Bard were able to significantly improve in their readability scores, with prompted ChatGPT 4.0 being able to consistently generate content that was easier to read (Flesch Reading Ease Score: 67.9, Simple Measure of Gobbledygook: 10.2). This study suggests that AI tools, when guided by appropriate prompts, can generate accessible and comprehensible PEMs in the field of ophthalmic plastic and reconstructive surgeries, balancing readability with the complexity of the necessary information.
- Research Article
71
- 10.1002/hed.23157
- Sep 13, 2012
- Head & Neck
Published guidelines recommend written health information be written at or below the sixth-grade level. We evaluate the readability of online materials related to thyroid surgery. Thyroid surgery materials were evaluated using Flesch Reading Ease Score (FRES), Flesch Kincaid Grade Level (FKGL), Gunning Frequency of Gobbledygook (GFOG), and Simple Measure of Gobbledygook (SMOG). Thirty-one documents were evaluated. FRES scores ranged from 29.3 to 67.8 (possible range = 0 to 100), and averaged 50.5. FKGL ranged from 6.9 to 14.9 (possible range = 3 to 12), and averaged 10.4. SMOG scores ranged from 11.8 to 14.5 (possible range = 3 to 19), and averaged 13.0. GFOG scores ranged from 10.6 to 18.0 (possible range = 3 to 19), and averaged 13.5. Readability scores for online thyroid surgery materials are higher (i.e., more difficult) than the recommended levels. However, readability is only one aspect of comprehension. Written information should be designed with that fact in mind.
- Research Article
36
- 10.1097/md.0000000000008526
- Nov 1, 2017
- Medicine
We evaluated the readability of Internet-sourced patient education materials (PEMs) related to “labour analgesia.” In addition to assessing the readability of websites, we aimed to compare commercial, personal, and academic websites.We used the most popular search engine (http://www.google.com) in our study. The first 100 websites in English that resulted from a search for the key words “labour analgesia” were scanned. Websites that were not in English, graphs, pictures, videos, tables, figures and list formats in the text, all punctuation, the number of words in the text is less than 100 words, feedback forms not related to education, (Uniform Resource Locator) URL websites, author information, references, legal disclaimers, and addresses and telephone numbers were excluded.The texts included in the study were assessed using the Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (FOG) readability formulae. The number of Latin words within the text was determined.Analysis of 300-word sections of the texts revealed that the mean FRES was 47.54 ± 12.54 (quite difficult), mean FKGL and SMOG were 11.92 ± 2.59 and 10.57 ± 1.88 years of education, respectively, and mean Gunning FOG was 14.71 ± 2.76 (very difficult). Within 300-word sections, the mean number of Latin words was identified as 16.56 ± 6.37.In our study, the readability level of Internet-sourced PEM related to “labour analgesia” was identified to be quite high indicating poor readability.
- Abstract
- 10.1016/j.jvir.2019.12.701
- Feb 20, 2020
- Journal of Vascular and Interventional Radiology
No. 640 Readability assessment of internet-based patient education materials related to treatment options for benign prostatic hyperplasia
- Research Article
2
- 10.14444/8133
- Oct 1, 2021
- International Journal of Spine Surgery
As spine surgery in the ambulatory setting becomes more frequent, patients should comprehend the difference from traditional hospital-based, outpatient settings. Limited research exists on the readability of online articles surrounding spine surgery in the ambulatory surgery center (ASC). In this study, we intend to evaluate the readability of online articles pertaining to spine surgery in the outpatient and ambulatory surgical settings. Three search engines were queried, and the first 100 articles pertaining to each outpatient spine surgery search term were collected. Advertisements, videos, and peer-reviewed scientific articles were excluded. Articles were categorized by publishing source as follows: hospital or institution, general medical Websites, private practice, or surgery center. Flesch-Kincaid (FK) grade level, Flesch Reading Ease (FRE) score, word count, sentences per paragraph, words per sentence, and characters per word were evaluated for each article. Student's t tests compared readability metrics between groups based on setting and procedure region. A total of 342 articles was analyzed; 279 articles were outpatient hospital related, and 63 ASC related. Flesch-Kincaid grade levels or FRE scores were not significantly different between outpatient hospital and ambulatory center. Comparison of ASC to outpatient articles from a hospital or institution source significantly differed in FRE score (40.7 versus 32.4) and FK grade level (12.3 versus 13.9; all P < .05). Articles addressing procedure type were significantly different in FRE score (36.2 versus 30.0) and FK grade level (13.0 ± 2.1 versus 14.3 ± 1.8). Hospital, private practice, and medical journalists should be aware of significant differences in readability of patient-accessible ASC articles. These articles may be more difficult to read than outpatient hospital articles, and production of more reading-level-appropriate online literature is required. 3 CLINICAL RELEVANCE: There is a significant difference in the readability of patient-accessible ASC articles.
- Research Article
1
- 10.1097/md.0000000000032685
- Jan 20, 2023
- Medicine
The aim of this research is to evaluate the websites containing "coccydynia, coccyx trauma or fracture" in terms of readability, reliability, accuracy, and quality. Searches for "coccydynia, coccyx trauma, coccyx fracture" were carried out in the 3 most used search engines in the USA: Google, Yahoo, and Bing in February 2022. A total of 141 websites were rated by 2 different neurosurgeons for the "Global Quality Score" and "Alexa Popularity Rank." 97.2% of the sites examined include the definition of the disease, 66% include the importance of the disease, 92.9% include the symptoms of the disease, 88.7% include the treatment of the disease, 78% include the signs of the disease, 77.3% include the mechanism of the disease It has been determined that the websites examined within the scope of the research have high global quality score (GQS) and APR and are enriched with images to a large extent.