Internet-based Patient Education Materials Research Articles

Readability, Content, and Quality of Online Patient Education Materials on Anesthesia and Neurotoxicity in the Pediatric Population.

Internet-based patient education materials (PEMs) are often above the recommended sixth grade reading level recommended by the U.S. Department of Health and Human Services. In 2016 the U.S. Food and Drug Administration (FDA) released a warning statement against use of general anesthetic drugs in children and pregnant women due to concerns about neurotoxicity. The aim of this study is to evaluate readability, content, and quality of Internet-based PEMs on anesthesia in the pediatric population and neurotoxicity. The websites of U.S. medical centers with pediatric anesthesiology fellowship programs were searched for PEMs pertaining to pediatric anesthesia and neurotoxicity. Readability was assessed. PEM content was evaluated using matrices specific to pediatric anesthesia and neurotoxicity. PEM quality was assessed with the Patient Education Material Assessment Tool for Print. A one-sample t-test was used to compare the readability of the PEMs to the recommended sixth grade reading level. We identified 27 PEMs pertaining to pediatric anesthesia and eight to neurotoxicity. Mean readability of all PEMs was greater than a sixth grade reading (p <0.001). While only 13% of PEMs on anesthesia for pediatric patient mentioned the FDA warning, 100% of the neurotoxicity materials did. PEMs had good understandability (83%) and poor actionability (60%). The readability, content, and quality of PEMs are poor and should be improved to help parents and guardians make informed decisions about their children's health care. · The FDA issued a warning statement against the use of general anesthetic drugs in children and pregnant women.. · Readability, content, and quality of Internet-based patient education materials on the topic of neurotoxicity are poor.. · Improving the readability, content, and quality of PEMs could aid parents in making important health care decisions..

Evaluating the readability, quality and reliability of online patient education materials on transcutaneuous electrical nerve stimulation (TENS).

Increasing digitization also raises concerns regarding the reliability and comprehensibility of online health information. In this study, we aimed to examine the readability, reliability, and quality of internet-based patient education materials on "transcutaneous electrical nerve stimulation." On September 15, 2022, we used Google search engine to search the keyword "Transcutaneous Electrical Nerve Stimulation" and obtained information from 200 websites. The readability of the websites was evaluated using the Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level, Simple Measure of Gobbledygook, and Gunning Fog. The Journal of American Medical Association score and Health on the Net Foundation code of conduct were used to determine the reliability of the websites, whereas the DISCERN score and Global Quality Score were used to evaluate the quality of the websites. In the readability analysis of 102 websites that met the inclusion criteria of this study, we found that the Flesch Reading Ease Score was 47.91 ± 13.79 (difficult), average Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook were 11.20 ± 2.85 and 10.53 ± 2.11 years, respectively, and average Gunning Fog score was 14.04 ± 2.74 (very difficult). Commercial websites constituted the highest proportion of websites (n = 36, 35.5%). Overall, 16.7% of the websites were found to be of high quality according to the Global Quality Score, 16 (15.7%) websites had Health on the Net Foundation code of conduct certification, and 8.8% of the websites were found to be highly reliable according to the Journal of American Medical Association scores. There was a statistically significant difference between website typologies and quality and reliability scores (P < .001). Compared with the sixth-grade level recommended by the American Medical Association and the National Institute of Health, the readability of transcutaneous electrical nerve stimulation-related internet-based patient education materials was considerably high, but they showed low reliability and moderate-to-poor quality. Thus, the quality, reliability, and readability of websites developed by health professionals play a major role in conveying accurate and easily understandable information.

AB033. SOH22ABS030. Readability and quality assessment of internet-based patient education materials related to deep vein thrombosis (DVT)

Background: Access to health-related internet information has increased dramatically during the past decade. A significant proportion of this information has been demonstrated to be set at too high a level for general comprehension. The goal of this study was to evaluate the readability and quality of information available on the internet relating to deep vein thrombosis (DVT).

Internet-Based Patient Education Materials Regarding Diabetic Foot Ulcers: Readability and Quality Assessment.

BackgroundWhile diabetic foot ulcers (DFU) are a common complication of diabetes, little is known about the content and readability of online patient education materials (PEM) for DFU. The recommended reading grade level for these materials is grades 6-8.ObjectiveThe aim of this paper was to evaluate the quality and readability of online PEM on DFU.MethodsA Google search was performed using 4 different search terms related to DFU. Two readability formulas were used to assess the readability of the included PEM. These included the Flesch-Kincaid grade level and the Flesch-Reading ease score. The DISCERN tool was used to determine quality and reliability.ResultsA total of 41 online PEM were included. The average Flesch-Reading ease score for all PEM was 63.43 (SD 14.21), indicating a standard difficulty level of reading. The average reading grade level was 7.85 (SD 2.38), which is higher than the recommended reading level for PEM. The mean DISCERN score was 45.66 (SD 3.34), and 27% (11/41) of the articles had DISCERN scores of less than 39, corresponding to poor or very poor quality.ConclusionsThe majority of online PEM on DFU are written above the recommended reading levels and have significant deficiencies in quality and reliability. Clinicians and patients should be aware of the shortcomings of these resources and consider the impact they may have on patients’ self-management.

Readability and quality assessment of internet-based patient education materials related to deep vein thrombosis.

Access to health-related internet information has increased dramatically during the past decade. A significant proportion of this information has been demonstrated to be set at too high a level for general comprehension. The goal of this study was to evaluate the readability and quality of information available on the internet relating to deep vein thrombosis (DVT). A search for 'DVT' and 'Deep Vein Thrombosis' was performed on five most commonly accessed search engines. Top hundred websites were reviewed. Website authorship was classified. Each site was assessed using the recognized quality and readability scoring systems. The presence of the health on the net foundation code of conduct (HON-code), a reported quality-assurance marker, was noted. The majority of web sites (45%) were academic or physician compiled. Only 36% of the websites were HON-code certified. HON-code certified sites achieved significantly greater DISCERN and Journal of the American Medical Association (JAMA) scores. Seventy-three percent of the websites were above the recommended sixth-grade readability level. Flesch--Kincaid readability test (FRES) of more than half of the websites (56%) was below 60, which makes them fairly difficult to read by general public. Internet information relating to DVT is of variable quality and largely set at an inappropriate readability level. Given this variability in quality, healthcare providers should direct patients to known sources of reliable, readable online information. Identification of reliable sources may be aided by known markers of quality such as HONcode certification and to educate them to use academic and physician-provided sites which have been shown to contain better-quality information. Moreover, academic and physician-compiled websites should be written in a fashion appropriate for general public consumption.

"Readability Assessment of Internet-Based Patient Education Materials on Anticoagulation Therapy"

Since the advent of the Web and media, there has been a significant change in the practice of Medicine...

Readability and quality assessment of internet-based patient education materials related to nasal septoplasty

BackgroundGiven that nasal septoplasty is a common procedure in otolaryngology – head and neck surgery, the objective of this study was to evaluate the quality and readability of online patient education materials on septoplasty.MethodsA Google search was performed using eight different search terms related to septoplasty. Six different tools were used to assess the readability of included patient education materials. These included the Flesch-Kincaid Grade Level, Flesch Reading Ease, Gunning-Fog Index, Simple Measure of Gobbledygook Index, Coleman-Liau Index, and Automated Readability Index. The DISCERN tool was used to assess quality and reliability.ResultsEighty-five online patient education materials were included. The average Flesch-Reading Ease score for all patient education materials was 54.9 ± 11.5, indicating they were fairly difficult to read. The average reading grade level was 10.5 ± 2.0, which is higher than the recommended reading level for patient education materials. The mean DISCERN score was 42.9 ± 10.5 and 42% (36/85) of articles had DISCERN scores less than 39, corresponding to poor or very poor quality.ConclusionThe majority of online patient education materials on septoplasty are written above the recommended reading levels and have significant deficiencies in terms of their quality and reliability. Clinicians and patients should be aware of the shortcomings of these resources and consider the impact they may have on patients’ decision making.

Akut romatizmal ateşte internet tabanlı hasta eğitim materyallerinin okunabilirliğinin değerlendirilmesi

Purpose: The purpose of this study is to assess the readability of acute rheumatic fever-related Internet-based patient education materials. Materials and Methods: A total of 250 websites assessed, 50 for each of the keywords (“acute rheumatic fever,” “acute joint rheumatism’’, “rheumatic fever’’, “acute rheumatic carditis’’, “rheumatic carditis’’) on search engine Google (available at www.google.com). Sites with less information than ten sentences, chat, forum and commercial blog sites were excluded from the study. Average word count, average syllable number and words with an average syllable number of 4 and above were calculated. The average readability level was analyzed using Ateşman and Bezirci-Yilmaz readability formulas. Results: A total of 50 out of 250 websites were eligible for examination after the applying of the exclusion criteria. Of the sites reviewed, 33 created by health-care professionals and the 17 by non-health-care professionals. The readability of the web sites was moderate difficulty according to the Ateşman formula, and comprehensible to people at undergraduate level according to the Bezirci-Yılmaz formula. Conclusion: The readability level of patient educational texts related to acute rheumatic fever field on web sites was at academic literacy level. This information would be difficult to understand by the average education level in the Turkey.

Readability, Content, Quality, and Accuracy Assessment of Internet-based Patient Education Materials Relating to Labor Analgesia

(Int J Obstet Anesth. 2019;39:82–87) It has been reported that &gt;90% of pregnant women in the United States and Western Europe conduct internet searches for health information related to pregnancy. However, 66% of these women believed that information they obtained from a Web site may have been inaccurate or misleading; this potentially wrong content caused them worry about their pregnancy and/or delivery. With pregnancy information widely available online, it is important for health care professionals to monitor the quality and accuracy of the information their patients are receiving from internet sources. In this study, the investigators compared patient education materials (PEMs) provided by national and international medical societies to PEMs found via a Google search, assessing the readability, content, quality, and accuracy of the information.

Abstract No. 640 Readability assessment of internet-based patient education materials related to treatment options for benign prostatic hyperplasia

To assess the current readability levels for online Internet-based patient education materials (IPEMs) related to treatment options for benign prostatic hyperplasia (BPH), including transurethral resection of prostate (TURP) and prostate artery embolization (PAE). Using the Google search engine only we identified 40 IPEM’s pertaining to TURP and PAE that fit HON-code criteria. Readability comprehension analysis was performed using the following algorithms: Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Formula (FKGL), Simple Measure of Gobbledygook (SMOG), and the Gunning Frequency of Gobbledygook (Gunning FOG). Only 7.5% (3/40) websites met the United States Department of Health and Human Services (USDHHS) recommendation of a 6th grade or lower comprehension levels, with FRES scores in the “fairly easy.” Comparison of TURP to PAE groups showed that TURP readability scores with respect FRES and FKGL were significantly easier to read. According to SMOG and GFOG analysis there was no difference between the two groups by grade level, which demonstrated an average at the 12th grade reading level. Subgroup analysis of IPEM type, categorized as Health Networks (12), University Hospitals (14), Clinical Practices (6), and Miscellaneous (8), found no difference in reading level across all scoring systems. Currently available IPEM’s pertaining to BPH treatment options are written at a level that is too difficult for the average American to understand. Physicians and health networks should take USDHHS recommendations into consideration when designing IPEMs to optimize accessibility of health information to improve patient compliance and outcomes.TableAverage FRES, FKGL, SMOG & GFOG of all IPEMsReadability ScaleTotal Average Score (95% Cl)TURP Average Score (95% CI)PAE Average Score (95% CI)P valueFRES52.9 (48.7−57.0)57.7 (54.5−61.4)47.7 (43.9−51.6)0.01FKGL9.7 (8.9−10.4)8.8 (7.1−10.5)10.6 (9.1−12.1)0.02SMOG12.9 (12.2−13.6)12.5 (11.4−13.7)13.3 (11.9−14.6)0.29GFOG12.9 (11.9−13.8)11.9 (10.1−13.8)13.8 (12.0−15.5)0.06 Open table in a new tab

Readability Assessment of Internet-based Patient Education Materials Related to Treatment Options for Benign Prostatic Hyperplasia

To assess the current readability levels for online Internet-Based Patient Education Materials (IPEMs) related to treatment options for benign prostatic hyperplasia, including transurethral resection of prostate (TURP) and prostate artery embolization (PAE). Using the Google search engine we identified 40 IPEMs pertaining to TURP and PAE. Readability analysis was performed using the following algorithms: Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Formula (FKGL), Simple Measure of Gobbledygook (SMOG), and the Gunning Frequency of Gobbledygook (GFOG). Scores are categorized by difficulty (FRES) and grade level (FKGL, SMOG, GFOG). Only 7.5% (3/40) websites met the United States Department of Health and Human Services recommendation of a sixth grade or lower comprehension levels, with FRES scores in the "fairly easy" category. Comparison of TURP to PAE groups showed that TURP readability scores with respect FRES and FKGL were significantly easier to read. According to SMOG and GFOG analysis there was no difference between the two groups by grade level, which demonstrated an average at the 12th grade reading level. Subgroup analysis of IPEM type, categorized as Health Networks (12), University Hospitals (14), Clinical Practices (6), and Miscellaneous (8), found no difference in reading level across all scoring systems. Currently available IPEMs pertaining to benign prostatic hyperplasia treatment options are written at a level that is too difficult for the average American to understand. Physicians and health networks should take United States Department of Health and Human Services recommendations into consideration when designing IPEMs to optimize accessibility of health information to improve patient compliance and outcomes.

Readability, content, quality and accuracy assessment of internet-based patient education materials relating to labor analgesia

BackgroundWith over 90% of parturients searching the internet for health information, the quality of information is important. Web-based patient education materials (PEMs) related to labor analgesia are frequently of low readability. This study compares the readability, content, quality and accuracy of labor analgesia-related PEMs from relevant healthcare society websites and the top internet search results. MethodsThe first ten PEMs from Google searches for “labor epidural” and “labor pain relief” were compared with PEMs from North American and United Kingdom anesthesiology, obstetric and medical society websites. Readability was assessed utilizing five validated readability indices. Quality was assessed using Patient Education Materials Assessment Tool for Print (PEMAT). The PEMs were graded for accuracy by four obstetric anesthesiologists. Readability, quality and accuracy scores were compared using the independent t-test and content using Chi-square analysis. ResultsSociety PEMs were significantly more readable than non-society PEMs for three of five readability indices, though the mean of both groups was at or above an eighth-grade (average age 13–14 years-old) reading level. The PEMAT understandability and accuracy scores were significantly higher for society websites. The most frequently mentioned topics were benefits, effects of epidural analgesia on labor and delivery, definitions, post-dural puncture headache and alternative analgesics. ConclusionsGoogle search results for labor analgesia lead to PEMs of variable quality and readability. For readers to be better informed, web-based PEMs should be improved or women directed to society PEMs. Inaccurate information may lead to incorrect expectations and conflict during labor, with potentially lower maternal satisfaction.

Evaluation of internet-based patient education materials from internal medicine subspecialty organizations: will patients understand them?

The majority of Americans use the Internet daily, if not more often, and many search online for health information to better understand a diagnosis they have been given or to research treatment options. The average American reads at an eighth-grade level. The purpose of this study is to evaluate the readability of online patient education materials on the websites of 14 professional organizations representing the major internal medicine subspecialties. We used ten well-established quantitative readability scales to assess written text from patient education materials published on the websites of the major professional organizations representing the following subspecialty groups: allergy and immunology, cardiology, endocrinology, gastroenterology, geriatrics, hematology, hospice and palliative care, infectious disease, nephrology, oncology, pulmonology and critical care, rheumatology, sleep medicine, and sports medicine. Collectively the 540 articles analyzed were written at an 11th-grade level (SD 1.4 grade levels). The sleep medicine and nephrology websites had the most readable materials, written at an academic grade level of 8.5±1.5 and 9.0±0.2, respectively. Material at the infectious disease site was written at the most difficult level, with average readability corresponding to grades 13.9±0.3. None of the patient education materials we reviewed conformed to the American Medical Association (AMA) and the National Institutes of Health (NIH) guidelines requiring that patient education articles be written at a third- to seventh-grade reading level. If these online resources were rewritten, it is likely that more patients would derive benefit from reading them.

Health Literacy and Radiation Oncology: A Review of Internet-Based Patient Education Materials

Health Literacy and Radiation Oncology: A Review of Internet-Based Patient Education Materials

Radiation Oncology and Online Patient Education Materials: Deviating From NIH and AMA Recommendations

Physicians encourage patients to be informed about their health care options, but much of the online health care-related resources can be beneficial only if patients are capable of comprehending it. This study's aim was to assess the readability level of online patient education resources for radiation oncology to conclude whether they meet the general public's health literacy needs as determined by the guidelines of the United States National Institutes of Health (NIH) and the American Medical Association (AMA). Radiation oncology-related internet-based patient education materials were downloaded from 5 major professional websites (American Society for Radiation Oncology, American Association of Physicists in Medicine, American Brachytherapy Society, RadiologyInfo.org, and Radiation Therapy Oncology Group). Additional patient education documents were downloaded by searching for key radiation oncology phrases using Google. A total of 135 articles were downloaded and assessed for their readability level using 10 quantitative readability scales that are widely accepted in the medical literature. When all 10 assessment tools for readability were taken into account, the 135 online patient education articles were written at an average grade level of 13.7±2.0. One hundred nine of the 135 articles (80.7%) required a high school graduate's comprehension level (12th-grade level or higher). Only 1 of the 135 articles (0.74%) met the AMA and NIH recommendations for patient education resources to be written between the third-grade and seventh-grade levels. Radiation oncology websites have patient education material written at an educational level above the NIH and AMA recommendations; as a result, average American patients may not be able to fully understand them. Rewriting radiation oncology patient education resources would likely contribute to the patients' understanding of their health and treatment options, making each physician-patient interaction more productive and efficient.

Readability of Spine-Related Patient Education Materials From Leading Orthopedic Academic Centers.

Cross-sectional analysis of online spine-related patient education materials from leading academic centers. To assess the readability levels of spine surgery-related patient education materials available on the websites of academic orthopedic surgery departments. The Internet is becoming an increasingly popular resource for patient education. Yet many previous studies have found that Internet-based orthopedic-related patient education materials from subspecialty societies are written at a level too difficult for the average American; however, no prior study has assessed the readability of spine surgery-related patient educational materials from leading academic centers. All spine surgery-related articles from the online patient education libraries of the top five US News & World Report-ranked orthopedic institutions were assessed for readability using the Flesch-Kincaid (FK) readability test. Mean readability levels of articles amongst the five academic institutions and articles were compared. We also determined the number of articles with readability levels at or below the recommended sixth- or eight-grade levels. Intraobserver and interobserver reliability of readability assessment were assessed. A total of 122 articles were reviewed. The mean overall FK grade level was 11.4; the difference in mean FK grade level between each department varied significantly (range, 9.3-13.4; P < 0.0001). Twenty-three articles (18.9%) had a readability level at or below the eighth grade level, and only one (0.8%) was at or below the sixth grade level. Intraobserver and interobserver reliability were both excellent (intraclass correlation coefficient of 1 for both). Online patient education materials related to spine from academic orthopedic centers are written at a level too high for the average patient, consistent with spine surgery-related patient education materials provided by the American Academy of Orthopaedic Surgeons and spine subspecialty societies. This study highlights the potential difficulties patients might have in reading and comprehending the information in publicly available education materials related to spine. N/A.

Readability evaluation of Internet-based patient education materials related to the anesthesiology field

Study ObjectiveThe main objective of the current investigation was to assess the readability of Internet-based patient education materials related to the field of anesthesiology. We hypothesized that the majority of patient education materials would not be written according to current recommended readability grade level. SettingOnline patient education materials describing procedures, risks, and management of anesthesia-related topics were identified using the search engine Google (available at www.google.com) using the terms anesthesia, anesthesiology, anesthesia risks, and anesthesia care. DesignCross-sectional evaluation. InterventionsNone. MeasurementsAssessments of content readability were performed using validated instruments (Flesch-Kincaid Grade Formulae, the Gunning Frequency of Gobbledygook, the New Dale-Chall Test, the Fry graph, and the Flesch Reading Ease score). Main ResultsNinety-six Web sites containing Internet patient education materials (IPEMs) were evaluated. The median (interquartile range) readability grade level for all evaluated IPEMs was 13.5 (12.0-14.6). All the evaluated documents were classified at a greater readability level than the current recommended readability grade, P < .001. Readability grades were not significantly different among different IPEM sources. Assessment by the Flesch Reading Ease test classified all but 4 IPEMs as at least fairly difficult to read. ConclusionsInternet-based patient education materials related to the field of anesthesiology are currently written far above the recommended readability grade level. High complexity of written education materials likely limits access of information to millions of American patients. Redesign of online content of Web sites that provide patient education material regarding anesthesia could be an important step in improving access to information for patients with poor health literacy.

Readability Assessment of Internet-Based Patient Education Materials Related to Parathyroid Surgery.

Patient education is critical in obtaining informed consent and reducing preoperative anxiety. Written patient education material (PEM) can supplement verbal communication to improve understanding and satisfaction. Published guidelines recommend that health information be presented at or below a sixth-grade reading level to facilitate comprehension. We investigate the grade level of online PEMs regarding parathyroid surgery. A popular internet search engine was used to identify PEM discussing parathyroid surgery. Four formulas were used to calculate readability scores: Flesch Reading Ease (FRE), Flesch-Kincaid Grade Level (FKGL), Gunning Frequency of Gobbledygook (GFOG), and Simple Measure of Gobbledygook (SMOG). Thirty web-based articles discussing parathyroid surgery were identified. The average FRE score was 42.8 (±1 standard deviation [SD] 16.3; 95% confidence interval [CI], 36.6-48.8; range, 6.1-71.3). The average FKGL score was 11.7 (±1 SD 3.3; 95% CI, 10.5-12.9; range, 6.1-19.0). The SMOG scores averaged 14.2 (±1 SD 2.6; 95% CI, 13.2-15.2; range, 10.7-21.9), and the GFOG scores averaged 15.0 (±1 SD 3.5; 95% CI, 13.7-16.3; range, 10.6-24.8). Online PEM on parathyroid surgery is written above the recommended sixth-grade reading level. Improving readability of PEM may promote better health education and compliance.

Readability Assessment of Internet-based Patient Education Materials Related to Mammography for Breast Cancer Screening

The US Department of Health and Human Services (USDHHS) recommends that Internet-based patient education materials (IPEMs) be written below the sixth-grade reading level to target the average American adult. This study was designed to determine the readability of IPEMs regarding mammography for breast cancer screening. Three-hundred mammography-related Web sites were reviewed for IPEMs. Forty-two IPEMs that met the Health on the Net Foundation Code of Conduct were assessed for readability level with four readability indices that use existing algorithms based on word and sentence length to quantitatively analyze Internet sources for language intricacy including the following: Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease Score (FRES), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency of Gobbledygook (Gunning FOG; GFOG). Results were compared to national recommendations, and intergroup analysis was performed. No IPEMs (0%) regarding mammography were written at or below the sixth-grade reading level, based on FKGL. The mean readability scores were as follows: FRES, 49.04±10.62; FKGL, 10.71±2.01; SMOG, 13.33±1.67; and Gunning FOG, 14.32±2.18. These scores indicate that the readability of mammography IPEMs is written at a "difficult" level, significantly above the recommended sixth-grade reading level (P<.05) determined by the USDHHS. IPEMs related to mammography are written well above the recommended sixth-grade level and likely reflect other IPEMs in diagnostic radiology.

Analysis of Internet-Based Patient Education Materials Related to Pituitary Tumors

The Internet has become a primary and ubiquitous information source for patient education material (PEM); however, the information provided may not be appropriate for the average patient to comprehend. Various national healthcare organizations have recommended that PEM be written at or below the sixth-grade level. The purpose of this study was to assess the readability of pituitary tumor-related PEMs available on the Internet. Fifty-one PEMs on pituitary tumors were downloaded from professional society and clinical practice websites. Analysis of readability was performed using 4 different readability indices: Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease Score (FRES), Simple Measure of Gobbledygook (SMOG), and Gunning Frequency Measure of Gobbledygook (Gunning FOG). Scores from the FKGL, SMOG, and Gunning FOG scales correspond to reading grade levels. Therefore, a higher number corresponds to higher difficulty and lower readability. The average grade level of the PEMs according to the readability indices were as follows: FKGL = 11.71 (11th to 12th grades), SMOG = 14.56 (college level), and Gunning FOG = 14.86 (college level). For the FRES, higher scores imply easier readability. The average FRES was 40.19 (fairly difficult-between 10th and 11th grades). These findings suggest that online pituitary tumor-related material may be too difficult for comprehension by the majority of the targeted patient population. Keeping the reading level of PEMs at or below the sixth grade may improve understanding of this disease and its management for pituitary tumor patients.