Patient Education Materials Assessment Tool Research Articles

FRI401 Co-creating Patient-facing Materials For Primary Ovarian Insufficiency

Abstract Disclosure: I.R. McDonald: None. E.S. Blocker: None. E.A. Weyman: None. C.K. Welt: None. A.A. Dwyer: None. Evidence suggests people with POI have unmet health and information needs that contribute to impaired health-related quality of life (HR-QoL). Co-creation can produce high-quality patient-facing educational materials that respond to patient-identified needs and overcome healthcare disparities. Our goal was to co-create patient-facing materials that respond to unmet health and informational needs, mitigate health disparities, and improve HR-QoL for people with POI. The project had three sequential steps. First, we synthesized the state of the science on HR-QoL, care, and management of POI. Next, we conducted a systematic scoping review to identify “best practices” for co-creating patient-facing materials. Last, we employed co-creation best practices, patient engagement, and an iterative “design thinking” process to co-create and evaluate patient-facing POI materials. The HR-QoL scoping review identified three inter-related themes related to impaired HR-QoL in POI (diagnostic odyssey, isolation & stigma, and ego integrity) along with sub-themes of decreased sexual function, altered body image, psychological vulnerability and catastrophizing. The co-creation scoping review identified 6 best practices for co-creation: (1) begin with a review of the literature, (2) utilize a framework to inform the process, (3) involve clinical and patient experts from the beginning, (4) engage diverse perspectives, (5) ensure patients have the final decision, and (6) employ validated evaluation tools. Informed by the synthesis of care and management of POI, we partnered with patients to create concise patient-facing materials responding to unmet health and informational needs of people with POI. Patients engaged in co-creation using the “design thinking” process: empathize, define the question, ideate/brainstorm, iterate prototypes (n=4), and testing using the “gold standard” Patient Education Materials Assessment Tool (PEMAT). The final 2-page patient-facing materials were evaluated using 7 readability algorithms revealing a consensus reading level of 7th grade (i.e., fairly easy to read for an 11-13 year-old). The patient partners rated the materials as highly acceptable and actionable. The online PEMAT evaluation is underway in collaboration with POI patient organizations. We envision such co-creation will produce understandable and actionable materials (i.e., all PEMAT domain scores >80%). This project may serve as a roadmap for healthcare organizations and patients to collaborate and surmount health disparities and improve care for other health conditions. Presentation: Friday, June 16, 2023

A Quality Analysis of Donor Nephrectomy-Related Information on YouTube; Education or Misinformation?

There currently remains an urgent need to increase living kidney donation to help mitigate the high demand for waitlisted kidney failure patients. Potential kidney donors can readily access social media, particularly YouTube, to gain basic knowledge about live donor nephrectomy surgical procedures. YouTube is an open-source platform where anyone can upload videos about any topic without peer review or quality control and is frequently used for disseminating health education. This study aims to assess the quality and accuracy of information regarding live donor nephrectomy on YouTube. A YouTube search was performed using the keywords "donor nephrectomy" and "kidney transplant." A total of 57 videos were assessed for eligibility criteria. Two validated tools for evaluating health information, the DISCERN and The Patient Education Materials Assessment Tool for Audiovisual Materials tools, were used to assess YouTube video information quality, understandability, and actionability. A total of 53 of 57 screened videos were included in this study, with 4 videos being excluded for not being primarily in the English language. The mean (SD) DISCERN score was 23.3 (±8.3), and the mean (SD) The Patient Education Materials Assessment Tool for Audiovisual Materials Understandability and Actionability scores of 41.7% (±17.5) and 8.2% (±22.9%), respectively. Although videos were generally relevant in content to donor nephrectomy, videos lacked quality information and actionable items. Information on living donor nephrectomies is prevalent on YouTube. Our assessment using quality measures of selected videos illustrates substantial misinformation on living donor nephrectomies. YouTube has the potential to be a source of reliable and accurate information on living donor nephrectomies and donations.

Evaluation of the quality and reliability of anal cancer and its precancerous lesions-related content on YouTube: a cross-sectional study

ObjectivesThis research aims at evaluating the quality of anal cancer and its precancerous lesions-related videos on YouTube.DesignCross-sectional survey design.SettingUSA.ParticipantsThe top 150 videos on YouTube were selected for analysis based on...

Evaluating the Quality, Readability, and Activity of Online Information on Brain Arteriovenous Malformations.

Introduction Brain arteriovenous malformations (AVMs) are vascular deformities created by improper connections between arteries and veins, most commonly in the brain and spinal cord. The management is complex and patient-dependent; further understanding of patient education activities is imperative. Internet access has become more ubiquitous, allowing patients to utilize a large database of medical information online. Using Google Trends (GT) (Google LLC, Mountain View, CA, USA), one can see the public interest in a particular topic over time. Further, when presented with numerous search results, patients may not be able to identify the highest-yielding resources, making objective measures of information quality and readability imperative. Methods A GT analysis was conducted for "hereditary hemorrhagic telangiectasia," "cerebral aneurysm," and "arteriovenous malformation".These relative search volumes (RSV) were compared with the2017 to 2019 annual USA AVM diagnosis quantityfor correlation. These RSVs were also compared with the2017 to 2019 annual USA deaths due to cerebral hemorrhagic conditions.One search was conducted for "brain arteriovenous malformation". Since most users looking for health information online use only the first page of sources, the quality and readability analyses were limited to the first page of results on Google search. Five quality tools and six readability formulas were used. Results Pearson's correlation coefficients showed positive correlations between USA AVM RSVs and annual AVM deaths per capita from 2017 to 2019 (R2=0.932). The AVM annual diagnosis quantity and AVM RSVs showed a strong positive correlation as well (R2=0.998). Hereditaryhemorrhagic telangiectasiaand cerebral aneurysms had strong positive correlations between their RSVs and their corresponding annual diagnoses in the 2017 to 2019 time period (R2=0.982, R2=0.709). One-way ANOVA, for USA's 2004 to 2021 AVM RSVs and 2004 to 2019 deaths per capita, displayed no month-specific statistically significant repeating pattern (all p>0.483). The DISCERN tool had four websites that qualified as "poor" and five as "good." The average score for the tool was "good." The Journal of the American Medical Association (JAMA) benchmark scores were very low on average, as four websites achieved zero points. There was a wide variance in the currency, relevance, authority, accuracy, and purpose (CRAAP) scores, indicating an inconsistent level of webpage reliability across results. The patient education materials assessment tool (PEMAT) understandability (86.6%) showed much higher scores than the PEMAT actionability (54.6%). No readability score averaged at or below the American Medical Association (AMA)-recommended sixth-grade reading level. Conclusion These GT correlations may be due to patients and families with new diagnoses researching those same conditions online. The seasonality results reflect that no prior research has detected seasonality for AVM diagnosis or presentation. The quality study showed a wide variance in website ethics, treatment information quality, website/author qualifications, and actionable next steps regarding AVMs. Overall, this study showed that patients are routinely attempting to access information regarding these intracranial conditions, but the information available, specifically regarding AVMs, is not routinely reliable and the reading level required to understand them is too high.

Evaluating the understandability and actionability of online CKD educational materials

BackgroundPrevious studies have not fully determined whether online education materials on chronic kidney disease (CKD) for Japanese patients are easy to understand and help change their behavior. Therefore, this study quantitatively assessed the understandability and actionability of online CKD education materials.MethodsIn September 2021, we searched Google and Yahoo Japan using the keywords “kidney,” “kidney disease,” “CKD,” “chronic kidney disease,” and “renal failure” to identify 538 webpages. We used the Japanese version of the Patient Education Materials Assessment Tool (PEMAT), ranging from 0 to 100%, to evaluate the understandability and actionability of webpages. We set the cutoff point to 70%.ResultsOf the 186 materials included, the overall understandability and actionability were 61.5% (± 16.3%) and 38.7% (± 30.6%), respectively. The materials were highly technical in their terminology and lacked clear and concise charts and illustrations to encourage action. Compared to lifestyle modification materials on CKD overview, symptoms/signs, examination, and treatment scored significantly lower on the PEMAT. In addition, the materials produced by medical institutions and academic organizations scored significantly lower than those produced by for-profit companies.ConclusionMedical institutions and academic organizations are encouraged to use plain language and to attach explanations of medical terms when preparing materials for patients. They are also expected to improve visual aids to promote healthy behaviors.

O.3.2-10 My Active Ingredient: making movement more accessible for people living with chronic conditions

Abstract Purpose Physical activity can treat over 30 chronic conditions, yet four out of five Canadians are not active enough to get these benefits. Finding evidence-based physical activity guidance for specific chronic health conditions is challenging, and patients are unsure about what and how much exercise is needed. Healthcare providers can feel under-equipped to counsel on physical activity. In 2021, we created the Western Research Hub for Physical Activity and Health (the Hub), a team of 30 junior and senior scientists across seven Faculties at Western University (London, Canada) and a Community Advisory Council (CAC) made up of local organization representatives and patient partners. This collective works to lead and advocate for improved access for physical activity and its implementation. Project or policy description Through ongoing discussion and regular meetings with The Hub, we learned about the barriers and opportunities patients face when approaching physical activity, and in response collaboratively developed My Active Ingredient (myactiveingredient.org – launch date June 3/2023), a peer-to-peer healthcare hub for movement as medicine, co-designed and curated by people living with chronic conditions, healthcare providers, and researchers. From 2021-2023, we held CAC meetings and Community Workshops to review resources and provide feedback on design and functionality of the site. We gathered information through small group discussion, online surveys, and the Patient Education Materials Assessment Tool to incorporate in the development of the website. We collect and create the best physical activity resources to help make movement more accessible for people living with chronic conditions, and support healthcare providers advising their patients. Our team updates the website on an ongoing basis with new research, resources, and programs related to physical activity identified by website users, the CAC, and/or researchers. The website will undergo a quarterly, two-part evaluation that focuses on website analytics (e.g., page views, sessions, traffic sources etc.) and usability (e.g., test with target representative users). Conclusions My Active Ingredient will increase the accessibility and quality of physical activity advice and resources for individuals living with chronic conditions or other barriers to physical activity, and become the “go-to” source for evidence-based guidance for patients, caregivers, and health providers.

TikTok and YouTube Videos on Overactive Bladder Exhibit Poor Quality and Diversity.

We sought to assess the quality, understandability, actionability, and diversity of speakers in videos on TikTok and YouTube regarding overactive bladder. Using Application Program Interface, the top 500 TikTok and 120 YouTube videos on overactive bladder were retrieved. Videos unrelated to overactive bladder, those not in English, longer than 10 minutes, or lacking both text and audio were excluded. Surgical technique videos for providers were also excluded. Videos were scored by trained raters using 2 validated instruments: PEMAT (Agency for Healthcare Research and Quality's Patient Education Materials Assessment Tool) for actionability and understandability, and the DISCERN instrument for quality of consumer health information. We also examined for evidence of misinformation and commercial bias. One hundred thirty-six TikTok videos and 75 YouTube videos met inclusion criteria. Eighty-eight percent of TikTok videos had poor PEMAT actionability scores (a score below 75%), as compared to 60% of YouTube videos. Both YouTube and TikTok videos scored low on PEMAT understandability. Ninety-eight percent of TikTok videos and 65% of YouTube videos were poor quality (DISCERN score <3). YouTube videos had higher actionability and quality than TikTok videos (P < .001) but did not differ on understandability (P = .769). Twenty-three percent of TikTok and 11% of YouTube videos had high misinformation (score >3). Commercial bias was present in 10% of TikTok and 19% of YouTube videos. Actionability, understandability, and quality for overactive bladder-related content is poor on YouTube and TikTok. With increasing access to social media, it is important that health care providers and organizations invest resources in patient education on health literacy.

Appraising publicly available online resources to support patients considering decisions about medical assistance in dying in Canada: an environmental scan.

Medical assistance in dying (MAiD) was legalized in Canada in 2016, with legislation updated in 2021. It is unclear whether resources are available to help patients make this difficult decision; therefore, we sought to identify and quality appraise Canadian MAiD resources for supporting patients making this decision. We conducted an environmental scan by searching Canadian websites for online MAiD resources that were published after the 2016 MAiD legislation, patient targeted, publicly accessible and able to inform decisions about MAiD in Canada. We excluded resources that targeted health care professionals or policy-makers, service protocols and personal narratives. Two authors appraised resources using the International Patient Decision Aids Standards (IPDAS) criteria and the Patient Education Materials Assessment Tool (PEMAT) for health literacy. Descriptive analysis was conducted. We defined resources as patient decision aids if 7 IPDAS defining criteria were met, and we rated resources as adequate for understandability or actionability if the PEMAT score was 70% or greater. We identified 80 MAiD resources. As of March 2023, 62 resources (90%) provided eligibility according to the 2021 legislation and 11 did not discuss any eligibility criteria. The median IPDAS score was 3 out of 7; 52% discussed alternative options and none provided benefits or harms. Of 80 resources, 59% were adequate for understandability and 29% were adequate for actionability. Although many resources on MAiD were updated with 2021 legislation, few were adequate to support patients with lower health literacy. There is a need to determine whether a patient decision aid would be appropriate for people in Canada considering MAiD.

Development and validation of educational multimedia to promote public health literacy about healthy cognitive aging.

Health literacy (HL) about healthy cognitive aging is essential in preventing cognitive decline and promoting cognitive well-being. It is important that one such HL module should be scientifically designed, delivered in a technically sound manner to the audience, and specific to the context. The present study thus aimed at developing and validating educational multimedia about cognitive health. The study followed a methodological framework and was carried out across three phases, that is, identification of themes, development and validation of educational script and design, and validation of educational multimedia. The module was scripted based on the Integrated HL framework and the recommendations made during the modified nominal group technique among the research team. Seven speech-language pathologists (SLPs), with expertise in the field of cognitive sciences, and 15 representatives of the general public validated the module using the Educational Content Validation Instrument in Health and the Patient Education Materials Assessment Tool for Audiovisual Materials questionnaire. The scientific content of the educational script received satisfactory agreements among the experts (content validity index [CVI]: 0.93) and representatives of the general public (CVI: 0.86). The technical aspects of the educational multimedia were rated to have high understandability (experts: 92.8%; representatives of general public: 98.8%) and actionability (experts and representatives of general public 100%). Overall, the developed educational multimedia scored optimally with respect to the objective, structure, relevance of the content, actionability and understandability of the multimedia. The developed module holds the potential to be used at community and national level health educational programs or awareness campaigns to enhance public knowledge and beliefs pertaining to cognitive health. SLPs with expertise in the field of cognitive science and representatives from the general public were included to validate and obtain feedback on the developed educational multimedia.

BPPV Information on Google VersusAI (ChatGPT).

To quantitatively compare online patient education materials found using traditional search engines (Google) versus conversational Artificial Intelligence (AI) models (ChatGPT) for benign paroxysmal positional vertigo (BPPV). The top 30 Google search results for "benign paroxysmal positional vertigo" were compared to the OpenAI conversational AI language model, ChatGPT, responses for 5 common patient questions posed about BPPV in February 2023. Metrics included readability, quality, understandability, and actionability. Online information. Validated online information metrics including Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease (FRE), DISCERN instrument score, and Patient Education Materials Assessment Tool for Printed Materials were analyzed and scored by reviewers. Mean readability scores, FKGL and FRE, for the Google webpages were 10.7 ± 2.6 and 46.5 ± 14.3, respectively. ChatGPT responses had a higher FKGL score of 13.9 ± 2.5 (P < .001) and a lower FRE score of 34.9 ± 11.2 (P = .005), both corresponding to lower readability. The Google webpages had a DISCERN part 2 score of 25.4 ± 7.5 compared to the individual ChatGPT responses with a score of 17.5 ± 3.9 (P = .001), and the combined ChatGPT responses with a score of 25.0 ± 0.9 (P = .928). The average scores of the reviewers for all ChatGPT responses for accuracy were 4.19 ± 0.82 and 4.31 ± 0.67 for currency. The results of this study suggest that the information on ChatGPT is more difficult to read, of lower quality, and more difficult to comprehend compared to information on Google searches.

Evaluating the understandability and actionability of online educational videos on pre-dialysis chronic kidney disease.

It remains undetermined whether online education videos for Japanese patients with chronic kidney disease (CKD) are easy to understand and allow adoption of behavioural changes. This study quantitatively assessed the understandability and applicability of online education videos for patients with CKD. In September 2021, we identified 200 videos on YouTube using the Japanese translations of the keywords 'kidney,' 'kidney disease,' 'CKD,' and 'chronic kidney disease.' We used the Japanese version of the Patient Education Materials Assessment Tool to evaluate the understandability and usability of webpages on a scale of 0% to 100%. The cut-off was set at 70%. A total of 54 videos were evaluated. The overall understandability and actionability of the materials were 57.6 (SD = 22.6) and 53.7 (SD = 33.4), respectively. Approximately 70% and 60% of the materials were considered insufficiently understandable and actionable, respectively. Most videos lacked a summary and had difficulty in using only everyday language. Most videos included at least one action for the audience to take. However, many failed to break down the action into sequential steps. They also lack visual aids to encourage the audience to take action. Our results suggest that current information on pre-dialysis chronic kidney disease was not presented in a manner that can be applied by laypeople.

A content analysis of online videos containing dietary recommendations for gout and their alignment with evidence-based dietary guidelines.

To assess the alignment of YouTube® videos providing dietary recommendations for gout with evidence-based guidelines targeted at the United Kingdom (UK) population and to establish their quality. A content analysis of YouTube® videos providing dietary recommendations for gout was undertaken. Videos were categorised by video source. Each video's dietary recommendations for gout were compared with three evidence-based guidelines for gout, producing a compliance score. Presence of non-guideline advice was assessed. Understandability and actionability were evaluated using the Patient Education Material Assessment Tool for Audio-Visual Materials. Reliability was assessed using an adapted-DISCERN tool and educational quality using the Global Quality Score Five-Point Scale. Differences between video source and continuous variables were assessed using one-way Kruskal-Wallis H tests. For categorical variables, associations were investigated using Fisher-Freeman-Halton tests. Online, May-June 2020. One-hundred thirty-one videos. Alignment of videos with evidence-based guidelines was poor (median compliance score 27 % (interquartile range 17-37 %)). Additionally, 57 % of videos contained non-guideline advice. The health professional source group had the fewest videos containing non-guideline advice, but this was only significantly lower than the naturopath group (31 % v. 81 %, P = 0·009). Almost 70 % of videos were considered poorly actionable and 50 % poorly understandable. Most videos were rated poor for reliability (79 %) and poor to generally poor for educational quality (49 %). YouTube® videos providing dietary recommendations for gout frequently fail to conform to evidence-based guidelines, and their educational quality, reliability, understandability and actionability are often poor. More high-quality, comprehensive, evidence-based YouTube® videos are required for UK gout patients.

How Well Do Artificial Intelligence Chatbots Respond to the Top Search Queries About Urological Malignancies?

Artificial intelligence (AI) chatbots are becoming a popular source of information but there are limited data on the quality of information on urological malignancies that they provide. Our objective was to characterize the quality of information and detect misinformation about prostate, bladder, kidney, and testicular cancers from four AI chatbots: ChatGPT, Perplexity, Chat Sonic, and Microsoft Bing AI. We used the top five search queries related to prostate, bladder, kidney, and testicular cancers according to Google Trends from January 2021 to January 2023 and input them into the AI chatbots. Responses were evaluated for quality, understandability, actionability, misinformation, and readability using published instruments. AI chatbot responses had moderate to high information quality (median DISCERN score 4 out of 5, range 2–5) and lacked misinformation. Understandability was moderate (median Patient Education Material Assessment Tool for Printable Materials [PEMAT-P] understandability 66.7%, range 44.4–90.9%) and actionability was moderate to poor (median PEMAT-P actionability 40%, range 0–40%The responses were written at a fairly difficult reading level. AI chatbots produce information that is generally accurate and of moderate to high quality in response to the top urological malignancy–related search queries, but the responses lack clear, actionable instructions and exceed the reading level recommended for consumer health information. Patient summaryArtificial intelligence chatbots produce information that is generally accurate and of moderately high quality in response to popular Google searches about urological cancers. However, their responses are fairly difficult to read, are moderately hard to understand, and lack clear instructions for users to act on.

Head-to-Head Comparison of ChatGPT Versus Google Search for Medical Knowledge Acquisition.

Chat Generative Pretrained Transformer (ChatGPT) is the newest iteration of OpenAI's generative artificial intelligence (AI) with the potential to influence many facets of life, including health care. This study sought to assess ChatGPT's capabilities as a source of medical knowledge, using Google Search as a comparison. Cross-sectional analysis. Online using ChatGPT, Google Seach, and Clinical Practice Guidelines (CPG). CPG Plain Language Summaries for 6 conditions were obtained. Questions relevant to specific conditions were developed and input into ChatGPT and Google Search. All questions were written from the patient perspective and sought (1) general medical knowledge or (2) medical recommendations, with varying levels of acuity (urgent or emergent vs routine clinical scenarios). Two blinded reviewers scored all passages and compared results from ChatGPT and Google Search, using the Patient Education Material Assessment Tool (PEMAT-P) as the primary outcome. Additional customized questions were developed that assessed the medical content of the passages. The overall average PEMAT-P score for medical advice was 68.2% (standard deviation [SD]: 4.4) for ChatGPT and 89.4% (SD: 5.9) for Google Search (p < .001). There was a statistically significant difference in the PEMAT-P score by source (p < .001) but not by urgency of the clinical situation (p = .613). ChatGPT scored significantly higher than Google Search (87% vs 78%, p = .012) for patient education questions. ChatGPT fared better than Google Search when offering general medical knowledge, but it scored worse when providing medical recommendations. Health care providers should strive to understand the potential benefits and ramifications of generative AI to guide patients appropriately.

Participatory design of an infographic to help support the care of people living with complex regional pain syndrome

Background Complex regional pain syndrome (CRPS) can be a debilitating pain condition with enduring physical, psychological and social impacts. CRPS is often poorly understood by healthcare professionals and management needs to be tailored to each individual’s presentation. People with lived experience express difficulty in accessing reliable and meaningful information about the condition. This study aimed to co-create a trustworthy infographic to share information about the lived experience of CRPS. Methods We adopted a seven-phase, iterative, participatory methodology to co-create the infographic. Potential infographic content was obtained from qualitative work investigating the lived experience of CRPS. Online consumer engagement (people with doctor diagnosed CRPS/their family, n=20) was used to prioritise content to be included in the infographic and then potential designs were sourced. The research team narrowed the selections down to two designs which were presented to consumers online for final selection ( n=25) and refinement ( n=34). Results An infographic for understanding the lived experience of CRPS was completed using participatory design, providing a resource aligned to the needs of people with this condition. Using the Patient Education Materials Assessment Tool, the final infographic rated highly for understandability (92%) and participants indicated significant willingness to share this infographic with others (93%). Conclusion A process of participatory design was an effective and efficient process for translation of evidence gathered from qualitative research into a trustworthy resource for people with CRPS and their support people.

An Analysis of Pediatric Ophthalmology Content on TikTok.

To assess pediatric ophthalmology-related information on TikTok (ByteDance). The 12 most commonly searched terms from the American Association for Pediatric Ophthalmology and Strabismus website were queried as TikTok hashtags. The top 20 videos for each hashtag were analyzed for views, likes, comments, saves, shares, author status and gender, content, and engagement level ratio (ELR). Subanalysis of the educational videos for quality, understandability and actionability, and medical accuracy using the modified DISCERN (mDISCERN), Patient Education Materials Assessment Tool (PEMAT), and modified Medical Information and Content Index (mMICI) was performed. Analysis of 222 videos revealed a cumulative 191,337,973 views. Patients/families created the most videos (60.4%), followed by optometrists (14.4%), other (laypeople/unknown) (9.0%), ophthalmologists (7.7%), non-ophthalmology physicians (4.5%), and nurses (4.1%). Content was predominantly patient experience (56.8%), followed by educational (25.2%), humor (11.7%), self-promotional (3.6%), procedures (0.9%), other (0.9%), advertisements (0.5%), and career (0.5%). Educational videos had a lower ELR than humorous (3.3 vs 8.2, P < .001) and patient experience (3.3 vs 5.3, P < .001) videos, but more saves than patient experience videos (74 vs 25, P = .009). The mDISCERN scores were greater for videos authored by ophthalmologists (3, P < .001) and optometrists (2.5, P < .001) compared to lay-people (1.5). Ophthalmologist PEMAT understandability scores were greater than non-ophthalmology providers' (95.5% vs 67.4%, P = .002). There was no difference in PEMAT actionability (P = .743) or mMICI scores among the author subgroups (P = .206). Pediatric ophthalmology content on Tik-Tok ranges in quality and understandability. Additional research is needed to help promote posts created by eyecare providers to ensure evidence-based medical content reaches pediatric patients and their families. [J Pediatr Ophthalmol Strabismus. 2024;61(2):90-97.].

Prostate cancer and podcasts: an analysis and assessment of the quality of information about prostate cancer available on podcasts.

Podcasts represent a new source of information for patients and families dealing with prostate cancer, but no studies have been conducted evaluating the quality of information in them. Evaluating for: (1) quality based on the validated DISCERN criteria, (2) understandability and actionability based on the Patient Education Materials Assessment Tool (PEMAT), (3) misinformation, and (4) commercial bias, we concluded that podcasts are currently not good sources of information for lay health consumers.

Health literacy in rotator cuff repair: a quantitative assessment of the understandability of online patient education material

The American Medical Association and National Institutes of Health recommend online health information be written at a 6th grade or lower reading level for clear understanding. While syntax reading grade level has previously been utilized, those analyses do not determine whether readers are processing key information (understandability) or identifying available actions to take (actionability). The Patient Education Materials Assessment Tool (PEMAT-P) is a method to measure the understandability and actionability of online patient education materials. The purpose of this study was to evaluate online resources regarding rotator cuff repair utilizing measures of readability, understandability, and actionability. The search term "rotator cuff surgery" was used in two independent online searches to obtain the top 50 search results. The readability of included resources was quantified using valid objective algorithms: Flesch-Kincaid Grade-Level, Simple Measure of Gobbledygook grade, Coleman-Liau Index, and Gunning Fog Index. The PEMAT-P form was used to assess actionability and understandability. A total of 49 unique websites were identified to meet our inclusion criteria and were included in our analysis. The mean Flesch-Kincaid Grade Level graded materials at a 10.6 (approximately a 10th grade reading level), with only two websites offering materials at a 6th grade reading level or below. The remaining readability studies graded the mean reading level at high school or greater, with the Gunning Fog Index scoring at a collegiate reading level. Mean understandability and actionability scores were 64.6% and 29.5%, respectively, falling below the 70% PEMAT score threshold for both scales. Fourteen (28.6%) websites were above the threshold for understandability, while no website (0%) scored above the 70% threshold for actionability. When comparing source categories, commercial health publishers provided websites that scored higher in understandability (P<.05), while private practice materials scored higher in actionability (P<.05). Resources published by academic institutions or organizations scored lower in both understandability and actionability than private practice and commercial health publishers (P<.05). No readability, understandability, or actionability score was significantly associated with search result rank. Overall, online patient education materials related to rotator cuff surgery scored poorly with respect to readability, understandability, and actionability. Only two (4.1%) of the patient education websites scored at the American Medical Association and National Institutes of Health recommended reading level. Fourteen (28.6%) scored above the 70% PEMAT score for understandability; however, no website met the threshold for actionability.

'How to stop a nosebleed': a combined objective and subjective assessment of YouTube videos on first-aid management of epistaxis.

A previous study in 2016 found that the quality of YouTube videos on epistaxis first-aid management was highly variable. This study aimed to reassess the accuracy and patient understandability of such YouTube videos. YouTube was searched using the phrase 'How to stop a nosebleed'. The highest 50 ranking videos, based on relevance, were screened. Each video was assessed objectively using a standardised 'advice score', and subjectively using a video understandability and actionability checklist, the Patient Education Materials Assessment Tool for Audiovisual Materials ('PEMAT-A/V'). The mean advice score was 4.1 out of 8. The mean (standard deviation) understandability and actionability scores were 76 per cent (17 per cent) and 89 per cent (18 per cent), respectively. There was a strong positive correlation between the actionability scores and the advice scores (ρ = 0.634; p < 0.001), and between the actionability scores and the understandability scores (ρ = 0.519; p = 0.002). YouTube videos are providing increasingly relevant advice for patients seeking healthcare information. YouTube is proposed as a useful medium for teaching epistaxis management to patients and community practitioners.

How Good Is Online Information for Patients on the Treatment for Luminal Gastrointestinal Cancers? A Comprehensive Evaluation in English and Spanish.

The internet has become a necessary communication platform for health information. The quality of online material for patients varies significantly, and this is not different for material on gastrointestinal cancers. We aimed to assess English and Spanish online patient information addressing esophageal, gastric, and colorectal cancer treatment. Six independent Google searches were conducted using the terms: esophageal cancer treatment, gastric cancer treatment, colorectal cancer treatment, and their translations in Spanish. Websites were included in the top 50 results for each search. Readability was assessed using two validated tests for each language. Understandability/actionability, quality, and cultural sensitivity were assessed using Patient Education Materials Assessment Tool (PEMAT), DISCERN, and Cultural Sensitivity Assessment Tool (CSAT), respectively. Pearson's chi-squared was used for categorical variables and Wilcoxon rank-sum (2 groups) or Kruskal-Wallis (> 2 groups) for continuous. One hundred twelve websites were analyzed. Readability levels were high in both languages (between 11th grade and university level) and significantly higher in English. Mean quality scores for English and Spanish were consistent with good quality. CSAT scores met the cultural acceptability with lower CSAT scores for gastric cancer treatment in English. Higher actionability scores were found in English for colorectal cancer. Also, there was a clear trend for higher cultural sensitivity and quality of Spanish material for gastric cancer treatment. Online patient information on esophageal, gastric, and colorectal cancer treatment, in English and Spanish, were at a readability level above the average literacy level and even significantly higher in English. Initiatives to improve online information on gastrointestinal cancer treatments are warranted.