Flesch Reading Ease Score Research Articles

Thyroid Ethanol and Radiofrequency Ablation: A Call for Patient-Friendly Online Resources

Introduction: The multiple treatment options available to patients with thyroid nodules can generate uncertainty and confusion. Radiofrequency ablation (RFA) and ethanol ablation (EA) are two alternative modalities to manage thyroid nodules. As patients more frequently utilize online resources to guide their decision-making, the quality of such resources must be evaluated. The goal of this study was to assess the quality of online patient materials relating to RFA and EA compared to standard thyroidectomy. Methods: The terms “thyroidectomy,” “thyroid radiofrequency ablation,” and “thyroid ethanol ablation” were searched on Google. Flesch Reading Ease (FRE), Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Patient Education Materials Assessment Tool (PEMAT) understandability and actionability were calculated for each website. Statistical analysis was conducted on SPSS Statistics. Google trends were used to determine search interest for each term (May 2016 – May 2021). Results: Of the 77 websites that met our inclusion criteria (30 thyroidectomy sites, 30 RFA sites, and 17 EA sites), the average FRE, FKGL, and SMOG scores of the RFA websites were significantly worse than those of the thyroidectomy websites (p < 0.05). The FKGL and SMOG scores of the EA websites were significantly worse than those of the thyroidectomy websites (p < 0.05). The average understandability and actionability scores for thyroidectomy websites were significantly higher than those of RFA and EA websites (p < 0.05). Conclusion: Ablation websites have lower search interest, readability, validity, understandability, and actionability scores in comparison to traditional thyroidectomy websites. Our findings emphasize the need to consider readability and PEMAT scores when developing online educational resources for ablative alternatives to thyroidectomy to allow for greater patient accessibility.

Evaluating the readability, quality and reliability of online patient education materials on chronic low back pain.

Background There are concerns over the reliability and comprehensibility of health-related information on the internet. We analyzed the readability, reliability and quality of online patient education materials obtained from websites associated with chronic low back pain (cLBP). Methods On 26 April 2022, the term 'cLBP' was used to perform a search on Google, and 95 eligible websites were identified. The Flesch Reading Ease Score (FRES) and Gunning Fog (GFOG) index were used to evaluate the readability. The Journal of the American Medical Association (JAMA) score was used to assess the reliability and the Health on the Net Foundation code of conduct (HONcode) was used to assess quality. Results The mean (SD) FRES was 55.74 (13.57) (very difficult) and the mean (SD) GFOG was 12.76 (2.8) (very difficult) of the websites reviwed. According to the JAMA scores, 28.4% of the websites had a high reliability rating and 33.7% adhered to the HONcode. Websites of different typologies were found to significantly differ in their reliability and the quality scores (p<0.05). Conclusion The reading ability required for cLBP-related information on the internet was found to be considerably higher than that recommended by the National Health Institute and had low reliability and poor quality. We believe that online information should have readability appropriate for most readers and must have reliable content that is appropriate to educate the public, particularly for websites that provide patient education material.

Study to evaluate the readability and visual appearance of online resources for blunt chest trauma: an evaluation of online resources using mixed methods

ObjectivesBlunt chest trauma (BCT) is characterised by forceful and non-penetrative impact to the chest region. Increased access to the internet has led to online healthcare resources becoming used by the...

Ostomy Information on the Internet-Is It Good Enough?

The aim of this study was to determine which internet search engines and keywords patients with ostomies utilize, to identify the common websites using these terms, to determine what aspects of information they wanted, and to perform a quality and readability assessment for these websites. A cross-sectional survey of persons with ostomies to identify search engines and terms, followed by a structured assessment of the quality and readability of the identified web pages. The sample comprised 20 hospitalized patients with ostomies cared for on a colorectal surgical ward of a tertiary care hospital located in Melbourne, Australia. There were 15 (75%) adult males and 5 (25%) adult females; their mean age was 52.2years. Participants were surveyed between August and December 2020. Patients with newly formed ostomies were surveyed about which search engines and keywords they would use to look for information and for which questions regarding ostomies they wanted answers. In addition, 2 researchers then performed independent searches using the search terms identified by patient participants. These searches were conducted in August 2021, with the geographical location set to Australia. The quality of the websites was graded using the DISCERN, Ensuring Quality Information for Patients, and Quality Evaluation Scoring Tool scoring assessments, and their readability was graded using the Flesch Reading Ease Score tool. Participants used Google as their primary search engine. Four keywords/phrases were identified: stoma for bowel surgery, ileostomy, colostomy, and caring for stoma. Multiple web pages were identified, 8 (21%) originated from Australia, 7 (18%) were from the United Kingdom, and 23 (61%) were from the United States. Most web pages lacked recent updates; only 18% had been undated within the last 12months. The overall quality of the online information on ostomies was moderate with an average level of readability, deemed suitable for patient educational purposes. Information for persons living with an ostomy can be obtained from multiple web pages, and many sites have reasonable quality and are written at a suitable level. Unfortunately, these websites are rarely up-to-date and may contain advice that may not be applicable to individual patients.

Evaluating Quality, Credibility, and Readability of Online Over-the-Counter Hearing Aid Information.

With over-the-counter hearing aids being recently approved by the United States Food and Drug Administration, the accuracy and usefulness of online information has not yet been examined. This study evaluates the quality, credibility, readability, and accessibility of online over-the-counter hearing aids education materials. Google was queried using the search term "over-the-counter hearing aids". The top 50 results were categorized into healthcare versus non-healthcare authored resources. The Flesch Reading Ease Score (FRES) and Flesch-Kincaid Grade Level (FKGL) tests were utilized to assess readability, whereas the Currency, Relevance, Authority, Accuracy, and Purpose (CRAAP) test and DISCERN instruments were used to assess quality and credibility. The number of clicks taken to access relevant information on each website was used to assess accessibility. There was no significant difference in FRES or FKGL readability scores between healthcare and non-healthcare authored websites (p = 0.5548, p = 0.5981, respectively), but both readability scores were higher than that of the recommended reading level for patient education materials. There was no significant difference in CRAAP and DISCERN scores between both groups (p = 0.5746, p = 0.1699, respectively). The number of clicks did not significantly differ between healthcare and non-healthcare authored resources (p = 0.4932). This study highlights poor readability and accessibility of virtual healthcare information regarding OTC hearing aids. Although credibility in articles authored by healthcare and non-healthcare professionals was adequate, readability was greatly compromised due to the written information exceeding the recommended United States reading level. Accessibility posed a similar issue, as many sites required multiple clicks to access product information. NA Laryngoscope, 134:3302-3309, 2024.

Assessment of the Readability and Quality of Online Information for Patients and Their Families Regarding Schizophrenia.

To our knowledge, this is the first study that specifically aims to assess the readability and quality of online information about schizophrenia. The analysis is performed on 93 of 195 websites that appeared in an advanced Google search of the term "schizophrenia" performed on a single day. The websites were categorized as commercial, nonprofit, professional, and government. The websites were evaluated using the Health on the Net Foundation (HON) code certificate, DISCERN tool, and Journal of the American Medical Association ( JAMA ) benchmark criteria for quality and the Flesch Reading Ease Formula, Flesch-Kincaid Grade Level (FKGL) Formula, Simple Measure of Gobbledygook, and Gunning Fog indices for readability. A total of 21.5% of all websites had a HON code certificate, 50.5% were accepted as high quality ( JAMA score ≥3), and 25.8% reached the recommended readability level (FKGL ≤8). Only three websites scored at a fifth- to sixth-grade reading level. Commercial and government websites had significantly lower DISCERN scores. Commercial websites had significantly lower Flesch Reading Ease Score and FKGL score than nonprofit websites. In conclusion, the current findings indicate that the quality of online information on schizophrenia is generally acceptable, but the readability is insufficient. Website creators, physicians, and health authorities should be more sensitive to the readability of online information about schizophrenia, considering the poor cognitive capacity of the patients and the unique nature of the disease.

Literacy-related factors and knowledge of patient rights charter: evidence from nurses in selected hospitals in Ghana.

Systems of across the world have developed and implemented patient rights policies to protect and improve the provider-patient relationship. The Patient Charter of Ghana was developed in 2002 to improve service quality and protect patients' rights. However, it is not yet known whether those at the frontline of healthcare delivery can read and understand the contents of the charter. While studies have explored the socioeconomic and institutional level factors related to awareness and knowledge of the Patient Rights Charter, there is a lack of literature on its readability and comprehensibility among nurses. This study assesses nurses' knowledge of the Patient Rights Charter and associated literacy-related factors. An exploratory cross-sectional design and quantitative methods were used to collect data on knowledge, comprehension, and readability of the Patient Rights Charter. 205 nurses from four district hospitals in the Central Region were recruited using proportional and total enumeration sampling. Data were collected using structured questionnaires and were processed using SPSS (version 26) and an online text readability consensus calculator (version 2.0). Descriptive and inferential statistical analyses were performed, and data were presented using simple frequencies, readability statistics, and regression output. The results show the charter is written at a higher reading grade level; Flesch-Kincaid Grade Level (13.36), Simple Measure of Gobbledygook (11.57), and Coleman-Liau Readability Index (14.2). The average reading grade level score was 14. The Gunning Fox Index (15.40) and the Flesch Reading Ease Score (34%) show the patient charter is difficult to read and will require at least 14 years of education to be able to read. 87.3% of nurses were able to read and comprehend the charter. Very few (8.3%) read at frustration level. Nurses' actual comprehension of the charter was the only significant predictor of knowledge of the charter. Comprehension of the patient charter is an important predictor of its knowledge. The results emphasize the need to enhance the readability and comprehensibility of the charter for providers. Hospitals can stimulate nurses' knowledge of the charter by simplifying the charter's language and deliberately educating nurses on its content.

Assessment of Quality and Readability of Information Provided by ChatGPT in Relation to Anterior Cruciate Ligament Injury.

The aim of our study was to evaluate the potential role of Artificial Intelligence tools like ChatGPT in patient education. To do this, we assessed both the quality and readability of information provided by ChatGPT 3.5 and 4 in relation to Anterior Cruciate Ligament (ACL) injury and treatment. ChatGPT 3.5 and 4 were used to answer common patient queries relating to ACL injuries and treatment. The quality of the information was assessed using the DISCERN criteria. Readability was assessed with the use of seven readability formulae: the Flesch-Kincaid Reading Grade Level, the Flesch Reading Ease Score, the Raygor Estimate, the SMOG, the Fry, the FORCAST, and the Gunning Fog. The mean reading grade level (RGL) was compared with the recommended 8th-grade reading level, the mean RGL among adults in America. The perceived quality and mean RGL of answers given by both ChatGPT 3.5 and 4 was also compared. Both ChatGPT 3.5 and 4 yielded DISCERN scores suggesting "good" quality of information, with ChatGPT 4 slightly outperforming 3.5. However, readability levels for both versions significantly exceeded the average 8th-grade reading level for American patients. ChatGPT 3.5 had a mean RGL of 18.08, while the mean RGL of ChatGPT 4 was 17.9, exceeding the average American reading grade level by 10.08 grade levels and 9.09 grade levels, respectively. While ChatGPT can provide both reliable and good quality information on ACL injuries and treatment options, the readability of the content may limit its utility. Additionally, the consistent lack of source citation represents a significant area of concern for patients and clinicians alike. If AI is to play a role in patient education, it must reliably produce information which is accurate, easily comprehensible, and clearly sourced.

Improving health literacy of passengers of cruise ships: readability of passenger-facing COVID-19 information provided by commercial cruise lines-an infodemiology study.

Readability of COVID-19 information from 35 cruise lines was examined. Mean Flesch Reading Ease and Flesch-Kincaid Grade Level scores (±standard error of mean) were 46.6 ± 1.3 (target ≥60) and 10.9 ± 0.3 (target ≤ 8.0), respectively. Two (6%) cruise lines met readability reference targets. Readability tools may aid in preparing more easily read passenger-facing health-related information on existing infections, including COVID-19, other respiratory infections, as well as gastroenteritis (e.g. norovirus), as well as providing a methodology for improving the readability of information prepared for newly emerging infectious diseases.

Comprehensiveness, Accuracy, and Readability of Exercise Recommendations Provided by an AI-Based Chatbot: Mixed Methods Study.

Regular physical activity is critical for health and disease prevention. Yet, health care providers and patients face barriers to implement evidence-based lifestyle recommendations. The potential to augment care with the increased availability of artificial intelligence (AI) technologies is limitless; however, the suitability of AI-generated exercise recommendations has yet to be explored. The purpose of this study was to assess the comprehensiveness, accuracy, and readability of individualized exercise recommendations generated by a novel AI chatbot. A coding scheme was developed to score AI-generated exercise recommendations across ten categories informed by gold-standard exercise recommendations, including (1) health condition-specific benefits of exercise, (2) exercise preparticipation health screening, (3) frequency, (4) intensity, (5) time, (6) type, (7) volume, (8) progression, (9) special considerations, and (10) references to the primary literature. The AI chatbot was prompted to provide individualized exercise recommendations for 26 clinical populations using an open-source application programming interface. Two independent reviewers coded AI-generated content for each category and calculated comprehensiveness (%) and factual accuracy (%) on a scale of 0%-100%. Readability was assessed using the Flesch-Kincaid formula. Qualitative analysis identified and categorized themes from AI-generated output. AI-generated exercise recommendations were 41.2% (107/260) comprehensive and 90.7% (146/161) accurate, with the majority (8/15, 53%) of inaccuracy related to the need for exercise preparticipation medical clearance. Average readability level of AI-generated exercise recommendations was at the college level (mean 13.7, SD 1.7), with an average Flesch reading ease score of 31.1 (SD 7.7). Several recurring themes and observations of AI-generated output included concern for liability and safety, preference for aerobic exercise, and potential bias and direct discrimination against certain age-based populations and individuals with disabilities. There were notable gaps in the comprehensiveness, accuracy, and readability of AI-generated exercise recommendations. Exercise and health care professionals should be aware of these limitations when using and endorsing AI-based technologies as a tool to support lifestyle change involving exercise.

Evaluating the Efficacy of ChatGPT as a Patient Education Tool in Prostate Cancer: Multimetric Assessment.

Artificial intelligence (AI) chatbots, such as ChatGPT, have made significant progress. These chatbots, particularly popular among health care professionals and patients, are transforming patient education and disease experience with personalized information. Accurate, timely patient education is crucial for informed decision-making, especially regarding prostate-specific antigen screening and treatment options. However, the accuracy and reliability of AI chatbots' medical information must be rigorously evaluated. Studies testing ChatGPT's knowledge of prostate cancer are emerging, but there is a need for ongoing evaluation to ensure the quality and safety of information provided to patients. This study aims to evaluate the quality, accuracy, and readability of ChatGPT-4's responses to common prostate cancer questions posed by patients. Overall, 8 questions were formulated with an inductive approach based on information topics in peer-reviewed literature and Google Trends data. Adapted versions of the Patient Education Materials Assessment Tool for AI (PEMAT-AI), Global Quality Score, and DISCERN-AI tools were used by 4 independent reviewers to assess the quality of the AI responses. The 8 AI outputs were judged by 7 expert urologists, using an assessment framework developed to assess accuracy, safety, appropriateness, actionability, and effectiveness. The AI responses' readability was assessed using established algorithms (Flesch Reading Ease score, Gunning Fog Index, Flesch-Kincaid Grade Level, The Coleman-Liau Index, and Simple Measure of Gobbledygook [SMOG] Index). A brief tool (Reference Assessment AI [REF-AI]) was developed to analyze the references provided by AI outputs, assessing for reference hallucination, relevance, and quality of references. The PEMAT-AI understandability score was very good (mean 79.44%, SD 10.44%), the DISCERN-AI rating was scored as "good" quality (mean 13.88, SD 0.93), and the Global Quality Score was high (mean 4.46/5, SD 0.50). Natural Language Assessment Tool for AI had pooled mean accuracy of 3.96 (SD 0.91), safety of 4.32 (SD 0.86), appropriateness of 4.45 (SD 0.81), actionability of 4.05 (SD 1.15), and effectiveness of 4.09 (SD 0.98). The readability algorithm consensus was "difficult to read" (Flesch Reading Ease score mean 45.97, SD 8.69; Gunning Fog Index mean 14.55, SD 4.79), averaging an 11th-grade reading level, equivalent to 15- to 17-year-olds (Flesch-Kincaid Grade Level mean 12.12, SD 4.34; The Coleman-Liau Index mean 12.75, SD 1.98; SMOG Index mean 11.06, SD 3.20). REF-AI identified 2 reference hallucinations, while the majority (28/30, 93%) of references appropriately supplemented the text. Most references (26/30, 86%) were from reputable government organizations, while a handful were direct citations from scientific literature. Our analysis found that ChatGPT-4 provides generally good responses to common prostate cancer queries, making it a potentially valuable tool for patient education in prostate cancer care. Objective quality assessment tools indicated that the natural language processing outputs were generally reliable and appropriate, but there is room for improvement.

Development and Preliminary Validation of an Equine Brief Pain Inventory for Owner Assessment of Chronic Pain Due to Osteoarthritis in Horses.

An owner-completed questionnaire was designed to monitor the level of chronic pain and impact on quality of life in horses with osteoarthritis (OA). A standardized approach to develop and validate subjective-state scales for clinical use was followed. Scale items were generated through literature review, focus group meetings, and expert panel evaluation. The draft tool was tested for reading level and language ambiguity and piloted in 25 owners/caregivers of horses with osteoarthritis, with factor analysis performed on responses. The resulting revised questionnaire is currently undergoing validation in a larger sample population of 60 OA and 20 sound control horses. In the pilot group, 21 people (84%) found the questionnaire easy to complete and 22 people (88%) found it useful. It could be completed within 5 min by all participants. Readability scores (Flesch Reading Ease Score, Flesch-Kincaid grade level, SMOG index) indicated an English language reading level comparable to that of 6th to 7th grade in the U.S. system (age 11-12 years). Cronbach's alpha of all items in the tool was 0.957, indicating excellent inter-item correlation. Interim analysis for 23 OA horses from the sample population showed good test-retest reliability and higher scores compared to 5 control horses. Full validation must be completed for the instrument to be used in clinical practice.

Evaluation of the reliability and readability of ChatGPT-4 responses regarding hypothyroidism during pregnancy

Hypothyroidism is characterized by thyroid hormone deficiency and has adverse effects on both pregnancy and fetal health. Chat Generative Pre-trained Transformer (ChatGPT) is a large language model trained with a very large database from many sources. Our study was aimed to evaluate the reliability and readability of ChatGPT-4 answers about hypothyroidism in pregnancy. A total of 19 questions were created in line with the recommendations in the latest guideline of the American Thyroid Association (ATA) on hypothyroidism in pregnancy and were asked to ChatGPT-4. The reliability and quality of the responses were scored by two independent researchers using the global quality scale (GQS) and modified DISCERN tools. The readability of ChatGPT was assessed used Flesch Reading Ease (FRE) Score, Flesch-Kincaid grade level (FKGL), Gunning Fog Index (GFI), Coleman-Liau Index (CLI), and Simple Measure of Gobbledygook (SMOG) tools. No misleading information was found in any of the answers. The mean mDISCERN score of the responses was 30.26 ± 3.14; the median GQS score was 4 (2–4). In terms of reliability, most of the answers showed moderate (78.9%) followed by good (21.1%) reliability. In the readability analysis, the median FRE was 32.20 (13.00–37.10). The years of education required to read the answers were mostly found at the university level [9 (47.3%)]. Although ChatGPT-4 has significant potential, it can be used as an auxiliary information source for counseling by creating a bridge between patients and clinicians about hypothyroidism in pregnancy. Efforts should be made to improve the reliability and readability of ChatGPT.

Investigating the proficiency of an AI tool in summarizing foot and ankle literature: A quantitative, qualitative and accuracy analysis

Artificial Intelligence (AI) is rapidly transforming various sectors of industry, including the medical community, due to its ability to simulate human intelligence processes. This study evaluates the capacity of an AI tool, ChatGPT 3.5, to summarize scientific papers in the foot and ankle surgery literature, comparing its performance to summaries written by podiatric surgery residents. Quantitative and Qualitative analyses were performed, including BLEU and ROUGE metrics, Flesch Reading Ease Score (FRES), Flesch-Kincaide Grade Level (FKGL) readability statistics, qualitative analysis by independent reviewers, and independent accuracy assessments. Results indicate that AI-generated summaries closely resemble those produced by podiatric surgery residents in terms of content, readability, and accuracy. Although differing slightly from their human-generated counterparts with a higher level of writing, AI-generated summaries offer consistency and conciseness. Overall, this study demonstrates the potential of AI tools to streamline research processes while emphasizing the importance of judicious use and oversight to maintain scholarly integrity.

"Lost in Translation: The Readability Discrepancy of Online Patient Educational Materials for PCL Surgery".

While the internet provides accessible medical information, often times it does not cater to the average patient's ability to understand medical text at a 6th and 8th grade reading level, per American Medical Association (AMA)/National Institute of Health (NIH) recommendations. This study looks to analyze current online materials relating to posterior cruciate ligament (PCL) surgery and their readability, understandability, and actionability. The top 100 Google searchs for "PCL surgery" were compiled. Research papers, procedural protocols, advertisements, and videos were excluded from the data collection. The readability was examined using 7 algorithms: the Flesch Reading Ease Score, Gunning Fog, Flesch-Kincaid Grade Level, Coleman-Liau Index, SMOG index, Automated Readability Index and the Linsear Write Formula. Two evaluators assessed Understandability and Actionability of the results with the Patient Educational Materials Assessment Tool (PEMAT). Outcome measures included Reading Grade Level, Reader's age minimum and maximum, Understandability, and Actionability. Of the 100 results, 16 were excluded based on the exclusion criteria. There was a statistically significant difference between the readability of the results from all algorithms and the current recommendation by AMA and NIH. Subgroup analysis demonstrated that there was no difference in readability as it pertained to which page they appeared on Google search. There was also no difference in readability between individual websites versus organizational websites (hospital and non-hospital educational websites). Three articles were at the 8th grade recommended reading level, and all three were from healthcare institutes. There is a discrepancy in readability between the recommendation of AMA/NIH and online educational materials regarding PCL surgeries, regardless of where they appear on Google and across different forums. The understandability and actionability were equally poor. Future research can focus on the readability and validity of video and social media as they are becoming increasingly popular sources of medical information.

Chatbot Performance in Defining and Differentiating Palliative Care, Supportive Care, Hospice Care

ContextArtificial intelligence (AI) chatbot platforms are increasingly used by patients as sources of information. However, there is limited data on the performance of these platforms, especially regarding palliative care terms. ObjectivesWe evaluated the accuracy, comprehensiveness, reliability, and readability of three AI platforms in defining and differentiating “palliative care,” “supportive care,” and “hospice care.” MethodsWe asked ChatGPT, Microsoft Bing Chat, Google Bard to define and differentiate “palliative care,” “supportive care,” and “hospice care” and provide three references. Outputs were randomized and assessed by six blinded palliative care physicians using 0–10 scales (10 = best) for accuracy, comprehensiveness, and reliability. Readability was assessed using Flesch Kincaid Grade Level and Flesch Reading Ease scores. ResultsThe mean (SD) accuracy scores for ChatGPT, Bard, and Bing Chat were 9.1 (1.3), 8.7 (1.5), and 8.2 (1.7), respectively; for comprehensiveness, the scores for the three platforms were 8.7 (1.5), 8.1 (1.9), and 5.6 (2.0), respectively; for reliability, the scores were 6.3 (2.5), 3.2 (3.1), and 7.1 (2.4), respectively. Despite generally high accuracy, we identified some major errors (e.g., Bard stated that supportive care had “the goal of prolonging life or even achieving a cure”). We found several major omissions, particularly with Bing Chat (e.g., no mention of interdisciplinary teams in palliative care or hospice care). References were often unreliable. Readability scores did not meet recommended levels for patient educational materials. ConclusionWe identified important concerns regarding the accuracy, comprehensiveness, reliability, and readability of outputs from AI platforms. Further research is needed to improve their performance.

Multimodal Discourse Analysis of English Teaching Materials in Colleges and Universities from the Perspective of Ecological Philosophical Perspective

Abstract English teaching materials serve as a critical vehicle for instruction, with well-designed materials fostering positive learning habits and interests among students. This study employs an ecological philosophy approach and multimodal discourse analysis to examine the modal shifts in college English textbooks. It utilizes the BiFPN network model to capture image features within these materials. Furthermore, the TF-IDF method extracts key terms from the textbook text, while the integration of a CNN-GRU model facilitates the classification of these terms. Additionally, this research introduces relevant computational formulas from text readability theory to evaluate the difficulty levels of these textbooks. The analysis focuses on the “New Vision College English Textbook” series, volumes Compulsory 1 through Compulsory 4. It explores the semantic relationships between text and graphics, chapter-specific reading challenges, and overall text readability indices. Findings indicate that the average proportion of graphic-text equality relations stands at 58.30%, with the highest occurrence of images depicting detailed relationships totaling 217. The Grade Level index for Compulsory 4 reaches 1.61, signifying a high complexity, whereas the Flesch Reading Ease (FRE) score for Compulsory 1 peaks at 75.42, suggesting easier comprehension. In contrast, Compulsory 2 and Compulsory 4 exhibit lower readability scores. Through multimodal discourse analysis, the study delineates the varying difficulty levels across college English textbooks, advocating for a graded approach to textbook development that aligns with students’ evolving competencies. This strategy is poised to significantly boost students’ engagement and facilitate more effective learning.

A critical evaluation of pictogram based patient information leaflet on hypothyroidism patients with metabolic syndrome: a visual approach to enhance health literacy.

Hypothyroidism is a condition with an underactive thyroid gland. Since thyroid hormones play a significant role in metabolism, hypothyroidism is often associated with metabolic syndrome. Thus, the patient's awareness regarding metabolic syndrome is crucial. To develop and evaluate a Pictogram-based Patient Information Leaflet (P-PIL) for hypothyroidism with metabolic syndrome. This is a quasi-experimental study without a control group. The P-PIL was developed and validated using the Lawshe Method, translated, and evaluated with 72 patients (24 patients each for English and regional languages, Kannada and Malayalam). The leaflet's Flesch Reading Ease (FRE) and Flesch-Kincaid Grade Level (FKGL) scores were 62.0 and 7.1, respectively. The Baker Able Leaflet Design (BALD) index of English, Kannada, and Malayalam versions of the P-PIL were 28, 27, and 27, respectively. The user testing of the P-PIL was assessed in 72 patients. The overall mean knowledge assessment scores significantly improved from 52.92 ± 6.90 to 77.92 ± 9.31. The majority of patients, precisely 84.72%, expressed a positive opinion regarding the design and layout of the P-PIL. The evaluation results strongly suggest that this P-PIL can be an effective educational tool for hypothyroidism patients with metabolic syndrome.

Accuracy and comprehensibility of chat-based artificial intelligence for patient information on atrial fibrillation and cardiac implantable electronic devices.

Natural language processing chatbots (NLPC) can be used to gather information for medical content. However, these tools contain a potential risk of misinformation. This study aims to evaluate different aspects of responses given by different NLPCs on questions about atrial fibrillation (AF) and clinical implantable electronic devices (CIED). Questions were entered into three different NLPC interfaces. Responses were evaluated with regard to appropriateness, comprehensibility, appearance of confabulation, absence of relevant content, and recommendations given for clinically relevant decisions. Moreover, readability was assessed by calculating word count and Flesch Reading Ease score. 52, 60, and 84% of responses on AF and 16, 72, and 88% on CIEDs were evaluated to be appropriate for all responses given by Google Bard, (GB) Bing Chat (BC) and ChatGPT Plus (CGP), respectively. Assessment of comprehensibility showed that 96, 88, and 92% of responses on AF and 92 and 88%, and 100% on CIEDs were comprehensible for all responses created by GB, BC, and CGP, respectively. Readability varied between different NLPCs. Relevant aspects were missing in 52% (GB), 60% (BC), and 24% (CGP) for AF, and in 92% (GB), 88% (BC), and 52% (CGP) for CIEDs. Responses generated by an NLPC are mostly easy to understand with varying readability between the different NLPCs. The appropriateness of responses is limited and varies between different NLPCs. Important aspects are often missed to be mentioned. Thus, chatbots should be used with caution to gather medical information about cardiac arrhythmias and devices.

Quality of Web-Based Sickle Cell Disease Resources for Health Care Transition: Website Content Analysis.

Adolescents and young adults with sickle cell disease (SCD) transitioning from pediatric to adult health care face a high-risk period associated with increased use of acute health care services and mortality. Although 59% of American citizens report using the internet for health care information, the quality of web-based, patient-facing resources regarding transition in SCD care has not been evaluated. This study aimed to evaluate the quality and readability of web-based health information on SCD, especially as it pertains to the transition to adulthood for inidividuals with SCD. The study also compared the readability and content scores of websites identified in 2018 to those from 2021 to assess any change in quality over time. Keywords representing phrases adolescents may use while searching for information on the internet regarding transition in SCD care, including "hydroxyurea" and "SCD transition," were identified. A web-based search using the keywords was conducted in July 2021 using Google, Yahoo, and Bing. The top 20 links from each search were collected. Duplicate websites, academic journals, and websites not related to SCD health care transition were excluded. Websites were categorized based on the source: health department, hospital or private clinician, professional society, and other websites. Websites were assessed using Health On the Net Foundation code of conduct (HONcode), Flesch Reading Ease (FRE), Flesch-Kincaid Grade Level (FGL), Ensuring Quality Information for Patients (EQIP), and a novel SCD content checklist (SCDCC). EQIP and SCDCC scores range from 0- to 100. Each website was reviewed by 2 research assistants and assessed for interrater reliability. Descriptive statistics were calculated. Of the 900 websites collected, 67 (7.4%) met the inclusion criteria: 13 health department, 7 hospital or private clinician, 33 professional society, and 14 other websites. A total of 15 (22%) out of 67 websites had HONcode certification. Websites with HONcode certification had higher FRE and EQIP scores and lower FGL scores than those without HONcode certification, reflecting greater readability. Websites without HONcode certification had higher SCDCC scores, reflecting greater clinical content. Only 7 (10%) websites met the National Institutes of Health recommendation of a seventh-grade or lower reading level. Based on EQIP scores, 6 (9%) websites were of high quality. The mean SCDCC score was 20.60 (SD 22.14) out of 100. The interrater reliability for EQIP and SCDCC ratings was good (intraclass correlation: 0.718 and 0.897, respectively). No source of website scored significantly higher mean EQIP, FRE, FGL, or SCDCC scores than the others (all P<.05). Although seeking health care information on the web is very common, the overall quality of information about transition in SCD care on the internet is poor. Changes to current web-based health care information regarding SCD care transitions would benefit transitioning youth by providing expectations, knowledge, skills, and tools to increase self-efficacy.