Information Scores Research Articles

Quality of Carpal Tunnel Syndrome Patient Education Handouts Available on the Internet: A Systematic Analysis of Content and Design

ObjectiveTo evaluate the quality of carpal tunnel syndrome (CTS) patient education handouts and identify the best resources for patients and clinicians. DesignA document content analysis of handouts identified through a systematic internet search using 8 search terms on Google and Bing and a hand search of professional association websites. SettingNot applicable. ParticipantsDocuments (N=56) were identified from the top 50 search results across 16 individual searches. Included documents provided general patient education for CTS; descriptive websites, videos, and research studies were excluded. InterventionsNot applicable. Main Outcome MeasuresContent analysis was conducted using the Information Score (IS) tool to evaluate completeness of information (0%-100%) and misleading treatment recommendations were identified. Design analysis was conducted using the Patient Material Assessment Tool for Printable Materials (PEMAT-P) (0%-100%) and 2 widely used readability formulas, Flesch Reading Ease and Flesch Kincaid Grade Level. Using these results, all handouts were rated with a summative 12-point scale. ResultsOf 805 unique search results, we included 56 CTS handouts. The average IS was 74.6%±17.9%, and 78.6% of the handouts mentioned non–evidence-based treatment recommendations. The average PEMAT-P score was 70.2%±10.9%, and the average readability grade level was 7.7±1.7. Only 3 handouts were identified as high quality based on the 12-point summative scores, 22 handouts had mixed quality, and 17 handouts had low quality on both content and design. ConclusionsFindings of this study suggest a lack of high-quality and easily understandable CTS patient education handouts. Most handouts contained unreliable treatment information. Improvements are needed to ensure patients’ ability to understand and manage this condition.

Associations Between the Subjective Cognitive Decline-Questionnaire's Scores, Gray Matter Volume, and Amyloid-β Levels.

Exploring the relationship between Alzheimer's disease (AD) biomarkers and subjective cognitive decline (SCD) is needed for better defining its clinical meaning in preclinical AD (preAD). To assess the association between the Subjective Cognitive Decline Questionnaire (SCD-Q), gray matter (GM), and cerebrospinal fluid amyloid-β (Aβ). 56 cognitively healthy older adults and their informants answered the SCD-Q. Correlations between GM and SCD-Q scores were explored using structural voxel-based morphometry models including Aβ levels. SCD-Q*Aβ vectors were calculated with higher scores reflecting higher SCD and cerebral amyloid, simultaneously. Subjects were classified according to their perception of cognitive worsening in the last two years, exploring for GM differences between-groups. Higher self-reported SCD-Q scores correlated with reduced GM in the right frontal lobe and increased volumes in the occipital lobe, calcarine sulcus, fusiform gyrus, and cerebellum, while higher informant's scores correlated with increased GM in the right middle temporal gyrus. Correlations were more significant for SCD-Q language items, self-complaints, and more positive than negative correlations were found. The SCD-Q*Aβ vectors were negatively associated with GM both in self and informant's reports. Finally, lower Aβ levels related to lower GM in subjects who noticed cognitive worsening, but related to higher GM in subjects who have not noticed this decline. Our results suggest that SCD-Q scores relate with incipient brain changes that may be due to preAD. Independent studies are needed to confirm our observations.

A preliminary study of the impact of a handover cognitive aid on clinical reasoning and information transfer

To assess the impact of a written cognitive aid on expressed clinical reasoning and quantity and the accuracy of information transfer during resident doctor handover. This study was a randomised controlled trial in an academic paediatric intensive care unit (PICU) of 20 handover events (10 events per group) from residents in their first PICU rotation using a written handover cognitive aid (intervention) or standard practice (control). Before rounds, an investigator generated a reference standard of the handover event by completing a handover aid. Resident handovers were then audio-recorded and transcribed by a blinded research assistant. The content of this transcript was inserted into a blank handover aid. A blinded content expert scored the quantity and accuracy of the information in this aid according to predetermined criteria and these information scores (ISs) were compared with the reference standard. The same expert also blindly scored the transcripts in five domains of clinical reasoning and effectiveness: (i) effective summary of events; (ii) expressed understanding of the care plan; (iii) presentation clarity; (iv) organisation; (v) overall handover effectiveness. Differences between intervention and control groups were assessed using the Mann-Whitney test and multivariate linear regression. The intervention group had total ISs that more closely approximated the reference standard (81% versus 61%; p<0.01). The intervention group had significantly higher clinical reasoning scores when compared by total score (21.1 versus 15.9 points; p=0.01) and in each of the five domains. No difference was observed in the duration of handover between groups (7.4 versus 7.7minutes; p = 0.97). Using a novel scoring system, our simple handover cognitive aid was shown to improve information transfer and resident expression of clinical reasoning without prolonging the handover duration.

Evaluation of Information of Websites on Precocious Puberty

Purpose: To evaluate the quality and scientific accuracy of internet information regarding precocious puberty. Methods: We identified websites by entering “precocious puberty” or “early puberty” into 5 search engines from May to July 2011. The top 50 websites from each search engine were included, excluding websites that were duplicate, inaccessible, or had poor information (containing fewer than two subjects of definition, causes, diagnosis, or treatment); 60 sites were identified. We classified the websites according to website author, evaluated the quality with the DISCERN instrument, giving a scientific accuracy with information score (IS) ranging from 0 to 30 points. Results: Analysis of the quality with the DISCERN instrument showed that the majority of websites received low overall ratings regardless of the authors. Assessing the scientific accuracy, the mean IS of oriental websites (10.82) was significantly low compared to that of academic authors (22.61), physician authors (21.50), commercial authors (22.88), and other authors (27.00). Conclusion: With the exception of oriental websites, scientifically accurate information was provided on the websites regarding precocious puberty. Most of the analyzed websites showed low reliability. It is important to provide reliable information as well as scientifically accurate information

A Review of Mesothelioma Information on the World Wide Web

The Internet is a widely used information resource for patients with mesothelioma. The goal of this study is to assess the content and quality of mesothelioma information presented on the internet using Google as a search engine, as well as to test the hypothesis that more popular sites (i.e., higher Google rank) are of higher quality. The top 100 websites appearing in Google using the terms "mesothelioma" were included in the study. Websites were evaluated using (a) JAMA benchmarks (authorship, references, currency, and disclosure), and (b) an Information score (IS) that awarded websites points (0-100) for specific information on various aspects of mesothelioma. Of the top 100 websites identified, 84 websites were suitable for scoring. Only 5 (6.0%) sites met all 4 criteria of the JAMA benchmarks. The mean IS was 23.8 (range, 0-86). There was a weak but significant positive correlation with Google ranking of websites and IS (r = 0.275, p = 0.006). There is marked variation in the quality, integrity, and currency of the information in educational websites for mesothelioma patients. Google ranking has shown a weak but significant positive correlation to the quality of medical information relating to mesothelioma.

The quality of information about kidney transplantation on the World Wide Web

Websites on the Internet are used increasingly by patients and those caring for them as a source of medical information. This study investigated the nature and quality of the kidney transplant-related information currently available on the World Wide Web (WWW). Four common search engines were used to explore the Internet using the keywords "kidney transplantation." Each website was assessed on the following categories: source, language, accessibility, presence of kitemarks, and quality/depth of information. Websites were scored independently by four transplant clinicians (two surgeons and two physicians), and a weighted Information Score (IS) was created to assess the overall clinical and educational value of the site. A total of 200 potential websites were identified of which 94 websites were suitable for scoring. The remaining 106 were repetitions or non-accessible links. The overall median weighted IS for the sites assessed was 21 (IQR 0-61). Median weighted IS of sites originating from Europe and USA were 47 (IQR = 21-61) and 45 (IQR = 15-61) respectively (p = 0.27). Websites belonging to academic institutions scored higher with a median weighted IS of 49 (IQR = 20-61) when compared with kitemarked websites (median 21, IQR = 5-45, p = 0.01). However, there was no statistically significant difference in weighted IS of kitemarked, professional (median 22, IQR = 2-53), commercial (median 20, IQR = 0-45), and individual websites (median 9, IQR 3-12). There was a good agreement between the observers who scored the websites with an intraclass correlation coefficient (ICC) of 0.79 and an associated 95% CI (0.73-0.90) for the four observers on the 94 websites. The educational material currently available on the WWW about kidney transplantation is often of poor quality and more input is required from transplant clinicians. Quality seals in the form of kitemarks may give a false sense of security. The gaps in validity and accuracy of the information available on complex topics such as kidney transplantation should be filled; otherwise poor quality information will continue to be the norm rather than the exception.

Information about liver transplantation on the World Wide Web

Orthotopic liver transplant (OLTx) has evolved to a successful surgical management for end-stage liver diseases. Awareness and information about OLTx is an important tool in assisting OLTx recipients and people supporting them, including non-transplant clinicians. The study aimed to investigate the nature and quality of liver transplant-related patient information on the World Wide Web. Four common search engines were used to explore the Internet by using the key words 'Liver transplant'. The URL (unique resource locator) of the top 50 returns was chosen as it was judged unlikely that the average user would search beyond the first 50 sites returned by a given search. Each Web site was assessed on the following categories: origin, language, accessibility and extent of the information. A weighted Information Score (IS) was created to assess the quality of clinical and educational value of each Web site and was scored independently by three transplant clinicians. The Internet search performed with the aid of the four search engines yielded a total of 2,255,244 Web sites. Of the 200 possible sites, only 58 Web sites were assessed because of repetition of the same Web sites and non-accessible links. The overall median weighted IS was 22 (IQR 1 - 42). Of the 58 Web sites analysed, 45 (77%) belonged to USA, six (10%) were European, and seven (12%) were from the rest of the world. The median weighted IS of publications originating from Europe and USA was 40 (IQR = 22 - 60) and 23 (IQR = 6 - 38), respectively. Although European Web sites produced a higher weighted IS [40 (IQR = 22 - 60)] as compared with the USA publications [23 (IQR = 6 - 38)], this was not statistically significant (p = 0.07). Web sites belonging to the academic institutions and the professional organizations scored significantly higher with a median weighted IS of 28 (IQR = 16 - 44) and 24(12 - 35), respectively, as compared with the commercial Web sites (median = 6 with IQR of 0 - 14, p = .001). There was an Intraclass Correlation Coefficient (ICC) of 0.89 and an associated 95% CI (0.83, 0.93) for the three observers on the 58 Web sites. The study highlights the need for a significant improvement in the information available on the World Wide Web about OLTx. It concludes that the educational material currently available on the World Wide Web about liver transplant is of poor quality and requires rigorous input from health care professionals. The authors suggest that clinicians should pay more attention to take the necessary steps to improve the standard of information available on their relevant Web sites and must take an active role in helping their patients find Web sites that provide the best and accurate information specifically applicable to the loco-regional circumstances.

Vascular surgery and the Internet: A poor source of patient-oriented information

Objective: Increasing numbers of patients use the Internet to obtain medical information. The Internet is easily accessible, but available information is under no guidelines or regulations. We sought to evaluate the type, quality, and focus of vascular disease information presented on the Internet and the role in patient education with simple search techniques. Methods: The arbitrarily chosen search phrases “abdominal aortic aneurysm (AAA),” “carotid surgery (CEA),” “claudication surgery,” and “leg gangrene surgery” were entered into five common Internet search engines. No attempt was made to refine searches. As indicated by the search engines, the 50 most commonly encountered web sites for both AAA and CEA were reviewed. The first 25 claudication sites and the first 25 gangrene sites were combined for a total of 50 leg ischemia (LIS) sites. An information score (IS) was developed as a weighted score ranging from 0 (poor) to 100 (outstanding) and was designed to assess how well the web page educated the patient about the disease, the treatment options, and the medical and surgical complications. Each vascular surgery web site was classified according to the author, the referenced information source, and the therapeutic recommendations. This was followed by an evaluation of each web site with the IS independently scored by two observers. Results: Of the 150 web sites, 146 were accessible. Ninety-six sites (65.8%) had no useful patient-oriented information (IS < 10). The mean IS and the ranges were: AAA, 14.9 (0 to 72.0); CEA, 17.5 (0 to 77.0); and LIS, 12.2 (0 to 44.5; P = .9). The mean IS of the 59 sites with scores of more than 10 were: AAA, 39.8 (n = 17); CEA, 44.8 (n = 19); and LIS, 24.8 (n = 23; P < .01, as compared with LIS scores). Differences in IS between observers were not significant ( P = .9). Misleading or unconventional care recommendations were recognized in one AAA site (1 of 47, 2.1%), two CEA sites (2 of 49, 4.1%), and 13 LIS sites (13 of 50, 26.0%). The Joint Vascular Societies web page was identified only as a tertiary link. Conclusion: Patient-oriented vascular surgery information, for common vascular diseases, is difficult to find on the Internet. The overall quality is poor, and information is difficult to obtain in part because of the large number of irrelevant sites. Of the sites that were relevant to patient education (33%), one third presented information that was classified by the authors as misleading or unconventional. This was most apparent in the leg ischemia sites. The Internet is a poor overall source of patient-oriented vascular surgery information and education. Focused and refined searches and improvements in search engines and educational web sites may yield improved information. Public and medical community awareness needs to be improved regarding the severe limitations of the Internet as an information resource. (J Vasc Surg 1999;30:84-91.)